00010000:00080000:1.2F:1788568718.479052:0:0:0:(ldlm_lib.c:3056:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 70 seconds (1 clients connected) 00010000:00080000:3.2F:1788568852.480488:0:0:0:(ldlm_lib.c:3056:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 70 seconds (1 clients connected) 00010000:00010000:2.0:1788572213.986204:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831ccf7 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.986217:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x332:0x0].0x0 (ffff94e5042ea400) 00010000:00010000:2.0:1788572213.986220:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572213.986223:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831ccf7 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.986228:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831ccf7 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x332:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.986245:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cce9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.986249:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cce9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.986254:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cce9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.986259:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572213.986262:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cce9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.986267:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cce9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.986274:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e5042ea800) 00010000:00010000:2.0:1788572213.986276:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572213.986279:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cce9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.986284:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cce9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572213.986299:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8d1c834 reply state 00000000fdedab32 transno 214748366819 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80800/0xdb7edb52b831ccf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8aa5e322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.986310:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80800/0xdb7edb52b831ccf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5e322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.986317:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8aa5e322 (ffff94e5042ea100) 00010000:00010000:2.0:1788572213.986318:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572213.986320:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572213.986403:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572213.986886:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572213.986892:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366820 00000020:00080000:2.0:1788572213.986898:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572213.986899:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366820 00000020:00080000:2.0:1788572213.990660:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572213.990665:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366820, next_transno: 214748366820 00010000:00080000:2.0:1788572213.990668:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366820) 00000020:00080000:2.0:1788572213.990671:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572213.990680:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615047168 t214748366820 from 192.168.202.13@tcp req@ffff94e6377d0a80 x1875449615047168/t0(214748366820) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:629/0 lens 504/0 e 0 to 0 dl 1788572224 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572213.990790:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831ccfe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.990809:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831ccfe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.990820:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831ccfe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.990838:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8f192411 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.990845:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f192411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.990852:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f192411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991041:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd0c lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x333:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991050:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd0c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x333:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991057:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd0c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x333:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572213.991277:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].10, 64 off8832 00010000:00010000:2.0:1788572213.991338:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd0c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x333:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991346:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd0c lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x333:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991353:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd0c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x333:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991359:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572213.991364:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd0c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x333:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991375:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd0c lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x333:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991388:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x333:0x0].0x0 (ffff94e5042ea200) 00010000:00010000:2.0:1788572213.991391:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572213.991396:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd0c lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x333:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991403:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd0c lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x333:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991425:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831ccfe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991431:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831ccfe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991437:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831ccfe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991442:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572213.991445:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831ccfe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991451:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831ccfe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991459:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e5042ea700) 00010000:00010000:2.0:1788572213.991461:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572213.991464:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831ccfe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991474:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831ccfe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572213.991486:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000999abcb reply state 00000000fec362ce transno 214748366820 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f192411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991496:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f192411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572213.991502:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f192411 (ffff94e5042ea500) 00010000:00010000:2.0:1788572213.991504:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572213.991507:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572213.991829:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572213.991850:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572213.991853:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366821 00000020:00080000:2.0:1788572213.991857:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572213.991859:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366821 00000020:00080000:2.0:1788572213.997992:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572213.997997:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366821, next_transno: 214748366821 00010000:00080000:2.0:1788572213.998001:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366821) 00000020:00080000:2.0:1788572213.998038:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572213.998050:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615047552 t214748366821 from 192.168.202.13@tcp req@ffff94e6377d0380 x1875449615047552/t0(214748366821) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:629/0 lens 504/0 e 0 to 0 dl 1788572224 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572214.003099:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.015207:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615048320 00000100:00100000:2.0:1788572214.015226:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615048320 00000100:00100000:2.0:1788572214.015309:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10675 00000100:00100000:2.0:1788572214.015321:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+50:2382:x1875449615048320:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.015344:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366823, current: 214748366823, replaying 00000100:00100000:2.0:1788572214.015401:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+50:2382:x1875449615048320:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 83us (2472us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.015409:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10675 00000020:00080000:2.0:1788572214.026463:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.026469:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366824, next_transno: 214748366824 00010000:00080000:2.0:1788572214.026473:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366824) 00000020:00080000:2.0:1788572214.026477:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.026488:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615048704 t214748366824 from 192.168.202.13@tcp req@ffff94e641107480 x1875449615048704/t0(214748366824) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.026592:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd52 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.026610:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.026624:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.026639:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.026647:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.026669:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.026883:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd60 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x337:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.026893:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd60 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x337:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.026900:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd60 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x337:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.027182:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].12, 64 off8960 00010000:00010000:2.0:1788572214.027247:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd60 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x337:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027256:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd60 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x337:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027263:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd60 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x337:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027270:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.027275:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd60 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x337:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027282:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd60 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x337:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027295:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x337:0x0].0x0 (ffff94e5042ea800) 00010000:00010000:2.0:1788572214.027299:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.027304:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd60 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x337:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027310:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd60 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x337:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027341:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027348:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd52 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027353:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027358:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.027361:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027367:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd52 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027374:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e5042ea700) 00010000:00010000:2.0:1788572214.027376:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.027379:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd52 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027385:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd52 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.027397:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abe0af1a reply state 0000000000341196 transno 214748366824 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027409:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.027414:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae3ad178 (ffff94e5042ea200) 00010000:00010000:2.0:1788572214.027417:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.027420:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.027507:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.027527:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.027530:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366825 00000020:00080000:2.0:1788572214.027534:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.027536:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366825 00000100:00100000:2.0:1788572214.034347:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615049472 00000100:00100000:2.0:1788572214.034359:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615049472 00000100:00100000:2.0:1788572214.034438:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10678 00000100:00100000:2.0:1788572214.034448:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+56:2382:x1875449615049472:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.034470:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366826, current: 214748366826, replaying 00000100:00100000:2.0:1788572214.034489:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+56:2382:x1875449615049472:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (345us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.034496:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10678 00000020:00080000:2.0:1788572214.038664:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.038668:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366827, next_transno: 214748366827 00010000:00080000:2.0:1788572214.038672:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366827) 00000020:00080000:2.0:1788572214.038675:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.038684:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615049856 t214748366827 from 192.168.202.13@tcp req@ffff94e641106300 x1875449615049856/t0(214748366827) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.038782:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd91 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.038798:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.038811:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.038825:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc89db40c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.038832:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc89db40c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.038838:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc89db40c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039038:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cd9f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x33a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039047:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cd9f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039053:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cd9f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.039280:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].14, 64 off9088 00010000:00010000:2.0:1788572214.039341:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cd9f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039349:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cd9f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039356:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cd9f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039362:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.039366:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cd9f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039378:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cd9f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039391:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x33a:0x0].0x0 (ffff94e5042ea400) 00010000:00010000:2.0:1788572214.039394:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.039398:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cd9f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039405:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cd9f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x33a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039428:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039434:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd91 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039439:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039444:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.039447:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039453:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd91 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039460:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e5042ea700) 00010000:00010000:2.0:1788572214.039463:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.039465:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd91 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039475:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cd91 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.039487:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5cb6f29 reply state 00000000de030960 transno 214748366827 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc89db40c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039497:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc89db40c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.039503:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc89db40c (ffff94e5042ea800) 00010000:00010000:2.0:1788572214.039506:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.039508:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.039577:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.039594:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.039597:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366828 00000020:00080000:2.0:1788572214.039601:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.039603:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366828 00000100:00100000:2.0:1788572214.048348:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615050240 00000100:00100000:2.0:1788572214.048361:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615050240 00000100:00100000:2.0:1788572214.048428:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10680 00000100:00100000:2.0:1788572214.048440:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+60:2382:x1875449615050240:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.048464:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366828, current: 214748366828, replaying 00000100:00100000:2.0:1788572214.048477:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+60:2382:x1875449615050240:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 41us (267us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.048484:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10680 00000100:00100000:2.0:1788572214.067584:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615050624 00000100:00100000:2.0:1788572214.067597:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615050624 00000100:00100000:2.0:1788572214.067666:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10681 00000100:00100000:2.0:1788572214.067679:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+62:2382:x1875449615050624:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.067710:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366829, current: 214748366829, replaying 00000100:00100000:2.0:1788572214.067727:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+62:2382:x1875449615050624:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 51us (249us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.067738:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10681 00000020:00080000:2.0:1788572214.067755:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.067759:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366829, next_transno: 214748366829 00010000:00080000:2.0:1788572214.067763:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366829) 00000020:00080000:2.0:1788572214.067765:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.067773:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615050624 t214748366829 from 192.168.202.13@tcp req@ffff94e641104000 x1875449615050624/t0(214748366829) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.067856:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cdbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.067873:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cdbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.067886:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cdbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.067898:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcce55700 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.067904:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcce55700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.067910:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcce55700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068132:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cdc9 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x33c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068141:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cdc9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068149:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cdc9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.068387:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].15, 64 off9152 00010000:00010000:2.0:1788572214.068444:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cdc9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068452:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cdc9 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x33c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068459:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cdc9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x33c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068465:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.068470:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cdc9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x33c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068478:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cdc9 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x33c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068491:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x33c:0x0].0x0 (ffff94e63a94eb00) 00010000:00010000:2.0:1788572214.068495:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.068500:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cdc9 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x33c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068511:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cdc9 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x33c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068535:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cdbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068541:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cdbb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068547:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cdbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068552:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.068555:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cdbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068562:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cdbb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068570:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e5042ea700) 00010000:00010000:2.0:1788572214.068572:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.068576:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cdbb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068581:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cdbb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.068596:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000693cea19 reply state 00000000d5226257 transno 214748366829 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcce55700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068608:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcce55700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.068631:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcce55700 (ffff94e5042ea400) 00010000:00010000:2.0:1788572214.068633:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.068636:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.068726:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.068745:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.068748:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366830 00000020:00080000:2.0:1788572214.068752:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.068754:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366830 00000020:00080000:2.0:1788572214.074790:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.074796:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366830, next_transno: 214748366830 00010000:00080000:2.0:1788572214.074801:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366830) 00000020:00080000:2.0:1788572214.074805:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.074817:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615051008 t214748366830 from 192.168.202.13@tcp req@ffff94e641105880 x1875449615051008/t0(214748366830) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.074920:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cdd0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.074936:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cdd0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.074963:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cdd0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.074978:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa763f02d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.074985:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa763f02d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.074996:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa763f02d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075191:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831cdde lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x33d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075199:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831cdde lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075206:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831cdde lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.075633:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].15, 64 off9152 00010000:00010000:2.0:1788572214.075692:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831cdde lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075711:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831cdde lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075719:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831cdde lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075724:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.075729:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831cdde lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075737:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831cdde lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075750:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x33d:0x0].0x0 (ffff94e63a94e400) 00010000:00010000:2.0:1788572214.075753:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.075758:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831cdde lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075764:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831cdde lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x33d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075787:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cdd0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075794:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cdd0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075799:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cdd0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075804:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.075807:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cdd0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075813:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cdd0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075821:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94ee00) 00010000:00010000:2.0:1788572214.075823:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.075826:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cdd0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075832:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cdd0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.075845:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037ed5d76 reply state 00000000c1d99e9c transno 214748366830 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa763f02d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075860:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa763f02d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.075866:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa763f02d (ffff94e63a94ec00) 00010000:00010000:2.0:1788572214.075868:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.075871:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.076103:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.076127:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.076131:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366831 00000020:00080000:2.0:1788572214.076135:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.076137:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366831 00000020:00080000:2.0:1788572214.081371:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.081379:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366831, next_transno: 214748366831 00010000:00080000:2.0:1788572214.081385:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366831) 00000020:00080000:2.0:1788572214.081389:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.081402:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615051392 t214748366831 from 192.168.202.13@tcp req@ffff94e60fe45c00 x1875449615051392/t0(214748366831) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.081519:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cde5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.081536:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cde5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.081549:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cde5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.081562:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc250041d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.081575:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc250041d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.081581:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc250041d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.081809:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cdf3 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x33e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.081819:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cdf3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.081826:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cdf3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.082116:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].16, 64 off9216 00010000:00010000:2.0:1788572214.082172:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cdf3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x33e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082180:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cdf3 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x33e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082187:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cdf3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x33e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082193:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.082198:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cdf3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x33e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082206:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cdf3 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x33e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082222:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x33e:0x0].0x0 (ffff94e63a94e600) 00010000:00010000:2.0:1788572214.082226:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.082231:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cdf3 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x33e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082237:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cdf3 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x33e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082258:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cde5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082264:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cde5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082270:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cde5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082276:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.082279:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cde5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082285:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cde5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082292:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572214.082294:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.082297:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cde5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082303:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cde5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.082318:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073b46834 reply state 000000001e50a848 transno 214748366831 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc250041d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082328:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc250041d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.082334:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc250041d (ffff94e63a94e500) 00010000:00010000:2.0:1788572214.082336:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.082339:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.082422:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.082441:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.082444:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366832 00000020:00080000:2.0:1788572214.082447:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.082449:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366832 00000100:00100000:2.0:1788572214.091109:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615051776 00000100:00100000:2.0:1788572214.091122:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615051776 00000100:00100000:2.0:1788572214.092854:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10684 00000100:00100000:2.0:1788572214.092876:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+68:2382:x1875449615051776:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.092899:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366832, current: 214748366832, replaying 00000100:00100000:2.0:1788572214.092925:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+68:2382:x1875449615051776:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 58us (2697us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.092934:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10684 00000100:00100000:2.0:1788572214.116619:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.187201:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615201664 00000100:00100000:2.0:1788572214.187215:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615201664 00000100:00100000:2.0:1788572214.187279:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:2.0:1788572214.187291:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615201664:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572214.187384:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615201664:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 95us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572214.187394:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:2.0:1788572214.193936:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615055232 00000100:00100000:2.0:1788572214.193960:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615055232 00000100:00100000:2.0:1788572214.194053:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10693 00000100:00100000:2.0:1788572214.194064:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+86:2382:x1875449615055232:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.194085:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366841, current: 214748366841, replaying 00000100:00100000:2.0:1788572214.194096:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+86:2382:x1875449615055232:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 36us (264us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.194103:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10693 00000100:00100000:2.0:1788572214.214141:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615056000 00000100:00100000:2.0:1788572214.214159:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615056000 00000100:00100000:2.0:1788572214.214239:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10695 00000100:00100000:2.0:1788572214.214252:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+90:2382:x1875449615056000:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.214277:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366843, current: 214748366843, replaying 00000100:00100000:2.0:1788572214.214296:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+90:2382:x1875449615056000:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 48us (4992us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.214304:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10695 00000020:00080000:2.0:1788572214.214335:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.214340:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366843, next_transno: 214748366843 00010000:00080000:2.0:1788572214.214345:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366843) 00000020:00080000:2.0:1788572214.214348:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.214360:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615056000 t214748366843 from 192.168.202.13@tcp req@ffff94e63ae3e300 x1875449615056000/t0(214748366843) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.214469:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cee1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.214491:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cee1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.214505:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cee1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.214520:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.214527:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.214534:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.214747:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831ceef lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x34a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.214755:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831ceef lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x34a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.214761:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831ceef lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x34a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.215034:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].22, 64 off9600 00010000:00010000:2.0:1788572214.215092:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831ceef lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x34a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215100:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831ceef lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x34a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215108:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831ceef lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x34a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215113:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.215118:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831ceef lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x34a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215126:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831ceef lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x34a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215137:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x34a:0x0].0x0 (ffff94e63a94e400) 00010000:00010000:2.0:1788572214.215141:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.215145:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831ceef lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x34a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215152:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831ceef lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x34a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215175:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cee1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215181:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cee1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215187:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cee1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215192:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.215195:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cee1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215205:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cee1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215212:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e600) 00010000:00010000:2.0:1788572214.215214:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.215217:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cee1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215223:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831cee1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.215236:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d91d31e7 reply state 0000000076b99f39 transno 214748366843 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215248:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.215254:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xec1969c9 (ffff94e63a94ee00) 00010000:00010000:2.0:1788572214.215256:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.215258:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.215341:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.215478:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.215482:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366844 00000020:00080000:2.0:1788572214.215485:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.215487:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366844 00000100:00100000:2.0:1788572214.218498:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615056384 00000100:00100000:2.0:1788572214.218509:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615056384 00000100:00100000:2.0:1788572214.218579:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10696 00000100:00100000:2.0:1788572214.218591:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+92:2382:x1875449615056384:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.218616:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366844, current: 214748366844, replaying 00000100:00100000:2.0:1788572214.218631:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+92:2382:x1875449615056384:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (253us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.218637:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10696 00000100:00100000:2.0:1788572214.223953:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.230249:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572214.237847:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.237857:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366846, next_transno: 214748366846 00010000:00080000:2.0:1788572214.237863:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366846) 00000020:00080000:2.0:1788572214.237866:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.237881:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615057152 t214748366846 from 192.168.202.13@tcp req@ffff94e5063aaa00 x1875449615057152/t0(214748366846) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.237993:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cf20 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238039:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cf20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238052:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cf20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238064:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xafebc86b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238071:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xafebc86b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238077:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xafebc86b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238251:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cf2e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238259:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cf2e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238265:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cf2e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.238533:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].23, 64 off9664 00010000:00010000:2.0:1788572214.238600:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cf2e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238608:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cf2e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238616:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cf2e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238623:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.238628:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cf2e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238637:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cf2e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238651:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x34d:0x0].0x0 (ffff94e63a94eb00) 00010000:00010000:2.0:1788572214.238655:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.238661:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cf2e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238672:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831cf2e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x34d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238709:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cf20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238716:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cf20 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238723:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cf20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238727:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.238731:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cf20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238737:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cf20 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238745:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e600) 00010000:00010000:2.0:1788572214.238748:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.238750:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cf20 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238756:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831cf20 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.238771:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f49ab7b reply state 0000000097d653ff transno 214748366846 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xafebc86b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238784:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xafebc86b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.238791:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xafebc86b (ffff94e63a94e400) 00010000:00010000:2.0:1788572214.238794:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.238796:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.238895:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.238917:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.238921:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366847 00000020:00080000:2.0:1788572214.238925:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.238927:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366847 00000100:00100000:2.0:1788572214.257516:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.261358:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572214.261626:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.261631:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366849, next_transno: 214748366849 00010000:00080000:2.0:1788572214.261635:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366849) 00000020:00080000:2.0:1788572214.261638:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.261648:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615058304 t214748366849 from 192.168.202.13@tcp req@ffff94e5063aa300 x1875449615058304/t0(214748366849) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.261749:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831cf5f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.261765:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831cf5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.261775:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831cf5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.261786:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.261795:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.261801:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.261983:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cf6d lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x350:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.261993:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cf6d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x350:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262000:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cf6d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x350:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.262527:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].25, 64 off9792 00010000:00010000:2.0:1788572214.262589:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cf6d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x350:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262598:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cf6d lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x350:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262606:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cf6d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x350:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262612:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.262616:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cf6d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x350:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262624:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cf6d lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x350:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262641:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x350:0x0].0x0 (ffff94e63a94e200) 00010000:00010000:2.0:1788572214.262644:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.262649:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cf6d lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x350:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262654:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cf6d lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x350:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262679:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831cf5f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262685:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831cf5f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262691:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831cf5f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262707:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ece00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.262710:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831cf5f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262717:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831cf5f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262724:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e300) 00010000:00010000:2.0:1788572214.262726:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.262729:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831cf5f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262734:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831cf5f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.262751:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fb061e7 reply state 0000000051c4d978 transno 214748366849 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262762:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.262768:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7e7bccb3 (ffff94e63a94ef00) 00010000:00010000:2.0:1788572214.262770:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.262772:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.262851:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.262868:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.262870:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366850 00000020:00080000:2.0:1788572214.262873:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.262876:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366850 00000020:00080000:2.0:1788572214.266727:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.266732:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366850, next_transno: 214748366850 00010000:00080000:2.0:1788572214.266736:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366850) 00000020:00080000:2.0:1788572214.266739:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.266749:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615058688 t214748366850 from 192.168.202.13@tcp req@ffff94e637672680 x1875449615058688/t0(214748366850) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.266851:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831cf74 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.266869:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831cf74 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.266881:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831cf74 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.266898:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x16cc758c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.266906:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x16cc758c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.266912:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x16cc758c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267122:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cf82 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x351:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267132:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cf82 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x351:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267139:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cf82 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x351:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.267360:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].25, 64 off9792 00010000:00010000:2.0:1788572214.267426:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cf82 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x351:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267434:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cf82 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x351:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267442:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cf82 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x351:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267448:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.267452:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cf82 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x351:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267465:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cf82 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x351:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267477:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x351:0x0].0x0 (ffff94e63a94ea00) 00010000:00010000:2.0:1788572214.267480:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.267484:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cf82 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x351:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267491:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cf82 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x351:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267513:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831cf74 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267519:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831cf74 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267525:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831cf74 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267531:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.267534:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831cf74 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267540:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831cf74 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267548:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e600) 00010000:00010000:2.0:1788572214.267550:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.267553:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831cf74 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267563:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831cf74 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.267574:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052806fc4 reply state 0000000004aedd61 transno 214748366850 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x16cc758c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267585:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x16cc758c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.267591:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x16cc758c (ffff94e63a94eb00) 00010000:00010000:2.0:1788572214.267594:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.267598:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.267711:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.267731:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.267734:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366851 00000020:00080000:2.0:1788572214.267738:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.267740:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366851 00000100:00100000:2.0:1788572214.270541:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615059072 00000100:00100000:2.0:1788572214.270552:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615059072 00000100:00100000:2.0:1788572214.270610:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10703 00000100:00100000:2.0:1788572214.270622:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+106:2382:x1875449615059072:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.270642:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366851, current: 214748366851, replaying 00000100:00100000:2.0:1788572214.270662:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+106:2382:x1875449615059072:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (201us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.270669:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10703 00000100:00100000:2.0:1788572214.274663:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615059456 00000100:00100000:2.0:1788572214.274674:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615059456 00000100:00100000:2.0:1788572214.274754:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10704 00000100:00100000:2.0:1788572214.274764:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+108:2382:x1875449615059456:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.274787:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366852, current: 214748366852, replaying 00000100:00100000:2.0:1788572214.274804:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+108:2382:x1875449615059456:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (243us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.274812:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10704 00000100:00100000:2.0:1788572214.278693:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638886656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572214.278779:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572214.287196:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638886656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572214.314044:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572214.314620:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.314625:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366854, next_transno: 214748366854 00010000:00080000:2.0:1788572214.314630:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366854) 00000020:00080000:2.0:1788572214.314633:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.314643:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615060224 t214748366854 from 192.168.202.13@tcp req@ffff94e5063abb80 x1875449615060224/t0(214748366854) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.314752:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfc8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.314769:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.314782:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.314794:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x69da5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.314806:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x69da5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.314813:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x69da5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.314986:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfd6 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x355:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.314994:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfd6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x355:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315000:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfd6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x355:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.315259:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].27, 64 off9920 00010000:00010000:2.0:1788572214.315319:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfd6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x355:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315328:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfd6 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x355:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315335:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfd6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x355:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315340:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ecc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.315344:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfd6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x355:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315353:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfd6 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x355:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315492:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x355:0x0].0x0 (ffff94e63a94e300) 00010000:00010000:2.0:1788572214.315496:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.315503:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfd6 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x355:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315511:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfd6 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x355:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315538:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315544:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfc8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315550:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315555:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.315558:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315564:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfc8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315572:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e600) 00010000:00010000:2.0:1788572214.315574:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.315577:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfc8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315584:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfc8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.315603:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc672ba4 reply state 00000000800ddd47 transno 214748366854 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x69da5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315615:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x69da5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.315622:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x69da5647 (ffff94e63a94ea00) 00010000:00010000:2.0:1788572214.315624:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.315627:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.315810:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.315829:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.315832:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366855 00000020:00080000:2.0:1788572214.315836:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.315838:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366855 00000100:00100000:2.0:1788572214.328883:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.341445:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10707 00000100:00100000:2.0:1788572214.341461:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+114:2382:x1875449615060608:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.341482:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366855, current: 214748366855, replaying 00000100:00100000:2.0:1788572214.341499:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+114:2382:x1875449615060608:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (12630us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.341508:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10707 00000020:00080000:2.0:1788572214.341530:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.341534:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366855, next_transno: 214748366855 00010000:00080000:2.0:1788572214.341539:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366855) 00000020:00080000:2.0:1788572214.341542:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.341551:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615060608 t214748366855 from 192.168.202.13@tcp req@ffff94e5063a9500 x1875449615060608/t0(214748366855) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.341658:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.341676:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.341690:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.341716:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.341723:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.341730:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.341928:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831cfeb lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x356:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.341937:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831cfeb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x356:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344086:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831cfeb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x356:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.344646:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].28, 64 off9984 00010000:00010000:2.0:1788572214.344728:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831cfeb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x356:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344736:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831cfeb lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x356:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344743:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831cfeb lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x356:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344749:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.344753:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831cfeb lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x356:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344761:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831cfeb lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x356:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344776:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x356:0x0].0x0 (ffff94e63a94e200) 00010000:00010000:2.0:1788572214.344779:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.344784:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831cfeb lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x356:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344791:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831cfeb lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x356:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344822:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfdd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344828:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfdd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344833:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344838:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.344841:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344850:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfdd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344858:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e600) 00010000:00010000:2.0:1788572214.344860:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.344864:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfdd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344869:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831cfdd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.344880:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da388036 reply state 000000006df7ba3c transno 214748366855 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344891:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.344899:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf19c79e3 (ffff94e63a94e300) 00010000:00010000:2.0:1788572214.344901:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.344905:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.347230:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.347268:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.347272:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366856 00000020:00080000:2.0:1788572214.347277:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.347279:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366856 00000100:00100000:2.0:1788572214.358545:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572214.358819:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.358825:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366856, next_transno: 214748366856 00010000:00080000:2.0:1788572214.358830:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366856) 00000020:00080000:2.0:1788572214.358833:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.358843:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615060992 t214748366856 from 192.168.202.13@tcp req@ffff94e5063ab100 x1875449615060992/t0(214748366856) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.358953:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831cff2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.358969:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831cff2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.358980:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831cff2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.358994:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359026:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359035:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359384:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d000 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x357:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359396:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d000 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x357:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359404:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d000 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x357:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.359630:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].28, 64 off9984 00010000:00010000:2.0:1788572214.359690:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d000 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x357:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359708:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d000 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x357:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359715:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d000 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x357:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359721:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411edc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.359726:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d000 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x357:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359733:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d000 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x357:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359745:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x357:0x0].0x0 (ffff94e63a94e700) 00010000:00010000:2.0:1788572214.359748:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.359753:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d000 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x357:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359759:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d000 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x357:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359782:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831cff2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359788:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831cff2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359793:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831cff2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359798:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.359801:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831cff2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359806:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831cff2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359813:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e100) 00010000:00010000:2.0:1788572214.359815:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.359817:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831cff2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359823:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831cff2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.359833:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d8c5e24 reply state 0000000003cbdd56 transno 214748366856 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359843:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.359849:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6f33506 (ffff94e63a94ed00) 00010000:00010000:2.0:1788572214.359851:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.359853:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.360132:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.360156:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.360159:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366857 00000020:00080000:2.0:1788572214.360163:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.360165:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366857 00000020:00080000:2.0:1788572214.373882:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.373887:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366857, next_transno: 214748366857 00010000:00080000:2.0:1788572214.373892:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366857) 00000020:00080000:2.0:1788572214.373896:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.374708:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615061376 t214748366857 from 192.168.202.13@tcp req@ffff94e6377c1c00 x1875449615061376/t0(214748366857) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572214.406376:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.440119:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615062912 00000100:00100000:2.0:1788572214.440131:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615062912 00000100:00100000:2.0:1788572214.440203:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10713 00000100:00100000:2.0:1788572214.440215:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+126:2382:x1875449615062912:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.440236:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366861, current: 214748366861, replaying 00000100:00100000:2.0:1788572214.440255:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+126:2382:x1875449615062912:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (974us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.440263:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10713 00000020:00080000:2.0:1788572214.440282:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.440286:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366861, next_transno: 214748366861 00010000:00080000:2.0:1788572214.440291:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366861) 00000020:00080000:2.0:1788572214.440294:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.440304:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615062912 t214748366861 from 192.168.202.13@tcp req@ffff94e6184ed880 x1875449615062912/t0(214748366861) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.440496:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d05b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.440515:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d05b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.440527:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d05b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.440543:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831d062 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6835ad98 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.440550:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831d062 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6835ad98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.440556:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831d062 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6835ad98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.440749:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d069 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x35c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.440758:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d069 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x35c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.440766:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d069 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x35c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.455741:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d07e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x35d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.455766:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d070 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.455773:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d070 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.455779:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d070 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.455784:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.455787:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d070 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.455792:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d070 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.455799:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502364f00) 00010000:00010000:3.0:1788572214.455801:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572214.455804:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d070 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.455809:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d070 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572214.455821:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000176e5c6a reply state 00000000a00b28e1 transno 214748366862 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b831d077 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf3f7bc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.455831:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b831d077 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf3f7bc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.455837:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf3f7bc9c (ffff94e502364200) 00010000:00010000:3.0:1788572214.455839:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572214.455842:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572214.456150:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572214.456169:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.456173:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366863 00000020:00080000:3.0:1788572214.456176:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.456179:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366863 00000100:00100000:2.0:1788572214.467045:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615063680 00000100:00100000:2.0:1788572214.467056:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615063680 00000100:00100000:2.0:1788572214.467107:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10715 00000100:00100000:2.0:1788572214.467116:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+130:2382:x1875449615063680:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.467136:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366863, current: 214748366863, replaying 00000100:00100000:2.0:1788572214.467149:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+130:2382:x1875449615063680:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 34us (467us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.467156:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10715 00000100:00100000:2.0:1788572214.482288:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615064448 00000100:00100000:2.0:1788572214.482299:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615064448 00000100:00100000:2.0:1788572214.482372:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10717 00000100:00100000:2.0:1788572214.482389:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+134:2382:x1875449615064448:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.482470:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366865, current: 214748366865, replaying 00000100:00100000:2.0:1788572214.482487:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+134:2382:x1875449615064448:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 105us (295us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.482512:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10717 00000020:00080000:2.0:1788572214.482553:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.482557:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366865, next_transno: 214748366865 00010000:00080000:2.0:1788572214.482561:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366865) 00000020:00080000:2.0:1788572214.482564:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.482592:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615064448 t214748366865 from 192.168.202.13@tcp req@ffff94e637673480 x1875449615064448/t0(214748366865) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.482690:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d0af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.482718:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d0af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.482732:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d0af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.482746:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.482753:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.482760:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483064:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d0bd lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x360:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483073:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d0bd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483099:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d0bd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.483606:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].33, 64 off10304 00010000:00010000:2.0:1788572214.483667:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d0bd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483676:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d0bd lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483682:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d0bd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483689:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411eca00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.483703:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d0bd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483711:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d0bd lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483725:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x360:0x0].0x0 (ffff94e63a94e800) 00010000:00010000:2.0:1788572214.483729:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.483734:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d0bd lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483744:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d0bd lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x360:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483770:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d0af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483775:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d0af lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483781:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d0af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483786:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.483789:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d0af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483815:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d0af lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483822:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e200) 00010000:00010000:2.0:1788572214.483824:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.483826:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d0af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483831:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d0af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.483842:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d99a1c46 reply state 00000000a8b68856 transno 214748366865 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483851:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.483857:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb92a8624 (ffff94e63a94e900) 00010000:00010000:2.0:1788572214.483859:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.483862:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.483993:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1788572214.484092:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.484096:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366866 00000020:00080000:2.0:1788572214.484100:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.484102:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366866 00000020:00000004:2.0:1788572214.501746:0:112317:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572214.502059:0:112317:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788572214.510528:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.511053:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615065216 00000100:00100000:2.0:1788572214.511067:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615065216 00000100:00100000:2.0:1788572214.511135:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10719 00000100:00100000:2.0:1788572214.511147:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+138:2382:x1875449615065216:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.511170:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366867, current: 214748366867, replaying 00000100:00100000:2.0:1788572214.511186:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+138:2382:x1875449615065216:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (671us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.511194:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10719 00000020:00080000:2.0:1788572214.511213:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.511217:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366867, next_transno: 214748366867 00010000:00080000:2.0:1788572214.511222:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366867) 00000020:00080000:2.0:1788572214.511225:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.511234:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615065216 t214748366867 from 192.168.202.13@tcp req@ffff94e6184eed80 x1875449615065216/t0(214748366867) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.511357:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d0d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.511376:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.511390:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.511405:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5862f90d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.511412:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5862f90d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.511419:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5862f90d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.511613:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d0e7 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x362:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.511622:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d0e7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.511628:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d0e7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.511896:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].34, 64 off10368 00010000:00010000:2.0:1788572214.511983:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d0e7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.511993:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d0e7 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512000:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d0e7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512038:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.512043:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d0e7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512052:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d0e7 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512069:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x362:0x0].0x0 (ffff94e6135f0100) 00010000:00010000:2.0:1788572214.512072:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.512080:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d0e7 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512087:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d0e7 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x362:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512115:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512121:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d0d9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512127:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d0d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512132:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ede00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.512135:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d0d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512141:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d0d9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512152:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6135f0900) 00010000:00010000:2.0:1788572214.512154:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.512158:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d0d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512164:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d0d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.512177:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dab57734 reply state 0000000082520805 transno 214748366867 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5862f90d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512189:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5862f90d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.512195:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5862f90d (ffff94e6135f0f00) 00010000:00010000:2.0:1788572214.512197:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.512200:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.512302:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.512322:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.512325:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366868 00000020:00080000:2.0:1788572214.512329:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.512331:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366868 00000100:00100000:2.0:1788572214.525984:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:3.0:1788572214.529059:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.529065:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366868, next_transno: 214748366868 00010000:00080000:3.0:1788572214.529070:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366868) 00000020:00080000:3.0:1788572214.529074:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.529087:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615065600 t214748366868 from 192.168.202.13@tcp req@ffff94e5063a8000 x1875449615065600/t0(214748366868) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572214.529187:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d0ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529208:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d0ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529222:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d0ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529235:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24147625 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529242:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24147625 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529248:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24147625 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529429:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d0fc lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x363:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529438:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d0fc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x363:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529446:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d0fc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x363:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572214.529675:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].34, 64 off10368 00010000:00010000:3.0:1788572214.529749:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d0fc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x363:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529756:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d0fc lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x363:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529762:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d0fc lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x363:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529767:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.529772:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d0fc lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x363:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529779:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d0fc lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x363:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529791:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x363:0x0].0x0 (ffff94e502364100) 00010000:00010000:3.0:1788572214.529794:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572214.529798:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d0fc lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x363:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529807:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d0fc lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x363:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529827:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d0ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529832:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d0ee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529837:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d0ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529841:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.529843:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d0ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529848:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d0ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529855:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502364f00) 00010000:00010000:3.0:1788572214.529857:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572214.529859:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d0ee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529865:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d0ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572214.529874:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abe42cd4 reply state 000000001a6074db transno 214748366868 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24147625 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529883:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24147625 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.529890:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24147625 (ffff94e502364400) 00010000:00010000:3.0:1788572214.529892:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572214.529894:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572214.529975:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572214.529991:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.529994:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366869 00000020:00080000:3.0:1788572214.529998:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.530000:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366869 00000100:00100000:3.0:1788572214.539782:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615065984 00000100:00100000:3.0:1788572214.539794:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615065984 00000100:00100000:3.0:1788572214.539886:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10721 00000100:00100000:3.0:1788572214.539897:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+142:2382:x1875449615065984:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.539919:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366869, current: 214748366869, replaying 00000100:00100000:3.0:1788572214.539934:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+142:2382:x1875449615065984:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (298us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.540025:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10721 00000020:00080000:3.0:1788572214.540245:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.540251:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366869, next_transno: 214748366869 00010000:00080000:3.0:1788572214.540255:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366869) 00000020:00080000:3.0:1788572214.540259:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.540269:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615065984 t214748366869 from 192.168.202.13@tcp req@ffff94e501ff0000 x1875449615065984/t0(214748366869) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572214.540372:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d103 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.540390:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d103 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.540405:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d103 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.540419:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.540426:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.540433:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.540608:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d111 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x364:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.540616:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d111 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x364:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.540622:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d111 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x364:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572214.543302:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].35, 64 off10432 00010000:00010000:3.0:1788572214.543401:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d111 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x364:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543413:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d111 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x364:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543420:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d111 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x364:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543427:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.543434:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d111 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x364:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543442:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d111 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x364:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543459:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x364:0x0].0x0 (ffff94e613542100) 00010000:00010000:3.0:1788572214.543463:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572214.543468:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d111 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x364:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543475:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d111 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x364:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543511:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d103 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543518:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d103 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543523:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d103 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543528:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.543531:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d103 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543536:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d103 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543544:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613542000) 00010000:00010000:3.0:1788572214.543546:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572214.543550:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d103 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543556:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d103 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572214.543569:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b15c101 reply state 00000000e963b716 transno 214748366869 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543582:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.543590:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35b0d4cb (ffff94e613542e00) 00010000:00010000:3.0:1788572214.543592:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572214.543595:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572214.543757:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572214.543780:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.543783:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366870 00000020:00080000:3.0:1788572214.543787:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.543789:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366870 00000100:00100000:2.0:1788572214.548721:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615066368 00000100:00100000:2.0:1788572214.548733:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615066368 00000100:00100000:2.0:1788572214.548799:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10722 00000100:00100000:2.0:1788572214.548811:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+144:2382:x1875449615066368:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.548834:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366870, current: 214748366870, replaying 00000100:00100000:2.0:1788572214.548850:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+144:2382:x1875449615066368:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (195us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.548856:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10722 00000020:00080000:3.0:1788572214.548922:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.548928:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366870, next_transno: 214748366870 00010000:00080000:3.0:1788572214.548933:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366870) 00000020:00080000:3.0:1788572214.548937:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.548949:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615066368 t214748366870 from 192.168.202.13@tcp req@ffff94e501ff3100 x1875449615066368/t0(214748366870) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572214.549224:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d118 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549247:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d118 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549261:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d118 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549275:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd7569629 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549281:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd7569629 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549288:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd7569629 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549482:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d126 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x365:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549491:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d126 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x365:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549497:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d126 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x365:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572214.549791:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].35, 64 off10432 00010000:00010000:3.0:1788572214.549875:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d126 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x365:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549884:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d126 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x365:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549893:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d126 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x365:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549899:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.549906:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d126 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x365:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549914:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d126 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x365:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.549928:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x365:0x0].0x0 (ffff94e640e4cc00) 00010000:00010000:3.0:1788572214.549931:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572214.552293:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d126 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x365:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.552321:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d126 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x365:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.552359:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d118 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.552368:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d118 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.552376:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d118 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.552382:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.552386:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d118 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.552394:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d118 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.552411:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e640e4ce00) 00010000:00010000:3.0:1788572214.552414:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572214.552420:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d118 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.552426:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d118 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572214.552439:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042039185 reply state 0000000008b097ac transno 214748366870 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd7569629 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.552451:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd7569629 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.552458:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd7569629 (ffff94e640e4c000) 00010000:00010000:3.0:1788572214.552461:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572214.552464:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572214.552571:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572214.552595:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.552599:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366871 00000020:00080000:3.0:1788572214.552603:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.552605:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366871 00000100:00100000:2.0:1788572214.563174:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615066752 00000100:00100000:2.0:1788572214.563188:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615066752 00000100:00100000:2.0:1788572214.563254:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10723 00000100:00100000:2.0:1788572214.563265:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+146:2382:x1875449615066752:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.563285:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366871, current: 214748366871, replaying 00000100:00100000:2.0:1788572214.563307:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+146:2382:x1875449615066752:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (724us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.563313:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10723 00000100:00100000:2.0:1788572214.577746:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615067520 00000100:00100000:2.0:1788572214.577760:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615067520 00000100:00100000:2.0:1788572214.577834:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10725 00000100:00100000:2.0:1788572214.577844:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+150:2382:x1875449615067520:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.577866:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366873, current: 214748366873, replaying 00000100:00100000:2.0:1788572214.577888:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+150:2382:x1875449615067520:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (495us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.577895:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10725 00000100:00100000:3.0:1788572214.585112:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.593906:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.605807:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.606040:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615068672 00000100:00100000:3.0:1788572214.606051:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615068672 00000100:00100000:3.0:1788572214.606124:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10728 00000100:00100000:3.0:1788572214.606137:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+157:2382:x1875449615068672:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.606163:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366876, current: 214748366876, replaying 00000100:00100000:3.0:1788572214.606186:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+157:2382:x1875449615068672:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 53us (393us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.606193:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10728 00000020:00080000:2.0:1788572214.606401:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.606406:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366876, next_transno: 214748366876 00010000:00080000:2.0:1788572214.606411:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366876) 00000020:00080000:2.0:1788572214.606414:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.606424:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615068672 t214748366876 from 192.168.202.13@tcp req@ffff94e5063a8a80 x1875449615068672/t0(214748366876) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.606520:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d196 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.606537:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d196 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.606549:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d196 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.606563:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.606570:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.606577:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.606796:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1a4 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.606805:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1a4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x36b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.606813:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1a4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x36b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.607104:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].38, 64 off10624 00010000:00010000:2.0:1788572214.607165:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1a4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x36b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607174:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1a4 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x36b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607181:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1a4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x36b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607189:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.607193:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1a4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x36b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607201:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1a4 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x36b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607214:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x36b:0x0].0x0 (ffff94e6135f0d00) 00010000:00010000:2.0:1788572214.607218:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.607223:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1a4 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x36b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607230:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1a4 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x36b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607250:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d196 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607256:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d196 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607262:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d196 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607266:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.607269:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d196 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607278:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d196 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607285:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6135f0900) 00010000:00010000:2.0:1788572214.607287:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.607290:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d196 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607295:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d196 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.607306:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f01ca85d reply state 00000000b01991e5 transno 214748366876 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607580:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.607588:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf34c54b6 (ffff94e6135f0100) 00010000:00010000:2.0:1788572214.607591:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.607594:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.607687:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.607715:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.607718:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366877 00000020:00080000:2.0:1788572214.607722:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.607724:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366877 00000100:00100000:2.0:1788572214.619971:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.620040:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615069056 00000100:00100000:3.0:1788572214.620052:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615069056 00000100:00100000:3.0:1788572214.620124:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10729 00000100:00100000:3.0:1788572214.620137:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+158:2382:x1875449615069056:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.620165:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366877, current: 214748366877, replaying 00000100:00100000:3.0:1788572214.620185:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+158:2382:x1875449615069056:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 51us (230us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.620192:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10729 00000020:00080000:2.0:1788572214.620207:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.620212:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366877, next_transno: 214748366877 00010000:00080000:2.0:1788572214.620216:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366877) 00000020:00080000:2.0:1788572214.620220:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.620230:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615069056 t214748366877 from 192.168.202.13@tcp req@ffff94e5063a9f80 x1875449615069056/t0(214748366877) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.620324:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620341:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620354:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620368:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620375:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620382:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620570:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d1b9 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x36c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620580:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d1b9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620588:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d1b9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.620865:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].39, 64 off10688 00010000:00010000:2.0:1788572214.620937:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d1b9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620946:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d1b9 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620954:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d1b9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620960:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ece00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.620966:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d1b9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620974:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d1b9 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.620991:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x36c:0x0].0x0 (ffff94e6135f0800) 00010000:00010000:2.0:1788572214.620995:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.621032:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d1b9 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.621038:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d1b9 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x36c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.621066:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.621073:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ab lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.621079:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.621084:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.621087:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.621093:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.621101:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6135f0c00) 00010000:00010000:2.0:1788572214.621104:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.621106:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.621113:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.621129:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028300776 reply state 000000008f9c20dc transno 214748366877 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.621142:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.621148:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8d64bc (ffff94e6135f0300) 00010000:00010000:2.0:1788572214.621151:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.621155:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.621241:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.621261:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.621264:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366878 00000020:00080000:2.0:1788572214.621268:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.621270:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366878 00000100:00100000:3.0:1788572214.624890:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572214.626381:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.626386:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366878, next_transno: 214748366878 00010000:00080000:2.0:1788572214.626391:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366878) 00000020:00080000:2.0:1788572214.626394:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.626405:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615069440 t214748366878 from 192.168.202.13@tcp req@ffff94e63ae69f80 x1875449615069440/t0(214748366878) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 2 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.626503:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d1c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.626519:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.626532:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.626545:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x26df8995 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.626552:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x26df8995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.626557:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x26df8995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.626748:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d1ce lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x36d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.626758:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d1ce lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x36d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.626764:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d1ce lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x36d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.626984:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].39, 64 off10688 00010000:00010000:2.0:1788572214.627071:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d1ce lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x36d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627080:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d1ce lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x36d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627087:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d1ce lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x36d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627093:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.627098:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d1ce lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x36d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627106:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d1ce lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x36d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627118:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x36d:0x0].0x0 (ffff94e6135f0500) 00010000:00010000:2.0:1788572214.627121:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.627126:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d1ce lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x36d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627132:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d1ce lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x36d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627150:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627156:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d1c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627162:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d1c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627167:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.627171:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d1c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627177:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d1c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627185:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6135f0900) 00010000:00010000:2.0:1788572214.627187:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.627190:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d1c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627196:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d1c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.627206:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7f88d5f reply state 0000000064a2ff05 transno 214748366878 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x26df8995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627218:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x26df8995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.627225:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x26df8995 (ffff94e6135f0d00) 00010000:00010000:2.0:1788572214.627227:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.627230:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.627314:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.627324:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.627326:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366879 00000020:00080000:2.0:1788572214.627330:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.627332:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366879 00000100:00100000:2.0:1788572214.642178:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615069824 00000100:00100000:2.0:1788572214.642189:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615069824 00000100:00100000:2.0:1788572214.642248:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10731 00000100:00100000:2.0:1788572214.642259:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+162:2382:x1875449615069824:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.642279:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366879, current: 214748366879, replaying 00000100:00100000:2.0:1788572214.642302:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+162:2382:x1875449615069824:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (195us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.642309:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10731 00000100:00100000:3.0:1788572214.651155:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615070208 00000100:00100000:3.0:1788572214.651165:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615070208 00000100:00100000:3.0:1788572214.651229:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10732 00000100:00100000:3.0:1788572214.651239:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+164:2382:x1875449615070208:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.651260:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366880, current: 214748366880, replaying 00000100:00100000:3.0:1788572214.651277:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+164:2382:x1875449615070208:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (285us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.651284:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10732 00000100:00100000:2.0:1788572214.655436:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.655512:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615070592 00000100:00100000:3.0:1788572214.655523:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615070592 00000100:00100000:3.0:1788572214.655588:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10733 00000100:00100000:3.0:1788572214.655599:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+166:2382:x1875449615070592:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.655621:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366881, current: 214748366881, replaying 00000100:00100000:3.0:1788572214.655642:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+166:2382:x1875449615070592:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (220us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.655649:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10733 00000020:00080000:2.0:1788572214.655676:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.655680:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366881, next_transno: 214748366881 00010000:00080000:2.0:1788572214.655685:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366881) 00000020:00080000:2.0:1788572214.655688:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.655708:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615070592 t214748366881 from 192.168.202.13@tcp req@ffff94e5063a9c00 x1875449615070592/t0(214748366881) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.655872:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.655889:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.655900:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.655913:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.655920:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.655926:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.656584:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d20d lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x370:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.656597:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d20d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x370:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.656606:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d20d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x370:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.657295:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].41, 64 off10816 00010000:00010000:2.0:1788572214.657532:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d20d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x370:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657542:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d20d lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x370:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657548:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d20d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x370:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657554:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ede00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.657575:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d20d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x370:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657602:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d20d lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x370:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657645:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x370:0x0].0x0 (ffff94e6135f0e00) 00010000:00010000:2.0:1788572214.657649:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.657656:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d20d lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x370:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657702:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d20d lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x370:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657868:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657876:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ff lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657882:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657887:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.657891:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657914:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657924:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6135f0c00) 00010000:00010000:2.0:1788572214.657926:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.657929:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.657935:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d1ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.658057:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fb12574 reply state 00000000c3c892fa transno 214748366881 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.658083:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.658125:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa58b1d89 (ffff94e6135f0800) 00010000:00010000:2.0:1788572214.658128:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.658132:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.658269:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.658299:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.658302:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366882 00000020:00080000:2.0:1788572214.658306:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.658422:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366882 00000100:00100000:2.0:1788572214.662399:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615070976 00000100:00100000:2.0:1788572214.662409:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615070976 00000100:00100000:2.0:1788572214.662680:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10734 00000100:00100000:2.0:1788572214.662702:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+168:2382:x1875449615070976:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.662724:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366882, current: 214748366882, replaying 00000100:00100000:2.0:1788572214.662748:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+168:2382:x1875449615070976:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 60us (679us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.662754:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10734 00000020:00080000:3.0:1788572214.662810:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.662817:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366882, next_transno: 214748366882 00010000:00080000:3.0:1788572214.662822:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366882) 00000020:00080000:3.0:1788572214.662825:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.662834:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615070976 t214748366882 from 192.168.202.13@tcp req@ffff94e501ff2680 x1875449615070976/t0(214748366882) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572214.662932:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d214 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.662962:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d214 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.662974:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d214 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.662988:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.662995:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663018:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663240:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d222 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x371:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663249:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d222 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663257:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d222 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572214.663520:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].41, 64 off10816 00010000:00010000:3.0:1788572214.663582:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d222 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663590:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d222 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663597:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d222 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663603:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.663608:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d222 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663616:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d222 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663631:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x371:0x0].0x0 (ffff94e640e4c800) 00010000:00010000:3.0:1788572214.663635:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572214.663640:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d222 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663647:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d222 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x371:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663666:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d214 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663672:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d214 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663682:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d214 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663687:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.663702:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d214 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663709:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d214 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.663717:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e640e4ce00) 00010000:00010000:3.0:1788572214.663720:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572214.663723:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d214 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.665422:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d214 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572214.665453:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d61c648b reply state 00000000a6aff269 transno 214748366882 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.665469:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.665478:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc7978ac (ffff94e640e4cc00) 00010000:00010000:3.0:1788572214.665481:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572214.665485:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572214.665719:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572214.665757:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.665761:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366883 00000020:00080000:3.0:1788572214.665766:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.665768:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366883 00000100:00100000:3.0:1788572214.671131:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615071360 00000100:00100000:3.0:1788572214.671141:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615071360 00000100:00100000:3.0:1788572214.671206:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10735 00000100:00100000:3.0:1788572214.671218:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+170:2382:x1875449615071360:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.671239:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366883, current: 214748366883, replaying 00000100:00100000:3.0:1788572214.671254:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+170:2382:x1875449615071360:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (251us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.671262:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10735 00000100:00100000:3.0:1788572214.679142:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572214.684054:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.684059:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366884, next_transno: 214748366884 00010000:00080000:2.0:1788572214.684064:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366884) 00000020:00080000:2.0:1788572214.684068:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.684079:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615071744 t214748366884 from 192.168.202.13@tcp req@ffff94e63ae6a680 x1875449615071744/t0(214748366884) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.684235:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d23e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684252:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d23e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684266:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d23e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684280:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684288:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684294:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684505:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d24c lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x373:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684514:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d24c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x373:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684521:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d24c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x373:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.684758:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].42, 64 off10880 00010000:00010000:2.0:1788572214.684820:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d24c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x373:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684827:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d24c lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x373:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684833:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d24c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x373:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684839:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.684845:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d24c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x373:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684852:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d24c lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x373:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684866:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x373:0x0].0x0 (ffff94e6135f0900) 00010000:00010000:2.0:1788572214.684869:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.684874:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d24c lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x373:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684881:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d24c lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x373:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684902:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d23e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684908:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d23e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684913:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d23e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684918:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.684921:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d23e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684927:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d23e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684934:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6135f0c00) 00010000:00010000:2.0:1788572214.684937:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.684940:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d23e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684946:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d23e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.684956:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000893f9b54 reply state 00000000dcd03aae transno 214748366884 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684967:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.684973:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x68e46f0f (ffff94e6135f0e00) 00010000:00010000:2.0:1788572214.684976:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.684979:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.685162:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.685186:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.685189:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366885 00000020:00080000:2.0:1788572214.685193:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.685195:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366885 00000100:00100000:2.0:1788572214.710137:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572214.715044:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.715054:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366885, next_transno: 214748366885 00010000:00080000:2.0:1788572214.715059:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366885) 00000020:00080000:2.0:1788572214.715062:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.715080:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615072128 t214748366885 from 192.168.202.13@tcp req@ffff94e5063a9180 x1875449615072128/t0(214748366885) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.715191:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d253 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715213:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d253 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715224:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d253 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715238:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715245:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715252:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715462:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d261 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x374:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715472:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d261 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x374:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715479:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d261 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x374:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.715716:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].43, 64 off10944 00010000:00010000:2.0:1788572214.715781:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d261 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x374:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715789:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d261 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x374:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715796:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d261 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x374:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715803:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.715807:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d261 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x374:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715815:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d261 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x374:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715829:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x374:0x0].0x0 (ffff94e6135f0500) 00010000:00010000:2.0:1788572214.715832:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.715837:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d261 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x374:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715842:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d261 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x374:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715864:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d253 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715869:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d253 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715874:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d253 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715879:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.715882:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d253 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715888:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d253 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715900:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6135f0c00) 00010000:00010000:2.0:1788572214.715902:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.715905:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d253 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715910:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d253 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.715923:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008abe2435 reply state 00000000a49f4df8 transno 214748366885 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715934:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.715941:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x307bf9d4 (ffff94e6135f0900) 00010000:00010000:2.0:1788572214.715943:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.715946:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.716081:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.716102:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.716106:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366886 00000020:00080000:2.0:1788572214.716110:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.716112:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366886 00000020:00080000:2.0:1788572214.734682:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.734701:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366886, next_transno: 214748366886 00010000:00080000:2.0:1788572214.734706:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366886) 00000020:00080000:2.0:1788572214.734709:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.734724:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615072512 t214748366886 from 192.168.202.13@tcp req@ffff94e637671c00 x1875449615072512/t0(214748366886) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.734879:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d268 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.734902:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d268 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.734922:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d268 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.734936:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x97775db3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.734944:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x97775db3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.734951:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x97775db3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735194:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d276 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x375:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735204:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d276 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x375:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735211:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d276 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x375:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.735475:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].43, 64 off10944 00010000:00010000:2.0:1788572214.735540:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d276 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x375:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735549:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d276 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x375:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735557:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d276 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x375:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735563:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.735567:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d276 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x375:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735575:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d276 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x375:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735590:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x375:0x0].0x0 (ffff94e6135f0700) 00010000:00010000:2.0:1788572214.735593:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.735597:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d276 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x375:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735604:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d276 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x375:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735624:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d268 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735630:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d268 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735635:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d268 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735639:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.735642:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d268 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735650:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d268 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735657:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6135f0c00) 00010000:00010000:2.0:1788572214.735659:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.735662:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d268 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.735667:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d268 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.735678:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074865ceb reply state 00000000682f6a5e transno 214748366886 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x97775db3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.740624:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x97775db3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.740648:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x97775db3 (ffff94e6135f0500) 00010000:00010000:2.0:1788572214.740651:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.740658:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.740798:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.740841:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.740845:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366887 00000020:00080000:2.0:1788572214.740849:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.740851:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366887 00000100:00100000:3.0:1788572214.746371:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572214.746644:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.746648:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366887, next_transno: 214748366887 00010000:00080000:2.0:1788572214.746651:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366887) 00000020:00080000:2.0:1788572214.746653:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.746662:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615072896 t214748366887 from 192.168.202.13@tcp req@ffff94e5058a4700 x1875449615072896/t0(214748366887) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.746765:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d27d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.746781:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d27d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.746794:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d27d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.746808:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x56770d6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.746814:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x56770d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.746819:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x56770d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747245:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d28b lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x376:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747256:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d28b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747265:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d28b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.747504:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].44, 64 off11008 00010000:00010000:2.0:1788572214.747563:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d28b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747576:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d28b lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747584:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d28b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747590:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145ba00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.747595:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d28b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747605:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d28b lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747619:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x376:0x0].0x0 (ffff94e63a94e200) 00010000:00010000:2.0:1788572214.747622:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.747627:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d28b lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747634:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d28b lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x376:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747655:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d27d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747662:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d27d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747668:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d27d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747673:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.747677:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d27d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747683:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d27d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747704:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6135f0b00) 00010000:00010000:2.0:1788572214.747706:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.747710:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d27d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747716:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d27d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.747730:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c931289c reply state 000000003808d8a1 transno 214748366887 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x56770d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747741:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x56770d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.747748:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x56770d6e (ffff94e6135f0a00) 00010000:00010000:2.0:1788572214.747750:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.747753:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.747890:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.747910:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.747913:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366888 00000020:00080000:2.0:1788572214.747917:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.747919:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366888 00000100:00100000:2.0:1788572214.759872:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.760049:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615073280 00000100:00100000:3.0:1788572214.760062:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615073280 00000100:00100000:3.0:1788572214.760132:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10740 00000100:00100000:3.0:1788572214.760146:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+180:2382:x1875449615073280:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.760173:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366888, current: 214748366888, replaying 00000100:00100000:3.0:1788572214.760197:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+180:2382:x1875449615073280:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 54us (334us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.760205:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10740 00000100:00100000:2.0:1788572214.768191:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615073664 00000100:00100000:2.0:1788572214.768201:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615073664 00000100:00100000:2.0:1788572214.768266:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10741 00000100:00100000:2.0:1788572214.768276:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+182:2382:x1875449615073664:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.768295:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366889, current: 214748366889, replaying 00000100:00100000:2.0:1788572214.768310:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+182:2382:x1875449615073664:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 36us (331us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.768318:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10741 00000020:00080000:2.0:1788572214.768335:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.768338:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366889, next_transno: 214748366889 00010000:00080000:2.0:1788572214.768343:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366889) 00000020:00080000:2.0:1788572214.768346:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.768355:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615073664 t214748366889 from 192.168.202.13@tcp req@ffff94e5038c0380 x1875449615073664/t0(214748366889) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.768443:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d2a7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768460:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768472:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768485:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768493:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768499:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768670:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d2b5 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x378:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768680:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d2b5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x378:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768699:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d2b5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x378:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.768911:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].45, 64 off11072 00010000:00010000:2.0:1788572214.768962:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d2b5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x378:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768970:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d2b5 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x378:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768977:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d2b5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x378:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768983:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.768988:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d2b5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x378:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.768995:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d2b5 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x378:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.769031:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x378:0x0].0x0 (ffff94e63a94e100) 00010000:00010000:2.0:1788572214.769035:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.769040:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d2b5 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x378:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.769051:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d2b5 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x378:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.769074:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d2a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.769080:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d2a7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.769086:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d2a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.769091:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.769094:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d2a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.769100:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d2a7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.769108:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e200) 00010000:00010000:2.0:1788572214.769110:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.769113:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d2a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.769119:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d2a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.769132:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b82cdee6 reply state 00000000e53c896d transno 214748366889 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.769143:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.769150:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa3d6624d (ffff94e63a94e800) 00010000:00010000:2.0:1788572214.769152:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.769155:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.769230:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.769355:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.769358:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366890 00000020:00080000:2.0:1788572214.769362:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.769364:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366890 00000100:00100000:3.0:1788572214.773466:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.779634:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615074432 00000100:00100000:3.0:1788572214.779646:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615074432 00000100:00100000:3.0:1788572214.779724:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10743 00000100:00100000:3.0:1788572214.779736:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+186:2382:x1875449615074432:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.779760:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366891, current: 214748366891, replaying 00000100:00100000:3.0:1788572214.779773:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+186:2382:x1875449615074432:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 41us (231us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.779780:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10743 00000020:00080000:3.0:1788572214.783831:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.783836:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366892, next_transno: 214748366892 00010000:00080000:3.0:1788572214.783841:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366892) 00000020:00080000:3.0:1788572214.783844:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.783853:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615074816 t214748366892 from 192.168.202.13@tcp req@ffff94e637671880 x1875449615074816/t0(214748366892) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572214.784088:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d2e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784105:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d2e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784118:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d2e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784135:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784142:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784149:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784406:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d2f4 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x37b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784416:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d2f4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x37b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784423:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d2f4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x37b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572214.784640:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].46, 64 off11136 00010000:00010000:3.0:1788572214.784711:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d2f4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x37b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784720:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d2f4 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x37b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784727:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d2f4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x37b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784732:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.784737:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d2f4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x37b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784744:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d2f4 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x37b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784756:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x37b:0x0].0x0 (ffff94e640e4c600) 00010000:00010000:3.0:1788572214.784760:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572214.784765:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d2f4 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x37b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784771:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d2f4 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x37b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784798:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d2e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784805:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d2e6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784811:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d2e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784816:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.784819:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d2e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784825:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d2e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784833:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e640e4ce00) 00010000:00010000:3.0:1788572214.784835:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572214.784838:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d2e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784844:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d2e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572214.784858:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000561dbbd3 reply state 00000000815dd448 transno 214748366892 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784869:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.784875:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc6ad9d74 (ffff94e640e4c800) 00010000:00010000:3.0:1788572214.784878:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572214.784881:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572214.785196:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572214.785216:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.785219:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366893 00000020:00080000:3.0:1788572214.785223:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.785225:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366893 00000100:00100000:2.0:1788572214.805417:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615075584 00000100:00100000:2.0:1788572214.805435:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615075584 00000100:00100000:2.0:1788572214.805502:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10746 00000100:00100000:2.0:1788572214.805512:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+192:2382:x1875449615075584:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.805533:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366894, current: 214748366894, replaying 00000100:00100000:2.0:1788572214.805590:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+192:2382:x1875449615075584:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 79us (6765us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.805598:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10746 00000100:00100000:3.0:1788572214.812189:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.817853:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615076352 00000100:00100000:2.0:1788572214.817865:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615076352 00000100:00100000:2.0:1788572214.817929:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10748 00000100:00100000:2.0:1788572214.817941:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+196:2382:x1875449615076352:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.817969:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366896, current: 214748366896, replaying 00000100:00100000:2.0:1788572214.818098:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+196:2382:x1875449615076352:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 159us (366us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.818106:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10748 00000100:00100000:2.0:1788572214.822126:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.826744:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572214.828043:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.828050:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366898, next_transno: 214748366898 00010000:00080000:2.0:1788572214.828055:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366898) 00000020:00080000:2.0:1788572214.828059:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.828071:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615077120 t214748366898 from 192.168.202.13@tcp req@ffff94e641195500 x1875449615077120/t0(214748366898) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572214.828451:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d364 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828465:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d364 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828474:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d364 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828482:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x88c34532 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828487:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x88c34532 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828491:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x88c34532 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828651:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d372 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x381:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828656:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d372 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x381:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828664:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d372 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x381:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572214.828889:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].49, 64 off11328 00010000:00010000:3.0:1788572214.828949:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d372 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x381:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828956:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d372 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x381:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828963:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d372 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x381:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828968:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.828972:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d372 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x381:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828980:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d372 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x381:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.828992:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x381:0x0].0x0 (ffff94e640e4c100) 00010000:00010000:3.0:1788572214.828995:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572214.829001:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d372 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x381:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.829029:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d372 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x381:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.829048:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d364 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.829059:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d364 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.829064:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d364 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.829069:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.829072:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d364 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.829078:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d364 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.829086:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e640e4ce00) 00010000:00010000:3.0:1788572214.829088:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572214.829091:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d364 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.829097:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d364 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572214.829108:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1472d22 reply state 00000000625c9246 transno 214748366898 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x88c34532 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.829118:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88c34532 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.829124:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x88c34532 (ffff94e640e4c600) 00010000:00010000:3.0:1788572214.829126:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572214.829128:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572214.829209:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572214.829227:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.829229:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366899 00000020:00080000:3.0:1788572214.829233:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.829235:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366899 00000100:00100000:2.0:1788572214.839203:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.847502:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.847536:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615078272 00000100:00100000:3.0:1788572214.847548:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615078272 00000100:00100000:3.0:1788572214.847607:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10753 00000100:00100000:3.0:1788572214.847617:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+206:2382:x1875449615078272:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.847639:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366901, current: 214748366901, replaying 00000100:00100000:3.0:1788572214.847660:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+206:2382:x1875449615078272:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (168us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.847667:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10753 00000100:00100000:3.0:1788572214.851069:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.851128:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615078656 00000100:00100000:2.0:1788572214.851139:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615078656 00000100:00100000:2.0:1788572214.851195:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10754 00000100:00100000:2.0:1788572214.851204:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+208:2382:x1875449615078656:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.851225:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366902, current: 214748366902, replaying 00000100:00100000:2.0:1788572214.851239:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+208:2382:x1875449615078656:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 36us (181us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.851245:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10754 00000020:00080000:3.0:1788572214.851262:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.851293:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366902, next_transno: 214748366902 00010000:00080000:3.0:1788572214.851297:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366902) 00000020:00080000:3.0:1788572214.851300:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.851375:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615078656 t214748366902 from 192.168.202.13@tcp req@ffff94e634b2a300 x1875449615078656/t0(214748366902) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572214.851465:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d3b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.851482:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d3b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.851494:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d3b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.851512:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.851519:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.851526:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.851720:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d3c6 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x385:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.851730:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d3c6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x385:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.851738:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d3c6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x385:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572214.852053:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].51, 64 off11456 00000004:00080000:3.0:1788572214.852063:0:112013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 4131873058311ns, next at 4132873055507ns, rc = 0 00010000:00010000:3.0:1788572214.852120:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d3c6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x385:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852128:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d3c6 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x385:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852135:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d3c6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x385:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852140:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.852144:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d3c6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x385:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852152:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d3c6 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x385:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852166:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x385:0x0].0x0 (ffff94e613542000) 00010000:00010000:3.0:1788572214.852169:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572214.852175:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d3c6 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x385:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852182:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d3c6 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x385:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852205:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d3b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852212:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d3b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852217:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d3b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852222:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.852225:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d3b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852232:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d3b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852239:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e640e4ce00) 00010000:00010000:3.0:1788572214.852242:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572214.852244:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d3b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852255:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d3b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572214.852268:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbe78b46 reply state 000000001e51d369 transno 214748366902 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852279:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.852285:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefa84bc9 (ffff94e640e4c100) 00010000:00010000:3.0:1788572214.852287:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572214.852290:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572214.852443:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572214.852473:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.852477:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366903 00000020:00080000:3.0:1788572214.852481:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.852483:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366903 00000100:00100000:3.0:1788572214.855187:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615079040 00000100:00100000:3.0:1788572214.855199:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615079040 00000100:00100000:3.0:1788572214.855272:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10755 00000100:00100000:3.0:1788572214.855284:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+210:2382:x1875449615079040:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.855307:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366903, current: 214748366903, replaying 00000100:00100000:3.0:1788572214.855335:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+210:2382:x1875449615079040:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 54us (210us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.855343:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10755 00000100:00100000:3.0:1788572214.859866:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.864071:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.865204:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615079808 00000100:00100000:3.0:1788572214.865217:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615079808 00000100:00100000:3.0:1788572214.865275:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10757 00000100:00100000:3.0:1788572214.865284:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+214:2382:x1875449615079808:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.865469:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366905, current: 214748366905, replaying 00000100:00100000:3.0:1788572214.865484:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+214:2382:x1875449615079808:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 202us (1426us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.865492:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10757 00000100:00100000:3.0:1788572214.871172:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.871432:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615080192 00000100:00100000:2.0:1788572214.871443:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615080192 00000100:00100000:2.0:1788572214.871529:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10758 00000100:00100000:2.0:1788572214.871547:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+216:2382:x1875449615080192:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.871569:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366906, current: 214748366906, replaying 00000100:00100000:2.0:1788572214.871585:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+216:2382:x1875449615080192:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (423us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.871592:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10758 00010000:00010000:1.0:1788572214.871972:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d41a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.871980:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d41a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572214.872213:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].53, 64 off11584 00010000:00010000:1.0:1788572214.872267:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d41a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872275:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d41a lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872282:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d41a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872288:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572214.872292:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d41a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872299:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d41a lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872312:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x389:0x0].0x0 (ffff94e61e76f900) 00010000:00010000:1.0:1788572214.872315:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572214.872320:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d41a lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872327:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d41a lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x389:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872347:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d40c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872369:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d40c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872376:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d40c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872381:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572214.872384:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d40c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872389:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d40c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872396:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e76f000) 00010000:00010000:1.0:1788572214.872398:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572214.872401:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d40c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872406:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d40c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572214.872417:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005735ac6a reply state 00000000551e932f transno 214748366906 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280200/0xdb7edb52b831d413 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x156a1dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872427:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280200/0xdb7edb52b831d413 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x156a1dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.872433:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x156a1dc4 (ffff94e61e76ff00) 00010000:00010000:1.0:1788572214.872436:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572214.872438:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572214.872508:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572214.872535:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.872537:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366907 00000020:00080000:1.0:1788572214.872541:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.872543:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366907 00000100:00100000:1.0:1788572214.875000:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.875268:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615080576 00000100:00100000:3.0:1788572214.875277:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615080576 00000100:00100000:3.0:1788572214.875336:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10759 00000100:00100000:3.0:1788572214.875346:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+218:2382:x1875449615080576:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.875367:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366907, current: 214748366907, replaying 00000100:00100000:3.0:1788572214.875389:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+218:2382:x1875449615080576:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (400us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.875396:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10759 00000020:00080000:2.0:1788572214.875454:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.875459:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366907, next_transno: 214748366907 00010000:00080000:2.0:1788572214.875463:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366907) 00000020:00080000:2.0:1788572214.875466:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.875475:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615080576 t214748366907 from 192.168.202.13@tcp req@ffff94e5038c0700 x1875449615080576/t0(214748366907) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.875571:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d421 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.875587:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d421 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.875599:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d421 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.875610:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.875616:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.875621:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.875814:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d42f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x38a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.875822:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d42f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.875829:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d42f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.876249:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].54, 64 off11648 00010000:00010000:2.0:1788572214.876307:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d42f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876315:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d42f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x38a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876323:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d42f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876328:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.876332:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d42f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876339:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d42f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x38a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876353:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x38a:0x0].0x0 (ffff94e63a94e600) 00010000:00010000:2.0:1788572214.876368:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.876373:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d42f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x38a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876379:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d42f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x38a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876402:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d421 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876408:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d421 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876419:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d421 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876424:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.876427:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d421 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876433:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d421 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876441:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e200) 00010000:00010000:2.0:1788572214.876443:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.876446:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d421 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876451:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d421 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.876462:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3c922cd reply state 0000000013d01d33 transno 214748366907 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876472:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.876479:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdd3e0619 (ffff94e63a94e100) 00010000:00010000:2.0:1788572214.876481:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.876483:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.876580:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.876597:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.876600:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366908 00000020:00080000:2.0:1788572214.876605:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.876606:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366908 00000100:00100000:3.0:1788572214.880462:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615080960 00000100:00100000:3.0:1788572214.880472:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615080960 00000100:00100000:3.0:1788572214.880527:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10760 00000100:00100000:3.0:1788572214.880539:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+220:2382:x1875449615080960:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.880561:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366908, current: 214748366908, replaying 00000100:00100000:3.0:1788572214.880582:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+220:2382:x1875449615080960:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (238us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.880590:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10760 00000020:00080000:2.0:1788572214.880640:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.880646:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366908, next_transno: 214748366908 00010000:00080000:2.0:1788572214.880651:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366908) 00000020:00080000:2.0:1788572214.880653:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.880664:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615080960 t214748366908 from 192.168.202.13@tcp req@ffff94e637671180 x1875449615080960/t0(214748366908) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.880783:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d436 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.880799:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d436 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.880810:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d436 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.880825:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.880831:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.880837:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881061:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d444 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x38b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881070:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d444 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881079:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d444 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.881302:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].54, 64 off11648 00010000:00010000:2.0:1788572214.881375:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d444 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881383:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d444 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881389:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d444 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881395:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145ae00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.881400:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d444 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881408:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d444 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881419:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x38b:0x0].0x0 (ffff94e6135f0c00) 00010000:00010000:2.0:1788572214.881423:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.881428:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d444 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881435:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d444 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881456:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d436 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881466:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d436 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881471:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d436 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881476:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145aa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.881478:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d436 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881484:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d436 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881491:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572214.881493:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.881496:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d436 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881501:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d436 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.881514:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2ce8ea5 reply state 0000000072fbf9c4 transno 214748366908 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881526:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.881532:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9a47f3e (ffff94e6135f0b00) 00010000:00010000:2.0:1788572214.881534:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.881537:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.881632:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.881650:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.881654:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366909 00000020:00080000:2.0:1788572214.881657:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.881659:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366909 00000100:00100000:3.0:1788572214.886527:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572214.886660:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615081344 00000100:00100000:1.0:1788572214.886670:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615081344 00000100:00100000:1.0:1788572214.886744:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10761 00000100:00100000:1.0:1788572214.886754:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+222:2382:x1875449615081344:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572214.886777:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366909, current: 214748366909, replaying 00000100:00100000:1.0:1788572214.886799:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+222:2382:x1875449615081344:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (286us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572214.886807:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10761 00000020:00080000:3.0:1788572214.886861:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.886866:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366909, next_transno: 214748366909 00010000:00080000:3.0:1788572214.886870:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366909) 00000020:00080000:3.0:1788572214.886873:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.886883:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615081344 t214748366909 from 192.168.202.13@tcp req@ffff94e634bea680 x1875449615081344/t0(214748366909) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572214.886993:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d44b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887037:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d44b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887049:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d44b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887063:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887071:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887077:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887268:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d459 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x38c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887279:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d459 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887291:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d459 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572214.887530:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].55, 64 off11712 00010000:00010000:3.0:1788572214.887581:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d459 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887590:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d459 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x38c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887597:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d459 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887603:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.887607:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d459 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887615:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d459 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x38c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887627:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x38c:0x0].0x0 (ffff94e640e4ce00) 00010000:00010000:3.0:1788572214.887630:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572214.887634:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d459 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x38c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887642:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d459 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x38c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887661:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d44b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887672:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d44b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887678:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d44b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887683:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.887697:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d44b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887704:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d44b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887711:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613542000) 00010000:00010000:3.0:1788572214.887713:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572214.887716:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d44b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887722:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d44b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572214.887737:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092f115c3 reply state 000000005ff5d822 transno 214748366909 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887748:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.887754:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f75c793 (ffff94e613542100) 00010000:00010000:3.0:1788572214.887757:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572214.887759:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572214.887832:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572214.887852:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.887855:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366910 00000020:00080000:3.0:1788572214.887859:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.887861:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366910 00000100:00100000:1.0:1788572214.893429:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.893577:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615081728 00000100:00100000:3.0:1788572214.893591:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615081728 00000100:00100000:3.0:1788572214.893659:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10762 00000100:00100000:3.0:1788572214.893672:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+224:2382:x1875449615081728:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.893704:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366910, current: 214748366910, replaying 00000100:00100000:3.0:1788572214.893726:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+224:2382:x1875449615081728:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 58us (316us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.893733:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10762 00000020:00080000:2.0:1788572214.893853:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.893857:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366910, next_transno: 214748366910 00010000:00080000:2.0:1788572214.893862:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366910) 00000020:00080000:2.0:1788572214.893865:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.893878:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615081728 t214748366910 from 192.168.202.13@tcp req@ffff94e5038c0a80 x1875449615081728/t0(214748366910) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.893987:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d460 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894040:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d460 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894055:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d460 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894072:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894079:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894086:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894316:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d46e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x38d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894326:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d46e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894333:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d46e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.894611:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].55, 64 off11712 00010000:00010000:2.0:1788572214.894669:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d46e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894677:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d46e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894696:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d46e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894704:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145b000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.894709:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d46e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894717:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d46e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894731:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x38d:0x0].0x0 (ffff94e63a94e600) 00010000:00010000:2.0:1788572214.894735:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.894739:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d46e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894746:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d46e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x38d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894789:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d460 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894796:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d460 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894803:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d460 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894808:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.894812:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d460 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894819:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d460 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894828:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6135f0700) 00010000:00010000:2.0:1788572214.894830:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.894833:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d460 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894840:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d460 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.894854:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b98d0a1 reply state 000000006d6ab4be transno 214748366910 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894866:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.894873:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb3580c60 (ffff94e63a94e200) 00010000:00010000:2.0:1788572214.894876:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.894879:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.894978:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.894997:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.895000:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366911 00000020:00080000:2.0:1788572214.895028:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.895031:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366911 00000100:00100000:1.0:1788572214.898818:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.899148:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615082112 00000100:00100000:3.0:1788572214.899161:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615082112 00000100:00100000:3.0:1788572214.899250:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10763 00000100:00100000:3.0:1788572214.899262:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+226:2382:x1875449615082112:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.899288:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366911, current: 214748366911, replaying 00000100:00100000:3.0:1788572214.899338:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+226:2382:x1875449615082112:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 79us (532us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.899346:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10763 00000020:00080000:2.0:1788572214.899396:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.899401:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366911, next_transno: 214748366911 00010000:00080000:2.0:1788572214.899405:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366911) 00000020:00080000:2.0:1788572214.899408:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.899420:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615082112 t214748366911 from 192.168.202.13@tcp req@ffff94e5038c1180 x1875449615082112/t0(214748366911) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.899544:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d475 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.899560:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d475 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.899572:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d475 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.899586:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.899592:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.899599:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.899780:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d483 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x38e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.899789:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d483 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.899795:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d483 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.900387:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].56, 64 off11776 00010000:00010000:2.0:1788572214.900452:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d483 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900461:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d483 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900468:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d483 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900474:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145b600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.900479:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d483 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900487:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d483 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900500:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x38e:0x0].0x0 (ffff94e5042ea700) 00010000:00010000:2.0:1788572214.900504:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.900508:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d483 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900518:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d483 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900540:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d475 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900546:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d475 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900551:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d475 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900556:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145aa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.900559:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d475 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900565:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d475 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900573:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572214.900575:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.900578:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d475 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900584:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d475 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.900597:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4061cb2 reply state 00000000318c3fc0 transno 214748366911 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900607:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.900614:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8e1f9ac5 (ffff94e6135f0c00) 00010000:00010000:2.0:1788572214.900617:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.900619:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.900770:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.900791:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.900795:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366912 00000020:00080000:2.0:1788572214.900799:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.900801:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366912 00000100:00100000:1.0:1788572214.905773:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.905867:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615082496 00000100:00100000:3.0:1788572214.905877:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615082496 00000100:00100000:3.0:1788572214.906161:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10764 00000100:00100000:3.0:1788572214.906173:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+228:2382:x1875449615082496:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.906192:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366912, current: 214748366912, replaying 00000100:00100000:3.0:1788572214.906217:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+228:2382:x1875449615082496:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (456us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.906224:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10764 00000020:00080000:1.0:1788572214.906271:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.906275:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366912, next_transno: 214748366912 00010000:00080000:1.0:1788572214.906280:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366912) 00000020:00080000:1.0:1788572214.906283:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.906293:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615082496 t214748366912 from 192.168.202.13@tcp req@ffff94e5038c3100 x1875449615082496/t0(214748366912) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572214.906391:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d48a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.906407:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d48a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.906420:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d48a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.906433:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11d613ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.906440:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11d613ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.906447:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11d613ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.906620:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d498 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x38f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.906631:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d498 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.906639:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d498 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572214.906865:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].56, 64 off11776 00010000:00010000:1.0:1788572214.906926:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d498 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907570:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d498 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907579:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d498 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907585:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572214.907592:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d498 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907600:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d498 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907616:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x38f:0x0].0x0 (ffff94e61e76fb00) 00010000:00010000:1.0:1788572214.907619:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572214.907623:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d498 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907630:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d498 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907657:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d48a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907664:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d48a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907670:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d48a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907675:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572214.907678:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d48a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907684:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d48a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907703:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e76f000) 00010000:00010000:1.0:1788572214.907706:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572214.907709:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d48a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907715:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d48a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572214.907727:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e60dbbc reply state 00000000b82117b4 transno 214748366912 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11d613ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907737:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x11d613ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.907744:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11d613ea (ffff94e61e76f900) 00010000:00010000:1.0:1788572214.907747:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572214.907750:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572214.907854:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572214.908230:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.908235:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366913 00000020:00080000:1.0:1788572214.908239:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.908241:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366913 00000100:00100000:1.0:1788572214.911657:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.911761:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615082880 00000100:00100000:3.0:1788572214.911775:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615082880 00000100:00100000:3.0:1788572214.911848:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10765 00000100:00100000:3.0:1788572214.911859:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+230:2382:x1875449615082880:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.911886:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366913, current: 214748366913, replaying 00000100:00100000:3.0:1788572214.911910:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+230:2382:x1875449615082880:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 54us (265us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.911918:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10765 00000020:00080000:2.0:1788572214.912068:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.912075:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366913, next_transno: 214748366913 00010000:00080000:2.0:1788572214.912081:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366913) 00000020:00080000:2.0:1788572214.912085:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.912095:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615082880 t214748366913 from 192.168.202.13@tcp req@ffff94e60fc11c00 x1875449615082880/t0(214748366913) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.912217:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d49f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912237:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d49f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912252:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d49f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912267:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912274:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912284:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912464:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4ad lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x390:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912472:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4ad lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x390:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912479:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4ad lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x390:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.912712:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].57, 64 off11840 00010000:00010000:2.0:1788572214.912773:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4ad lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x390:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912781:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4ad lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x390:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912788:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4ad lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x390:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912794:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.912799:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4ad lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x390:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912807:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4ad lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x390:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912820:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x390:0x0].0x0 (ffff94e6053c7300) 00010000:00010000:2.0:1788572214.912823:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.912829:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4ad lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x390:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912837:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4ad lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x390:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912859:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d49f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912867:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d49f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912873:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d49f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912878:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.912881:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d49f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912887:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d49f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912895:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6135f0700) 00010000:00010000:2.0:1788572214.912897:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.912900:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d49f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912906:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d49f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.912920:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f32745f4 reply state 00000000f3e0a3ac transno 214748366913 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912949:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.912956:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5cd6ef7 (ffff94e63a94e600) 00010000:00010000:2.0:1788572214.912958:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.912961:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.913104:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.913124:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.913127:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366914 00000020:00080000:2.0:1788572214.913131:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.913132:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366914 00000100:00100000:1.0:1788572214.915750:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.915820:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615083264 00000100:00100000:2.0:1788572214.915830:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615083264 00000100:00100000:2.0:1788572214.915883:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10766 00000100:00100000:2.0:1788572214.915893:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+232:2382:x1875449615083264:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.915914:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366914, current: 214748366914, replaying 00000100:00100000:2.0:1788572214.915939:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+232:2382:x1875449615083264:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 41us (195us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.915946:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10766 00000020:00080000:1.0:1788572214.916072:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.916076:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366914, next_transno: 214748366914 00010000:00080000:1.0:1788572214.916080:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366914) 00000020:00080000:1.0:1788572214.916082:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.916090:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615083264 t214748366914 from 192.168.202.13@tcp req@ffff94e60fc12300 x1875449615083264/t0(214748366914) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572214.916181:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d4b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916194:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d4b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916203:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d4b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916211:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916216:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916220:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916371:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d4c2 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x391:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916379:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d4c2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916385:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d4c2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572214.916593:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].57, 64 off11840 00010000:00010000:1.0:1788572214.916643:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d4c2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916649:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d4c2 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916654:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d4c2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916658:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572214.916661:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d4c2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916667:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d4c2 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916676:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x391:0x0].0x0 (ffff94e61e76f200) 00010000:00010000:1.0:1788572214.916678:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572214.916681:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d4c2 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916698:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d4c2 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x391:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916726:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d4b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916732:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d4b4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916737:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d4b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916742:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572214.916745:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d4b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916752:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d4b4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916763:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e76fa00) 00010000:00010000:1.0:1788572214.916766:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572214.916769:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d4b4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916774:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d4b4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572214.916787:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097d2404e reply state 00000000db73d88f transno 214748366914 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916796:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.916802:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbad0c8b0 (ffff94e61e76f700) 00010000:00010000:1.0:1788572214.916804:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572214.916806:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572214.917377:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572214.917398:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.917401:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366915 00000020:00080000:1.0:1788572214.917405:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.917406:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366915 00000100:00100000:3.0:1788572214.920980:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.921177:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615083648 00000100:00100000:2.0:1788572214.921190:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615083648 00000100:00100000:2.0:1788572214.921255:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10767 00000100:00100000:2.0:1788572214.921265:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+234:2382:x1875449615083648:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.921286:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366915, current: 214748366915, replaying 00000100:00100000:2.0:1788572214.921301:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+234:2382:x1875449615083648:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 39us (333us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.921309:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10767 00000020:00080000:1.0:1788572214.921397:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.921403:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366915, next_transno: 214748366915 00010000:00080000:1.0:1788572214.921407:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366915) 00000020:00080000:1.0:1788572214.921410:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.921429:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615083648 t214748366915 from 192.168.202.13@tcp req@ffff94e634be8a80 x1875449615083648/t0(214748366915) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572214.921555:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d4c9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.921572:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.921583:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.921602:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x73a91119 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.921608:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x73a91119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.921614:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x73a91119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.921810:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d4d7 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x392:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.921818:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d4d7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.921825:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d4d7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572214.922570:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].58, 64 off11904 00010000:00010000:1.0:1788572214.922646:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d4d7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.922655:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d4d7 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.922663:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d4d7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.922668:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572214.922673:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d4d7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.922682:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d4d7 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.922713:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x392:0x0].0x0 (ffff94e61e76fc00) 00010000:00010000:1.0:1788572214.922716:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572214.923475:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d4d7 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.923487:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d4d7 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x392:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.923522:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.923528:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d4c9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.923534:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d4c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.923540:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572214.923543:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d4c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.923553:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d4c9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.923564:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e76f000) 00010000:00010000:1.0:1788572214.923567:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572214.923571:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d4c9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.923576:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d4c9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572214.923589:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0d5c406 reply state 000000009cf0533a transno 214748366915 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x73a91119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.923602:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73a91119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.923610:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x73a91119 (ffff94e61e76fb00) 00010000:00010000:1.0:1788572214.923612:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572214.923615:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572214.923742:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572214.923767:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.923771:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366916 00000020:00080000:1.0:1788572214.923775:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.923777:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366916 00000100:00100000:2.0:1788572214.931946:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.932219:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615084032 00000100:00100000:3.0:1788572214.932230:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615084032 00000100:00100000:3.0:1788572214.932296:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10768 00000100:00100000:3.0:1788572214.932307:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+236:2382:x1875449615084032:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.932332:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366916, current: 214748366916, replaying 00000100:00100000:3.0:1788572214.932357:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+236:2382:x1875449615084032:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 52us (428us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.932364:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10768 00000020:00080000:2.0:1788572214.932425:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.932430:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366916, next_transno: 214748366916 00010000:00080000:2.0:1788572214.932435:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366916) 00000020:00080000:2.0:1788572214.932440:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.932451:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615084032 t214748366916 from 192.168.202.13@tcp req@ffff94e5033f1f80 x1875449615084032/t0(214748366916) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572214.932556:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.932572:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.932585:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.932598:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.932604:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.932609:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.932802:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d4ec lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x393:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.932810:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d4ec lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x393:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.932817:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d4ec lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x393:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572214.933220:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].58, 64 off11904 00010000:00010000:2.0:1788572214.933285:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d4ec lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x393:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933294:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d4ec lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x393:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933301:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d4ec lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x393:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933307:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145b200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.933311:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d4ec lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x393:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933320:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d4ec lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x393:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933332:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x393:0x0].0x0 (ffff94e6053c7600) 00010000:00010000:2.0:1788572214.933335:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572214.933341:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d4ec lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x393:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933348:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d4ec lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x393:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933371:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933383:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933390:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933395:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572214.933398:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933403:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933411:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7300) 00010000:00010000:2.0:1788572214.933413:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572214.933416:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933421:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d4de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572214.933432:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f57ff0e5 reply state 000000003dbe9f44 transno 214748366916 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933442:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572214.933448:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d8f0ad2 (ffff94e6053c7900) 00010000:00010000:2.0:1788572214.933450:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572214.933452:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572214.933530:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572214.933548:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.933551:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366917 00000020:00080000:2.0:1788572214.933555:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572214.933557:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366917 00000100:00100000:1.0:1788572214.941419:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.941516:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615084416 00000100:00100000:3.0:1788572214.941528:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615084416 00000100:00100000:3.0:1788572214.941599:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10769 00000100:00100000:3.0:1788572214.941611:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+238:2382:x1875449615084416:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.941633:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366917, current: 214748366917, replaying 00000100:00100000:3.0:1788572214.941653:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+238:2382:x1875449615084416:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (247us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.941659:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10769 00000020:00080000:3.0:1788572214.946176:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.946187:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366917, next_transno: 214748366917 00010000:00080000:3.0:1788572214.946193:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366917) 00000020:00080000:3.0:1788572214.946196:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.946212:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615084416 t214748366917 from 192.168.202.13@tcp req@ffff94e60fc10380 x1875449615084416/t0(214748366917) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572214.946317:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d4f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946347:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d4f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946359:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d4f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946375:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946382:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946388:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946552:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d501 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x394:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946565:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d501 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x394:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946571:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d501 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x394:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572214.946794:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].59, 64 off11968 00010000:00010000:3.0:1788572214.946854:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d501 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x394:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946862:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d501 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x394:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946869:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d501 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x394:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946874:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.946879:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d501 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x394:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946888:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d501 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x394:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946900:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x394:0x0].0x0 (ffff94e502364f00) 00010000:00010000:3.0:1788572214.946903:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572214.946908:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d501 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x394:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946915:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d501 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x394:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946941:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d4f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946948:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d4f3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946954:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d4f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946959:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572214.946962:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d4f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946968:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d4f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946975:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e640e4ce00) 00010000:00010000:3.0:1788572214.946978:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572214.946980:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d4f3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.946986:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d4f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572214.946998:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5b3c6bd reply state 00000000793ad5e1 transno 214748366917 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.947042:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572214.947048:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x610a62d3 (ffff94e613542000) 00010000:00010000:3.0:1788572214.947050:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572214.947053:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572214.947161:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572214.947185:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.947188:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366918 00000020:00080000:3.0:1788572214.947191:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572214.947193:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366918 00000100:00100000:3.0:1788572214.953079:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.953222:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615084800 00000100:00100000:2.0:1788572214.953234:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615084800 00000100:00100000:2.0:1788572214.953299:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10770 00000100:00100000:2.0:1788572214.953310:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+240:2382:x1875449615084800:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.953334:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366918, current: 214748366918, replaying 00000100:00100000:2.0:1788572214.953359:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+240:2382:x1875449615084800:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 52us (294us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.953367:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10770 00000100:00100000:1.0:1788572214.959295:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.959499:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615085184 00000100:00100000:3.0:1788572214.959513:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615085184 00000100:00100000:3.0:1788572214.959607:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10771 00000100:00100000:3.0:1788572214.959618:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+242:2382:x1875449615085184:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.959639:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366919, current: 214748366919, replaying 00000100:00100000:3.0:1788572214.959656:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+242:2382:x1875449615085184:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 41us (376us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.959664:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10771 00000100:00100000:1.0:1788572214.967636:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572214.967726:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615085568 00000100:00100000:3.0:1788572214.967738:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615085568 00000100:00100000:3.0:1788572214.967809:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10772 00000100:00100000:3.0:1788572214.967820:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+244:2382:x1875449615085568:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572214.967841:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366920, current: 214748366920, replaying 00000100:00100000:3.0:1788572214.967860:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+244:2382:x1875449615085568:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (235us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572214.967868:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10772 00000100:00100000:3.0:1788572214.974069:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572214.978478:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.978491:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366921, next_transno: 214748366921 00010000:00080000:1.0:1788572214.978497:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366921) 00000020:00080000:1.0:1788572214.978501:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.978519:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615085952 t214748366921 from 192.168.202.13@tcp req@ffff94e634bea300 x1875449615085952/t0(214748366921) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:630/0 lens 504/0 e 0 to 0 dl 1788572225 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572214.978661:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d547 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.978683:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d547 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.978709:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d547 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.978723:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x33acf77f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.978730:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33acf77f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.978737:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33acf77f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.978957:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d555 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x398:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.978967:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d555 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x398:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.978973:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d555 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x398:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572214.979240:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].61, 64 off12096 00010000:00010000:1.0:1788572214.979303:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d555 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x398:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979324:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d555 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x398:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979331:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d555 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x398:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979337:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572214.979342:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d555 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x398:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979350:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d555 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x398:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979365:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x398:0x0].0x0 (ffff94e61e76fa00) 00010000:00010000:1.0:1788572214.979368:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572214.979373:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d555 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x398:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979380:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d555 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x398:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979404:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d547 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979411:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d547 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979421:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d547 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979425:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572214.979428:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d547 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979434:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d547 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979441:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e76f000) 00010000:00010000:1.0:1788572214.979444:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572214.979447:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d547 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979453:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d547 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572214.979465:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddc8b0b8 reply state 000000000cc0df0f transno 214748366921 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33acf77f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979475:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33acf77f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572214.979481:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x33acf77f (ffff94e61e76fc00) 00010000:00010000:1.0:1788572214.979483:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572214.979486:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572214.979586:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572214.979608:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.979611:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366922 00000020:00080000:1.0:1788572214.979616:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572214.979618:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366922 00010000:00010000:1.0:1788572214.979865:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572214.982493:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572214.982575:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615086336 00000100:00100000:1.0:1788572214.982585:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615086336 00000100:00100000:1.0:1788572214.982640:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10774 00000100:00100000:1.0:1788572214.982649:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+248:2382:x1875449615086336:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572214.982669:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366922, current: 214748366922, replaying 00000100:00100000:1.0:1788572214.982698:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+248:2382:x1875449615086336:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 50us (214us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572214.982704:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10774 00000100:00100000:3.0:1788572214.986836:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572214.991221:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615086720 00000100:00100000:1.0:1788572214.991251:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615086720 00000100:00100000:1.0:1788572214.991436:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10775 00000100:00100000:1.0:1788572214.991447:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+250:2382:x1875449615086720:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572214.991465:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366923, current: 214748366923, replaying 00000100:00100000:1.0:1788572214.991484:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+250:2382:x1875449615086720:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 39us (4660us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572214.991491:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10775 00000100:00100000:1.0:1788572214.999181:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572214.999367:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615087104 00000100:00100000:2.0:1788572214.999380:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615087104 00000100:00100000:2.0:1788572214.999477:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10776 00000100:00100000:2.0:1788572214.999488:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+252:2382:x1875449615087104:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572214.999513:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366924, current: 214748366924, replaying 00000100:00100000:2.0:1788572214.999532:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+252:2382:x1875449615087104:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (364us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572214.999538:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10776 00000100:00100000:1.0:1788572215.006983:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615087488 00000100:00100000:1.0:1788572215.006997:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615087488 00000100:00100000:1.0:1788572215.007100:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10777 00000100:00100000:1.0:1788572215.007113:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+254:2382:x1875449615087488:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.007138:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366925, current: 214748366925, replaying 00000100:00100000:1.0:1788572215.007154:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+254:2382:x1875449615087488:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (284us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.007161:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10777 00000100:00100000:1.0:1788572215.013872:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.013975:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615087872 00000100:00100000:3.0:1788572215.013988:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615087872 00000100:00100000:3.0:1788572215.014097:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10778 00000100:00100000:3.0:1788572215.014108:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+256:2382:x1875449615087872:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.014132:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366926, current: 214748366926, replaying 00000100:00100000:3.0:1788572215.014154:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+256:2382:x1875449615087872:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 49us (298us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.014161:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10778 00000020:00080000:2.0:1788572215.014429:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.014436:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366926, next_transno: 214748366926 00010000:00080000:2.0:1788572215.014440:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366926) 00000020:00080000:2.0:1788572215.014443:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.014455:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615087872 t214748366926 from 192.168.202.13@tcp req@ffff94e60fc11180 x1875449615087872/t0(214748366926) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.014564:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d5b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.014606:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.014620:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.014634:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.014641:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.014647:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.014856:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d5be lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x39d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.014866:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d5be lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.014873:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d5be lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.015211:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].63, 64 off12224 00010000:00010000:2.0:1788572215.015272:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d5be lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015280:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d5be lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015289:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d5be lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015295:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.015299:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d5be lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015306:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d5be lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015319:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x39d:0x0].0x0 (ffff94e6053c7500) 00010000:00010000:2.0:1788572215.015322:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.015326:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d5be lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015332:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d5be lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x39d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015356:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015362:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d5b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015368:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d5b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015374:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145b200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.015377:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d5b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015386:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d5b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015394:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7300) 00010000:00010000:2.0:1788572215.015396:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.015399:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d5b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015404:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d5b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.015415:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000445304df reply state 000000004b1e4fd0 transno 214748366926 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015426:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.015433:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbbdc1982 (ffff94e6053c7600) 00010000:00010000:2.0:1788572215.015435:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.015438:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.015592:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.015613:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.015616:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366927 00000020:00080000:2.0:1788572215.015621:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.015623:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366927 00000100:00100000:2.0:1788572215.022144:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.024504:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615088256 00000100:00100000:3.0:1788572215.024521:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615088256 00000100:00100000:1.0:1788572215.025333:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10779 00000100:00100000:1.0:1788572215.025348:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+258:2382:x1875449615088256:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.025373:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366927, current: 214748366927, replaying 00000100:00100000:1.0:1788572215.025389:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+258:2382:x1875449615088256:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (3258us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.025397:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10779 00000020:00080000:1.0:1788572215.025416:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.025420:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366927, next_transno: 214748366927 00010000:00080000:1.0:1788572215.025425:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366927) 00000020:00080000:1.0:1788572215.025428:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.025438:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615088256 t214748366927 from 192.168.202.13@tcp req@ffff94e5033f3800 x1875449615088256/t0(214748366927) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.025545:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.025563:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.025576:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.025590:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.025602:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.025609:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.025855:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5d3 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x39e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.025864:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5d3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x39e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.025870:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5d3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x39e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.026815:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].64, 64 off12288 00010000:00010000:1.0:1788572215.026890:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5d3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x39e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.026899:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5d3 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x39e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.026907:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5d3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x39e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.026914:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.026919:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5d3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x39e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.026927:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5d3 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x39e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.027059:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x39e:0x0].0x0 (ffff94e61e76f200) 00010000:00010000:1.0:1788572215.027062:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.027068:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5d3 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x39e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.027076:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5d3 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x39e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.027101:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.027107:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5c5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.027113:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.027119:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.027122:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.027129:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.027136:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e76f000) 00010000:00010000:1.0:1788572215.027139:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.027142:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5c5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.027148:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.027164:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf81eaa0 reply state 000000004252bb3b transno 214748366927 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.027174:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.027182:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x884d76d7 (ffff94e61e76fa00) 00010000:00010000:1.0:1788572215.027184:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.027186:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.027281:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.027302:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.027989:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366928 00000020:00080000:1.0:1788572215.027995:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.027997:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366928 00000100:00100000:1.0:1788572215.043547:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572215.043597:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615088640 00000100:00100000:1.0:1788572215.043607:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615088640 00000100:00100000:1.0:1788572215.043661:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10780 00000100:00100000:1.0:1788572215.043671:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+260:2382:x1875449615088640:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.043709:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366928, current: 214748366928, replaying 00000100:00100000:1.0:1788572215.043723:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+260:2382:x1875449615088640:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 54us (189us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.043730:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10780 00000020:00080000:1.0:1788572215.043752:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.043756:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366928, next_transno: 214748366928 00010000:00080000:1.0:1788572215.043761:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366928) 00000020:00080000:1.0:1788572215.043764:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.043775:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615088640 t214748366928 from 192.168.202.13@tcp req@ffff94e60fc13b80 x1875449615088640/t0(214748366928) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.043868:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.043884:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.043896:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.043908:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.043914:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.043920:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044124:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d5e8 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x39f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044132:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d5e8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044139:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d5e8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.044364:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].64, 64 off12288 00010000:00010000:1.0:1788572215.044419:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d5e8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044427:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d5e8 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044434:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d5e8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044440:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.044444:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d5e8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044452:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d5e8 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044464:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x39f:0x0].0x0 (ffff94e61e76f300) 00010000:00010000:1.0:1788572215.044466:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.044471:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d5e8 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044477:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d5e8 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x39f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044495:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044501:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044506:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044512:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.044515:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044521:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044527:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e76f000) 00010000:00010000:1.0:1788572215.044529:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.044532:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044537:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d5da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.044546:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2327176 reply state 000000006eccf767 transno 214748366928 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044555:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.044561:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b86e03c (ffff94e61e76f200) 00010000:00010000:1.0:1788572215.044563:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.044565:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.044638:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.044653:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.044655:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366929 00000020:00080000:1.0:1788572215.044659:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.044662:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366929 00000100:00100000:3.0:1788572215.054518:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572215.058103:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615089024 00000100:00100000:1.0:1788572215.058122:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615089024 00000100:00100000:1.0:1788572215.058196:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10781 00000100:00100000:1.0:1788572215.058206:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+262:2382:x1875449615089024:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.058225:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366929, current: 214748366929, replaying 00000100:00100000:1.0:1788572215.058240:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+262:2382:x1875449615089024:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 37us (3735us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.058247:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10781 00000020:00080000:1.0:1788572215.058264:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.058268:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366929, next_transno: 214748366929 00010000:00080000:1.0:1788572215.058273:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366929) 00000020:00080000:1.0:1788572215.058276:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.058284:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615089024 t214748366929 from 192.168.202.13@tcp req@ffff94e61e570700 x1875449615089024/t0(214748366929) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.058391:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d5ef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.058406:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d5ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.058419:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d5ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.058430:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe762a891 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.058437:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe762a891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.058442:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe762a891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.058624:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d5fd lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.058633:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d5fd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.058639:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d5fd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.058907:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].65, 64 off12352 00010000:00010000:1.0:1788572215.058971:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d5fd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.058978:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d5fd lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.058984:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d5fd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.058990:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.058995:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d5fd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059031:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d5fd lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059046:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3a0:0x0].0x0 (ffff94e61e76f100) 00010000:00010000:1.0:1788572215.059049:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.059054:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d5fd lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059065:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d5fd lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059089:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d5ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059095:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d5ef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059101:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d5ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059106:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.059109:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d5ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059115:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d5ef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059122:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e76f600) 00010000:00010000:1.0:1788572215.059124:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.059127:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d5ef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059132:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d5ef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.059145:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078f4b1c9 reply state 00000000986965f3 transno 214748366929 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe762a891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059156:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe762a891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.059163:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe762a891 (ffff94e61e76f400) 00010000:00010000:1.0:1788572215.059166:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.059169:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.059281:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.059447:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.059451:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366930 00000020:00080000:1.0:1788572215.059455:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.059457:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366930 00000100:00100000:1.0:1788572215.063290:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615089408 00000100:00100000:1.0:1788572215.063301:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615089408 00000100:00100000:1.0:1788572215.063360:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10782 00000100:00100000:1.0:1788572215.063371:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+264:2382:x1875449615089408:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.063392:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366930, current: 214748366930, replaying 00000100:00100000:1.0:1788572215.063413:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+264:2382:x1875449615089408:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (222us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.063419:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10782 00000020:00080000:3.0:1788572215.063465:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.063470:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366930, next_transno: 214748366930 00010000:00080000:3.0:1788572215.063475:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366930) 00000020:00080000:3.0:1788572215.063478:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.063487:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615089408 t214748366930 from 192.168.202.13@tcp req@ffff94e501ff5180 x1875449615089408/t0(214748366930) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.063605:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d604 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.063624:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d604 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.063636:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d604 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.063650:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.063657:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.063664:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.063896:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d612 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.063905:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d612 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.063912:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d612 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.064213:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].65, 64 off12352 00010000:00010000:3.0:1788572215.064273:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d612 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064281:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d612 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064288:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d612 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064294:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.064299:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d612 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064306:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d612 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064326:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3a1:0x0].0x0 (ffff94e640e4ce00) 00010000:00010000:3.0:1788572215.064329:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.064334:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d612 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064340:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831d612 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064362:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d604 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064369:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d604 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064375:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d604 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064381:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.064384:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d604 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064389:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d604 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064397:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502364f00) 00010000:00010000:3.0:1788572215.064399:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.064402:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d604 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064408:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831d604 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.064426:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc0a84df reply state 000000006038cd0d transno 214748366930 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064438:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.064445:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd8690d5e (ffff94e502364100) 00010000:00010000:3.0:1788572215.064447:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.064449:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.064537:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.064560:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.064563:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366931 00000020:00080000:3.0:1788572215.064568:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.064570:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366931 00000100:00100000:1.0:1788572215.068832:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.068927:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615089792 00000100:00100000:3.0:1788572215.068949:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615089792 00000100:00100000:3.0:1788572215.069040:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10783 00000100:00100000:3.0:1788572215.069052:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+266:2382:x1875449615089792:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.069076:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366931, current: 214748366931, replaying 00000100:00100000:3.0:1788572215.069094:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+266:2382:x1875449615089792:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (275us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.069101:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10783 00000100:00100000:1.0:1788572215.077156:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.077761:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615090176 00000100:00100000:3.0:1788572215.077775:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615090176 00000100:00100000:3.0:1788572215.078775:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10784 00000100:00100000:3.0:1788572215.078794:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+268:2382:x1875449615090176:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.078818:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366932, current: 214748366932, replaying 00000100:00100000:3.0:1788572215.078837:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+268:2382:x1875449615090176:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 50us (1691us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.078845:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10784 00000100:00100000:1.0:1788572215.083509:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615090560 00000100:00100000:1.0:1788572215.083521:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615090560 00000100:00100000:1.0:1788572215.083585:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10785 00000100:00100000:1.0:1788572215.083596:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+270:2382:x1875449615090560:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.083617:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366933, current: 214748366933, replaying 00000100:00100000:1.0:1788572215.083637:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+270:2382:x1875449615090560:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (228us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.083648:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10785 00000020:00080000:3.0:1788572215.083709:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.083714:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366933, next_transno: 214748366933 00010000:00080000:3.0:1788572215.083718:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366933) 00000020:00080000:3.0:1788572215.083720:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.083731:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615090560 t214748366933 from 192.168.202.13@tcp req@ffff94e501ff4700 x1875449615090560/t0(214748366933) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.083817:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d643 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.083835:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d643 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.083846:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d643 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.083858:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x29288f59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.083865:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x29288f59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.083872:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x29288f59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084099:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d651 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084109:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d651 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084116:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d651 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.084392:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].67, 64 off12480 00010000:00010000:3.0:1788572215.084447:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d651 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084455:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d651 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084462:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d651 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084468:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.084472:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d651 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084479:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d651 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084490:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3a4:0x0].0x0 (ffff94e61a333200) 00010000:00010000:3.0:1788572215.084493:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.084498:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d651 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084504:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d651 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084527:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d643 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084533:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d643 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084539:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d643 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084543:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.084546:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d643 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084551:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d643 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084557:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61a333600) 00010000:00010000:3.0:1788572215.084559:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.084562:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d643 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084567:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d643 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.084576:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d52fbce6 reply state 00000000f6fff5ac transno 214748366933 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x29288f59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084586:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x29288f59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.084591:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x29288f59 (ffff94e61a333f00) 00010000:00010000:3.0:1788572215.084594:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.084597:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.084660:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.084677:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.084680:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366934 00000020:00080000:3.0:1788572215.084695:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.084697:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366934 00000100:00100000:1.0:1788572215.092286:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572215.098037:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.098048:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366934, next_transno: 214748366934 00010000:00080000:2.0:1788572215.098054:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366934) 00000020:00080000:2.0:1788572215.098059:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.098077:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615090944 t214748366934 from 192.168.202.13@tcp req@ffff94e60fc11f80 x1875449615090944/t0(214748366934) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.098199:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d658 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098215:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d658 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098228:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d658 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098241:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6262f37e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098248:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262f37e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098254:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262f37e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098423:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d666 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098431:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d666 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098439:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d666 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.098626:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].67, 64 off12480 00010000:00010000:2.0:1788572215.098674:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d666 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098693:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d666 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098701:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d666 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098707:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145b200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.098712:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d666 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098720:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d666 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098731:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3a5:0x0].0x0 (ffff94e6053c7c00) 00010000:00010000:2.0:1788572215.098734:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.098739:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d666 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098745:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d666 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098764:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d658 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098769:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d658 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098775:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d658 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098781:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.098784:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d658 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098791:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d658 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098797:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7300) 00010000:00010000:2.0:1788572215.098799:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.098802:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d658 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098807:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d658 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.098815:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ed85e02 reply state 000000007bdacb24 transno 214748366934 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262f37e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098825:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262f37e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.098831:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6262f37e (ffff94e6053c7500) 00010000:00010000:2.0:1788572215.098833:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.098835:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.098907:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.098925:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.098928:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366935 00000020:00080000:2.0:1788572215.100763:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.100767:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366935 00000100:00100000:1.0:1788572215.110018:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572215.110064:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615091328 00000100:00100000:1.0:1788572215.110077:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615091328 00000100:00100000:1.0:1788572215.110146:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10787 00000100:00100000:1.0:1788572215.110157:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+274:2382:x1875449615091328:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.110178:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366935, current: 214748366935, replaying 00000100:00100000:1.0:1788572215.110195:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+274:2382:x1875449615091328:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (206us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.110202:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10787 00000020:00080000:2.0:1788572215.110386:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.110391:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366935, next_transno: 214748366935 00010000:00080000:2.0:1788572215.110396:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366935) 00000020:00080000:2.0:1788572215.110400:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.110410:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615091328 t214748366935 from 192.168.202.13@tcp req@ffff94e60fc10700 x1875449615091328/t0(214748366935) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.110508:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d66d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.110526:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d66d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.110540:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d66d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.110553:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.110560:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.110567:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.110756:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d67b lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.110764:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d67b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.110771:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d67b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.111665:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].68, 64 off12544 00010000:00010000:2.0:1788572215.111751:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d67b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111761:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d67b lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111768:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d67b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111774:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.111779:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d67b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111787:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d67b lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111802:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3a6:0x0].0x0 (ffff94e6053c7d00) 00010000:00010000:2.0:1788572215.111805:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.111810:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d67b lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111816:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d67b lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111840:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d66d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111846:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d66d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111852:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d66d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111857:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.111860:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d66d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111866:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d66d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111873:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7300) 00010000:00010000:2.0:1788572215.111876:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.111878:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d66d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111884:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d66d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.111895:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e21a6c2 reply state 00000000086d087a transno 214748366935 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111907:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.111913:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdc86f0d3 (ffff94e6053c7c00) 00010000:00010000:2.0:1788572215.111915:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.111918:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.112231:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.112255:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.112258:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366936 00000020:00080000:2.0:1788572215.112263:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.112265:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366936 00000100:00100000:3.0:1788572215.123600:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615091712 00000100:00100000:3.0:1788572215.123613:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615091712 00000100:00100000:3.0:1788572215.123695:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10788 00000100:00100000:3.0:1788572215.123708:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+276:2382:x1875449615091712:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.123731:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366936, current: 214748366936, replaying 00000100:00100000:3.0:1788572215.123754:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+276:2382:x1875449615091712:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 49us (334us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.123762:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10788 00000020:00080000:1.0:1788572215.123808:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.123813:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366936, next_transno: 214748366936 00010000:00080000:1.0:1788572215.123818:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366936) 00000020:00080000:1.0:1788572215.123821:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.123833:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615091712 t214748366936 from 192.168.202.13@tcp req@ffff94e637595180 x1875449615091712/t0(214748366936) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.123942:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d682 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.123959:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d682 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.123972:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d682 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.123985:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.123992:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.123998:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124213:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d690 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124221:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d690 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124227:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d690 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.124451:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].68, 64 off12544 00010000:00010000:1.0:1788572215.124509:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d690 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124518:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d690 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124524:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d690 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124530:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.124535:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d690 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124542:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d690 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124558:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3a7:0x0].0x0 (ffff94e61e76f000) 00010000:00010000:1.0:1788572215.124560:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.124565:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d690 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124571:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d690 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124592:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d682 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124598:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d682 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124604:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d682 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124607:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.124610:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d682 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124615:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d682 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124621:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e76f600) 00010000:00010000:1.0:1788572215.124624:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.124626:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d682 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124632:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d682 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.124645:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d47c74b6 reply state 000000002e0522c2 transno 214748366936 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124654:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.124660:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x60143ae0 (ffff94e61e76f100) 00010000:00010000:1.0:1788572215.124661:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.124664:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.124763:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.124780:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.124783:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366937 00000020:00080000:1.0:1788572215.124786:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.124788:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366937 00000100:00100000:2.0:1788572215.127330:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:3.0:1788572215.127604:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.127608:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366937, next_transno: 214748366937 00010000:00080000:3.0:1788572215.127613:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366937) 00000020:00080000:3.0:1788572215.127616:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.127625:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615092096 t214748366937 from 192.168.202.13@tcp req@ffff94e5033f2680 x1875449615092096/t0(214748366937) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.127739:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d697 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.127756:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d697 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.127769:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d697 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.127784:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.127791:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.127797:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.127990:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d6a5 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.127999:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d6a5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128124:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d6a5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.128352:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].69, 64 off12608 00010000:00010000:3.0:1788572215.128410:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d6a5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128418:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d6a5 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128425:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d6a5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128431:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.128436:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d6a5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128448:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d6a5 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128460:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3a8:0x0].0x0 (ffff94e61a333900) 00010000:00010000:3.0:1788572215.128463:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.128467:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d6a5 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128474:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d6a5 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128500:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d697 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128506:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d697 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128511:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d697 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128515:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.128518:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d697 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128524:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d697 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128530:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61a333600) 00010000:00010000:3.0:1788572215.128533:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.128535:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d697 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128545:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d697 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.128556:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085c40a4e reply state 000000002afa48ff transno 214748366937 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128566:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.128573:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a5b0335 (ffff94e61a333200) 00010000:00010000:3.0:1788572215.128575:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.128578:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.128785:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.128805:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.128808:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366938 00000020:00080000:3.0:1788572215.128811:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.128813:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366938 00000100:00100000:2.0:1788572215.136544:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615092480 00000100:00100000:2.0:1788572215.136556:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615092480 00000100:00100000:2.0:1788572215.136622:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10790 00000100:00100000:2.0:1788572215.136633:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+280:2382:x1875449615092480:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.136661:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366938, current: 214748366938, replaying 00000100:00100000:2.0:1788572215.136676:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+280:2382:x1875449615092480:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (250us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.136695:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10790 00000100:00100000:1.0:1788572215.149723:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.154077:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615092864 00000100:00100000:2.0:1788572215.154098:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615092864 00000100:00100000:2.0:1788572215.154187:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10791 00000100:00100000:2.0:1788572215.154200:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+282:2382:x1875449615092864:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.154220:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366939, current: 214748366939, replaying 00000100:00100000:2.0:1788572215.154236:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+282:2382:x1875449615092864:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 39us (4525us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.154243:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10791 00000100:00100000:2.0:1788572215.162994:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.163347:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.163352:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366940, next_transno: 214748366940 00010000:00080000:1.0:1788572215.163357:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366940) 00000020:00080000:1.0:1788572215.163360:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.163369:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615093248 t214748366940 from 192.168.202.13@tcp req@ffff94e5033f2300 x1875449615093248/t0(214748366940) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.163457:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d6d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.163478:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d6d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.163493:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d6d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.163509:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.163516:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.163523:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.163712:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d6e4 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.163721:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d6e4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.163728:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d6e4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.163954:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].70, 64 off12672 00010000:00010000:1.0:1788572215.164048:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d6e4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164056:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d6e4 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164064:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d6e4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164070:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.164075:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d6e4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164086:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d6e4 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164100:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ab:0x0].0x0 (ffff94e61e76f300) 00010000:00010000:1.0:1788572215.164104:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.164109:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d6e4 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164116:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d6e4 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164138:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d6d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164144:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d6d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164150:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d6d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164155:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.164158:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d6d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164164:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d6d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164171:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e76f600) 00010000:00010000:1.0:1788572215.164174:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.164177:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d6d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164187:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d6d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.164199:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057d20eb1 reply state 0000000085997647 transno 214748366940 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164209:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.164215:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x13f7a97c (ffff94e61e76f000) 00010000:00010000:1.0:1788572215.164218:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.164220:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.164299:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.164317:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.164320:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366941 00000020:00080000:1.0:1788572215.164324:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.164326:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366941 00000100:00100000:2.0:1788572215.167195:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572215.167288:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615093632 00000100:00100000:1.0:1788572215.167302:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615093632 00000100:00100000:1.0:1788572215.167375:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10793 00000100:00100000:1.0:1788572215.167388:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+286:2382:x1875449615093632:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.167411:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366941, current: 214748366941, replaying 00000100:00100000:1.0:1788572215.167471:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+286:2382:x1875449615093632:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 85us (288us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.167478:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10793 00010000:00010000:1.0:1788572215.168209:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d6f9 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168223:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d6f9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168231:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d6f9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.168588:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].71, 64 off12736 00010000:00010000:1.0:1788572215.168659:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d6f9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168667:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d6f9 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168674:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d6f9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168680:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.168696:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d6f9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168705:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d6f9 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168719:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ac:0x0].0x0 (ffff94e612be1e00) 00010000:00010000:1.0:1788572215.168723:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.168728:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d6f9 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168735:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d6f9 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168765:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d6eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168771:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d6eb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168777:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d6eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168782:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.168784:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d6eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168790:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d6eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168797:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e619f4ea00) 00010000:00010000:1.0:1788572215.168799:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.168802:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d6eb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168808:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d6eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.168820:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cce5d942 reply state 000000008b6d4fda transno 214748366941 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b831d6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x95197e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168830:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b831d6f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95197e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.168837:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x95197e1 (ffff94e619f4e600) 00010000:00010000:1.0:1788572215.168840:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.168843:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.168978:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.168997:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.169000:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366942 00000020:00080000:1.0:1788572215.169049:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.169052:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366942 00000100:00100000:2.0:1788572215.175303:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615094016 00000100:00100000:2.0:1788572215.175315:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615094016 00000100:00100000:2.0:1788572215.175372:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10794 00000100:00100000:2.0:1788572215.175383:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+288:2382:x1875449615094016:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.175404:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366942, current: 214748366942, replaying 00000100:00100000:2.0:1788572215.175422:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+288:2382:x1875449615094016:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (536us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.175429:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10794 00000020:00080000:1.0:1788572215.175533:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.175538:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366942, next_transno: 214748366942 00010000:00080000:1.0:1788572215.175542:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366942) 00000020:00080000:1.0:1788572215.175545:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.175554:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615094016 t214748366942 from 192.168.202.13@tcp req@ffff94e637596300 x1875449615094016/t0(214748366942) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.175650:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d700 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.175667:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d700 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.175679:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d700 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.175705:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb7081106 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.175712:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7081106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.175718:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7081106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.175893:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d70e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.175902:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d70e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.175909:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d70e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.176169:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].71, 64 off12736 00010000:00010000:1.0:1788572215.176231:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d70e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176240:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d70e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176246:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d70e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176252:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.176257:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d70e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176265:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d70e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176278:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ad:0x0].0x0 (ffff94e6416e6000) 00010000:00010000:1.0:1788572215.176281:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.176287:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d70e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176297:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d70e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176319:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d700 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176326:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d700 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176332:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d700 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176337:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.176340:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d700 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176347:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d700 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176355:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e76f600) 00010000:00010000:1.0:1788572215.176358:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.176360:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d700 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176366:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d700 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.176378:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f2cac73 reply state 0000000081482b54 transno 214748366942 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7081106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176388:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7081106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.176395:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb7081106 (ffff94e61e76f300) 00010000:00010000:1.0:1788572215.176398:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.176400:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.176497:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.176517:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.176520:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366943 00000020:00080000:1.0:1788572215.176523:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.176526:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366943 00000100:00100000:2.0:1788572215.179444:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.180089:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.180094:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366943, next_transno: 214748366943 00010000:00080000:1.0:1788572215.180098:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366943) 00000020:00080000:1.0:1788572215.180101:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.180112:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615094400 t214748366943 from 192.168.202.13@tcp req@ffff94e61e763100 x1875449615094400/t0(214748366943) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.180195:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d715 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180208:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d715 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180217:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d715 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180225:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180230:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180237:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180406:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d723 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180413:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d723 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180421:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d723 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.180610:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].72, 64 off12800 00010000:00010000:1.0:1788572215.180655:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d723 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180661:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d723 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180665:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d723 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180669:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.180672:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d723 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180677:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d723 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180698:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ae:0x0].0x0 (ffff94e63aaace00) 00010000:00010000:1.0:1788572215.180700:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.180704:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d723 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180709:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d723 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180728:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d715 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180732:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d715 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180736:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d715 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180739:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.180740:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d715 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180743:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d715 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180747:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6416e6900) 00010000:00010000:1.0:1788572215.180748:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.180750:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d715 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180753:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d715 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.180759:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f65fb32 reply state 000000004d39ee65 transno 214748366943 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180770:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.180773:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc5549f5e (ffff94e612be1e00) 00010000:00010000:1.0:1788572215.180775:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.180776:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.180840:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.180856:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.180858:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366944 00000020:00080000:1.0:1788572215.180861:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.180863:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366944 00000100:00100000:2.0:1788572215.186242:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.186379:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615094784 00000100:00100000:3.0:1788572215.186392:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615094784 00000100:00100000:3.0:1788572215.186465:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10796 00000100:00100000:3.0:1788572215.186477:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+292:2382:x1875449615094784:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.186504:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366944, current: 214748366944, replaying 00000100:00100000:3.0:1788572215.186529:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+292:2382:x1875449615094784:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 55us (300us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.186537:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10796 00000100:00100000:2.0:1788572215.193386:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615095168 00000100:00100000:2.0:1788572215.193399:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615095168 00000100:00100000:2.0:1788572215.193461:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10797 00000100:00100000:2.0:1788572215.193471:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+294:2382:x1875449615095168:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.193492:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366945, current: 214748366945, replaying 00000100:00100000:2.0:1788572215.193511:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+294:2382:x1875449615095168:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (377us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.193518:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10797 00000100:00100000:2.0:1788572215.200638:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.201953:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.201962:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366946, next_transno: 214748366946 00010000:00080000:1.0:1788572215.201968:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366946) 00000020:00080000:1.0:1788572215.201972:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.201985:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615095552 t214748366946 from 192.168.202.13@tcp req@ffff94e61e760700 x1875449615095552/t0(214748366946) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.202221:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d754 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.202807:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d754 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.202820:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d754 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.202839:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.202852:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.202859:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203136:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d762 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203145:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d762 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203152:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d762 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.203736:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].73, 64 off12864 00010000:00010000:1.0:1788572215.203792:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d762 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203801:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d762 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203808:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d762 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203814:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.203819:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d762 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203826:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d762 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203843:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3b1:0x0].0x0 (ffff94e6416e6900) 00010000:00010000:1.0:1788572215.203846:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.203850:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d762 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203857:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d762 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203876:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d754 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203882:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d754 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203888:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d754 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203893:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.203896:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d754 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203903:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d754 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203910:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63aaace00) 00010000:00010000:1.0:1788572215.203912:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.203915:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d754 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203921:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d754 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.203943:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b052c82b reply state 00000000f725f819 transno 214748366946 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203954:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.203961:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14f145a5 (ffff94e61e76f600) 00010000:00010000:1.0:1788572215.203963:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.203965:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.204844:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.204871:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.204875:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366947 00000020:00080000:1.0:1788572215.204879:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.204881:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366947 00000100:00100000:2.0:1788572215.213119:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.213196:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615095936 00000100:00100000:3.0:1788572215.213212:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615095936 00000100:00100000:3.0:1788572215.213279:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10799 00000100:00100000:3.0:1788572215.213289:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+298:2382:x1875449615095936:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.213311:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366947, current: 214748366947, replaying 00000100:00100000:3.0:1788572215.213344:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+298:2382:x1875449615095936:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 56us (235us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.213351:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10799 00000020:00080000:2.0:1788572215.213437:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.213442:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366947, next_transno: 214748366947 00010000:00080000:2.0:1788572215.213447:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366947) 00000020:00080000:2.0:1788572215.213450:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.213459:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615095936 t214748366947 from 192.168.202.13@tcp req@ffff94e61e762a00 x1875449615095936/t0(214748366947) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.213555:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d769 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.213571:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d769 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.213583:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d769 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.213596:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.213606:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.213611:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.213814:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d777 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3b2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.213823:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d777 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.213830:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d777 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.214083:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].74, 64 off12928 00010000:00010000:2.0:1788572215.214143:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d777 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214151:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d777 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214158:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d777 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214164:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.214169:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d777 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214178:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d777 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214195:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3b2:0x0].0x0 (ffff94e6053c7e00) 00010000:00010000:2.0:1788572215.214198:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.214203:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d777 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214209:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d777 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214228:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d769 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214235:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d769 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214241:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d769 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214245:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145aa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.214248:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d769 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214254:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d769 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214261:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7300) 00010000:00010000:2.0:1788572215.214263:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.214266:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d769 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214272:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831d769 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.214287:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e83a96c reply state 00000000150da8cf transno 214748366947 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214297:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.214304:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2fbea2fa (ffff94e6053c7d00) 00010000:00010000:2.0:1788572215.214306:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.214308:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.214504:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.214521:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.214524:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366948 00000020:00080000:2.0:1788572215.214528:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.214531:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366948 00000100:00100000:3.0:1788572215.230210:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615096320 00000100:00100000:3.0:1788572215.230224:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615096320 00000100:00100000:3.0:1788572215.230286:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10800 00000100:00100000:3.0:1788572215.230296:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+300:2382:x1875449615096320:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.230426:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366948, current: 214748366948, replaying 00000100:00100000:3.0:1788572215.230999:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+300:2382:x1875449615096320:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 703us (898us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.231030:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10800 00000020:00080000:1.0:1788572215.232254:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.232262:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366948, next_transno: 214748366948 00010000:00080000:1.0:1788572215.232267:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366948) 00000020:00080000:1.0:1788572215.232270:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.232283:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615096320 t214748366948 from 192.168.202.13@tcp req@ffff94e637595880 x1875449615096320/t0(214748366948) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.232407:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d77e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232424:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d77e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232437:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d77e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232453:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232460:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232466:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232640:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d78c lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232648:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d78c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232655:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d78c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.232855:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].74, 64 off12928 00010000:00010000:1.0:1788572215.232913:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d78c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232922:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d78c lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232941:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d78c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232948:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.232954:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d78c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232967:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d78c lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232980:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3b3:0x0].0x0 (ffff94e63aaace00) 00010000:00010000:1.0:1788572215.232983:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.232987:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d78c lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.232993:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d78c lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.233049:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d77e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.233056:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d77e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.233062:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d77e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.233067:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.233069:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d77e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.233075:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d77e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.233081:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6416e6900) 00010000:00010000:1.0:1788572215.233084:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.233086:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d77e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.233096:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d77e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.233106:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000742cd9a reply state 000000003123de96 transno 214748366948 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.233116:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.233122:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd34c0c5f (ffff94e6416e6000) 00010000:00010000:1.0:1788572215.233125:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.233127:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.233206:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.233224:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.233227:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366949 00000020:00080000:1.0:1788572215.233231:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.233233:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366949 00000100:00100000:2.0:1788572215.258480:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615096704 00000100:00100000:2.0:1788572215.258498:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615096704 00000100:00100000:2.0:1788572215.259477:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10801 00000100:00100000:2.0:1788572215.259493:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+302:2382:x1875449615096704:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.259517:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366949, current: 214748366949, replaying 00000100:00100000:2.0:1788572215.259540:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+302:2382:x1875449615096704:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 52us (4950us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.259547:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10801 00000020:00080000:3.0:1788572215.259610:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.259615:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366949, next_transno: 214748366949 00010000:00080000:3.0:1788572215.259620:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366949) 00000020:00080000:3.0:1788572215.259623:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.259632:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615096704 t214748366949 from 192.168.202.13@tcp req@ffff94e637597480 x1875449615096704/t0(214748366949) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.259728:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d793 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.259744:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d793 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.259756:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d793 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.259769:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.259776:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.259783:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.259963:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7a1 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.259971:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7a1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.259979:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7a1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.260217:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].75, 64 off12992 00010000:00010000:3.0:1788572215.260270:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7a1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260278:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7a1 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260285:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7a1 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260291:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.260295:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7a1 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260325:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7a1 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260339:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3b4:0x0].0x0 (ffff94e61a333c00) 00010000:00010000:3.0:1788572215.260342:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.260346:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7a1 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260352:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7a1 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260374:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d793 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260380:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d793 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260385:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d793 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260391:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.260393:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d793 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260399:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d793 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260406:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61a333600) 00010000:00010000:3.0:1788572215.260408:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.260411:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d793 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260421:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d793 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.260433:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c75189c reply state 000000007ae57e2d transno 214748366949 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260444:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.260450:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x509ff4b4 (ffff94e61a333900) 00010000:00010000:3.0:1788572215.260452:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.260455:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.260539:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.260557:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.260560:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366950 00000020:00080000:3.0:1788572215.260564:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.260566:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366950 00000100:00100000:1.0:1788572215.268238:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.268335:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615097088 00000100:00100000:3.0:1788572215.268350:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615097088 00000100:00100000:3.0:1788572215.268417:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10802 00000100:00100000:3.0:1788572215.268428:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+304:2382:x1875449615097088:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.268450:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366950, current: 214748366950, replaying 00000100:00100000:3.0:1788572215.268474:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+304:2382:x1875449615097088:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 48us (253us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.268481:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10802 00000020:00080000:2.0:1788572215.268646:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.268652:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366950, next_transno: 214748366950 00010000:00080000:2.0:1788572215.268658:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366950) 00000020:00080000:2.0:1788572215.268661:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.268672:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615097088 t214748366950 from 192.168.202.13@tcp req@ffff94e60fc11500 x1875449615097088/t0(214748366950) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.268783:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d7a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.268803:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d7a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.268817:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d7a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.268831:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x842e3981 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.268838:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x842e3981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.268844:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x842e3981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269090:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831d7b6 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269100:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831d7b6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269107:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831d7b6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.269562:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].75, 64 off12992 00010000:00010000:2.0:1788572215.269629:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831d7b6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269643:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831d7b6 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269651:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831d7b6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269657:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145be00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.269663:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831d7b6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269672:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831d7b6 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269699:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3b5:0x0].0x0 (ffff94e6053c7800) 00010000:00010000:2.0:1788572215.269703:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.269709:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831d7b6 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269717:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831d7b6 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269742:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d7a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269749:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d7a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269755:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d7a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269761:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.269765:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d7a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269771:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d7a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269778:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7300) 00010000:00010000:2.0:1788572215.269781:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.269784:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d7a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269790:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831d7a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.269800:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000715eaf6d reply state 000000001a725668 transno 214748366950 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x842e3981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269811:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x842e3981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.269816:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x842e3981 (ffff94e6053c7e00) 00010000:00010000:2.0:1788572215.269819:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.269821:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.269913:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.270555:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.270561:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366951 00000020:00080000:2.0:1788572215.270566:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.270568:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366951 00000100:00100000:3.0:1788572215.276209:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.276247:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615097472 00000100:00100000:3.0:1788572215.276259:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615097472 00000100:00100000:3.0:1788572215.276336:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10803 00000100:00100000:3.0:1788572215.276347:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+306:2382:x1875449615097472:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.276371:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366951, current: 214748366951, replaying 00000100:00100000:3.0:1788572215.276382:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+306:2382:x1875449615097472:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 39us (187us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.276389:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10803 00000020:00080000:2.0:1788572215.276587:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.276592:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366951, next_transno: 214748366951 00010000:00080000:2.0:1788572215.276597:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366951) 00000020:00080000:2.0:1788572215.276601:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.276613:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615097472 t214748366951 from 192.168.202.13@tcp req@ffff94e61e573800 x1875449615097472/t0(214748366951) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.276750:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d7bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.276768:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d7bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.276782:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d7bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.276798:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.276805:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.276812:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277080:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d7cb lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3b6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277089:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d7cb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277096:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d7cb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.277388:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].76, 64 off13056 00010000:00010000:2.0:1788572215.277450:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d7cb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277459:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d7cb lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277465:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d7cb lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277470:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.277474:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d7cb lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277482:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d7cb lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277496:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3b6:0x0].0x0 (ffff94e6053c7000) 00010000:00010000:2.0:1788572215.277499:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.277504:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d7cb lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277511:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d7cb lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277533:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d7bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277538:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d7bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277544:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d7bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277548:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.277551:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d7bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277557:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d7bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277563:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7b00) 00010000:00010000:2.0:1788572215.277566:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.277569:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d7bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277575:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831d7bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.277586:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000461e052d reply state 000000002f5e5d50 transno 214748366951 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277596:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.277602:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b6537a6 (ffff94e6053c7200) 00010000:00010000:2.0:1788572215.277604:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.277606:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.277709:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.277729:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.277732:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366952 00000020:00080000:2.0:1788572215.277736:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.277738:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366952 00000100:00100000:2.0:1788572215.288547:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:3.0:1788572215.288829:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.288835:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366952, next_transno: 214748366952 00010000:00080000:3.0:1788572215.288839:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366952) 00000020:00080000:3.0:1788572215.288843:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.288852:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615097856 t214748366952 from 192.168.202.13@tcp req@ffff94e63779a680 x1875449615097856/t0(214748366952) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.288964:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d7d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.288983:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d7d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.288995:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d7d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289046:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289055:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289061:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289279:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831d7e0 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289289:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831d7e0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289482:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831d7e0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.289746:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].76, 64 off13056 00010000:00010000:3.0:1788572215.289804:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831d7e0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289811:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831d7e0 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289817:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831d7e0 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289823:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.289827:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831d7e0 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289836:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831d7e0 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289849:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3b7:0x0].0x0 (ffff94e61a333100) 00010000:00010000:3.0:1788572215.289852:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.289857:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831d7e0 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289867:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831d7e0 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289891:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d7d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289897:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d7d2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289903:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d7d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289907:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.289910:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d7d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289915:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d7d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.289923:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61a333600) 00010000:00010000:3.0:1788572215.289993:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.289997:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d7d2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.290033:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d7d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.290048:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003cbc7cb reply state 000000005f3c44f6 transno 214748366952 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.290062:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.290070:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5eea10b (ffff94e61a333c00) 00010000:00010000:3.0:1788572215.290072:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.290074:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.290169:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.291817:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.291828:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366953 00000020:00080000:3.0:1788572215.291834:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.291836:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366953 00000100:00100000:3.0:1788572215.297144:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:3.0:1788572215.297592:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.297596:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366953, next_transno: 214748366953 00010000:00080000:3.0:1788572215.297601:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366953) 00000020:00080000:3.0:1788572215.297604:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.297615:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615098240 t214748366953 from 192.168.202.13@tcp req@ffff94e61e570a80 x1875449615098240/t0(214748366953) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.297723:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d7e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.297740:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d7e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.297752:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d7e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.297766:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.297773:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.297779:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.297960:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d7f5 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3b8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.297969:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d7f5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.297977:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d7f5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.298230:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].77, 64 off13120 00010000:00010000:3.0:1788572215.298286:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d7f5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298294:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d7f5 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298312:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d7f5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298318:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.298322:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d7f5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298330:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d7f5 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298341:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3b8:0x0].0x0 (ffff94e61a333400) 00010000:00010000:3.0:1788572215.298344:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.298349:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d7f5 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298354:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d7f5 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298375:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d7e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298381:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d7e7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298386:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d7e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298391:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.298393:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d7e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298398:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d7e7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298405:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61a333d00) 00010000:00010000:3.0:1788572215.298407:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.298410:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d7e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298415:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d7e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.298425:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077f694ed reply state 00000000377da9ef transno 214748366953 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298439:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.298445:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe83d4e62 (ffff94e61a333000) 00010000:00010000:3.0:1788572215.298447:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.298449:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.298520:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.298536:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.298539:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366954 00000020:00080000:3.0:1788572215.298542:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.298544:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366954 00000100:00100000:3.0:1788572215.309701:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.309746:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615098624 00000100:00100000:3.0:1788572215.309757:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615098624 00000100:00100000:3.0:1788572215.309821:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10806 00000100:00100000:3.0:1788572215.309832:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+312:2382:x1875449615098624:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.309857:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366954, current: 214748366954, replaying 00000100:00100000:3.0:1788572215.309872:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+312:2382:x1875449615098624:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (193us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.309879:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10806 00000020:00080000:3.0:1788572215.309905:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.309909:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366954, next_transno: 214748366954 00010000:00080000:3.0:1788572215.309914:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366954) 00000020:00080000:3.0:1788572215.309917:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.309938:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615098624 t214748366954 from 192.168.202.13@tcp req@ffff94e61e573b80 x1875449615098624/t0(214748366954) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.310070:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d7fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310086:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d7fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310098:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d7fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310113:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7577b287 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310120:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7577b287 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310127:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7577b287 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310316:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d80a lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3b9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310325:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d80a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310332:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d80a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.310559:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].77, 64 off13120 00010000:00010000:3.0:1788572215.310615:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d80a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310624:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d80a lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310632:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d80a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310639:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.310644:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d80a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310654:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d80a lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310669:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3b9:0x0].0x0 (ffff94e6029e1200) 00010000:00010000:3.0:1788572215.310673:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.310678:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d80a lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310699:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d80a lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310725:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d7fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310732:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d7fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310739:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d7fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310743:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.310746:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d7fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310755:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d7fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310763:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502364f00) 00010000:00010000:3.0:1788572215.310765:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.310768:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d7fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310774:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d7fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.310785:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ff0f90e reply state 00000000adf6bc74 transno 214748366954 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7577b287 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310796:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7577b287 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.310802:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7577b287 (ffff94e640e4ce00) 00010000:00010000:3.0:1788572215.310805:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.310807:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.310882:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.311036:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.311040:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366955 00000020:00080000:3.0:1788572215.311044:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.311046:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366955 00000100:00100000:2.0:1788572215.321262:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.324444:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615099008 00000100:00100000:3.0:1788572215.324461:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615099008 00000100:00100000:3.0:1788572215.324535:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10807 00000100:00100000:3.0:1788572215.324547:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+314:2382:x1875449615099008:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.324571:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366955, current: 214748366955, replaying 00000100:00100000:3.0:1788572215.324589:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+314:2382:x1875449615099008:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (3342us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.324595:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10807 00000020:00080000:3.0:1788572215.324639:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.324643:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366955, next_transno: 214748366955 00010000:00080000:3.0:1788572215.324648:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366955) 00000020:00080000:3.0:1788572215.324651:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.324661:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615099008 t214748366955 from 192.168.202.13@tcp req@ffff94e63779b100 x1875449615099008/t0(214748366955) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.324791:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d811 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.324810:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d811 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.324823:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d811 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.324837:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.324844:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.324850:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.325140:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d81f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.325150:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d81f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.325157:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d81f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.328235:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].78, 64 off13184 00010000:00010000:3.0:1788572215.328496:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d81f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328509:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d81f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328517:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d81f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328524:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.328529:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d81f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328537:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d81f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328554:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ba:0x0].0x0 (ffff94e61a333d00) 00010000:00010000:3.0:1788572215.328558:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.328563:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d81f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328568:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831d81f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328598:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d811 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328605:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d811 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328610:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d811 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328615:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.328617:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d811 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328622:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d811 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328630:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6029e1200) 00010000:00010000:3.0:1788572215.328632:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.328635:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d811 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328640:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d811 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.328651:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003abafd08 reply state 00000000a444bd69 transno 214748366955 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328663:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.328669:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3c50fdc (ffff94e502364f00) 00010000:00010000:3.0:1788572215.328673:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.328675:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.329475:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.329508:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.329512:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366956 00000020:00080000:3.0:1788572215.329517:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.329519:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366956 00000100:00100000:3.0:1788572215.341449:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:3.0:1788572215.341788:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.341793:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366956, next_transno: 214748366956 00010000:00080000:3.0:1788572215.341798:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366956) 00000020:00080000:3.0:1788572215.341801:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.341811:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615099392 t214748366956 from 192.168.202.13@tcp req@ffff94e502d5f100 x1875449615099392/t0(214748366956) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.342034:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d826 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.342051:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d826 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.342065:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d826 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.342081:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x125754a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.342088:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x125754a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.342095:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x125754a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.342275:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d834 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3bb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.342285:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d834 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.342292:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d834 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.344169:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].78, 64 off13184 00010000:00010000:3.0:1788572215.344246:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d834 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344256:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d834 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344264:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d834 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344270:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.344275:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d834 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344283:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d834 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344423:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3bb:0x0].0x0 (ffff94e61a333100) 00010000:00010000:3.0:1788572215.344428:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.344435:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d834 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344446:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d834 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344476:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d826 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344483:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d826 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344488:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d826 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344493:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.344497:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d826 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344503:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d826 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344512:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61a333400) 00010000:00010000:3.0:1788572215.344514:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.344517:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d826 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344523:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d826 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.344536:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000509e1614 reply state 000000009cf74fd1 transno 214748366956 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x125754a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344547:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x125754a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.344555:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x125754a9 (ffff94e61a333600) 00010000:00010000:3.0:1788572215.344558:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.344561:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.345251:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.345274:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.345278:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366957 00000020:00080000:3.0:1788572215.345282:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.345283:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366957 00000100:00100000:1.0:1788572215.360183:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.364911:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.364916:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366957, next_transno: 214748366957 00010000:00080000:1.0:1788572215.364921:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366957) 00000020:00080000:1.0:1788572215.364934:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.364947:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615099776 t214748366957 from 192.168.202.13@tcp req@ffff94e60fc13100 x1875449615099776/t0(214748366957) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.365084:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d83b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365107:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d83b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365120:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d83b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365136:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24a751fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365144:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24a751fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365151:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24a751fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365354:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d849 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3bc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365363:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d849 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365371:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d849 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.365636:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].79, 64 off13248 00010000:00010000:1.0:1788572215.365718:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d849 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365728:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d849 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365735:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d849 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365741:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.365746:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d849 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365753:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d849 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365767:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3bc:0x0].0x0 (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.365769:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.365774:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d849 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365780:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d849 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365799:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d83b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365805:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d83b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365810:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d83b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365814:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.365817:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d83b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365822:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d83b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365832:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63aaace00) 00010000:00010000:1.0:1788572215.365835:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.365837:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d83b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365842:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d83b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.365852:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e74c27a2 reply state 0000000035cd4c79 transno 214748366957 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24a751fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365861:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24a751fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.365867:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24a751fe (ffff94e6416e6900) 00010000:00010000:1.0:1788572215.365869:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.365871:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.365961:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.365980:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.365983:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366958 00000020:00080000:1.0:1788572215.365987:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.365988:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366958 00000100:00100000:3.0:1788572215.371502:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.374515:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615100160 00000100:00100000:2.0:1788572215.374531:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615100160 00000100:00100000:2.0:1788572215.374610:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10810 00000100:00100000:2.0:1788572215.374621:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e502d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+320:2382:x1875449615100160:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.374643:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366958, current: 214748366958, replaying 00000100:00100000:2.0:1788572215.374659:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e502d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+320:2382:x1875449615100160:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 41us (3169us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.374667:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10810 00000020:00080000:2.0:1788572215.375061:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.375067:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366958, next_transno: 214748366958 00010000:00080000:2.0:1788572215.375071:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366958) 00000020:00080000:2.0:1788572215.375075:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.375086:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615100160 t214748366958 from 192.168.202.13@tcp req@ffff94e502d5ed80 x1875449615100160/t0(214748366958) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.375188:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d850 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375207:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d850 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375220:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d850 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375234:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375241:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375247:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375467:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d85e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3bd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375477:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d85e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375484:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d85e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.375730:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].79, 64 off13248 00010000:00010000:2.0:1788572215.375782:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d85e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375789:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d85e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375796:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d85e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375802:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600030c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.375808:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d85e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375817:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d85e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375832:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3bd:0x0].0x0 (ffff94e6053c7300) 00010000:00010000:2.0:1788572215.375836:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.375841:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d85e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375852:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d85e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375877:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d850 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375883:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d850 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375888:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d850 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375892:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.375895:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d850 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375900:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d850 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375909:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7b00) 00010000:00010000:2.0:1788572215.375911:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.375914:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d850 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375919:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d850 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.375930:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba9b00fa reply state 00000000f0b058a8 transno 214748366958 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375940:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.375945:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xade0bb63 (ffff94e6053c7000) 00010000:00010000:2.0:1788572215.375946:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.375948:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.376035:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.376051:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.376053:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366959 00000020:00080000:2.0:1788572215.376056:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.376057:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366959 00000100:00100000:3.0:1788572215.378974:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:3.0:1788572215.379171:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.379175:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366959, next_transno: 214748366959 00010000:00080000:3.0:1788572215.379179:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366959) 00000020:00080000:3.0:1788572215.379181:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.379190:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615100544 t214748366959 from 192.168.202.13@tcp req@ffff94e633e2df80 x1875449615100544/t0(214748366959) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.379295:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d865 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.379325:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d865 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.379337:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d865 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.379352:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.379363:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.379370:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.379716:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d873 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3be:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.379725:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d873 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.379733:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d873 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.379995:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].80, 64 off13312 00010000:00010000:3.0:1788572215.380176:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d873 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380184:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d873 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380191:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d873 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380197:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.380201:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d873 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380209:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d873 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380224:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3be:0x0].0x0 (ffff94e61a333d00) 00010000:00010000:3.0:1788572215.380228:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.380233:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d873 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380240:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831d873 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380260:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d865 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380266:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d865 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380272:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d865 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380277:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.380279:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d865 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380284:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d865 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380291:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61a333400) 00010000:00010000:3.0:1788572215.380293:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.380419:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d865 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380427:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831d865 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.380514:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b724ccd reply state 00000000985f61d5 transno 214748366959 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380525:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.380532:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x73b203b8 (ffff94e61a333100) 00010000:00010000:3.0:1788572215.380535:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.380538:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.380625:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.380644:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.380648:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366960 00000020:00080000:3.0:1788572215.380652:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.380654:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366960 00000100:00100000:1.0:1788572215.383790:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.383898:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615100928 00000100:00100000:3.0:1788572215.383909:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615100928 00000100:00100000:3.0:1788572215.383986:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10812 00000100:00100000:3.0:1788572215.383997:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+324:2382:x1875449615100928:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.384170:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366960, current: 214748366960, replaying 00000100:00100000:3.0:1788572215.384194:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+324:2382:x1875449615100928:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 199us (418us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.384202:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10812 00010000:00010000:1.0:1788572215.385200:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d888 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385209:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d888 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385216:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d888 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385222:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14a200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.385226:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d888 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385233:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d888 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385245:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3bf:0x0].0x0 (ffff94e619f4eb00) 00010000:00010000:1.0:1788572215.385248:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.385252:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d888 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385259:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d888 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385277:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d87a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385284:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d87a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385290:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d87a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385294:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.385416:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d87a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385424:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d87a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385448:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e619f4e900) 00010000:00010000:1.0:1788572215.385451:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.385454:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d87a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385460:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d87a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.385472:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006675a310 reply state 0000000033c07ed9 transno 214748366960 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3ac00/0xdb7edb52b831d881 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1944885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385483:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3ac00/0xdb7edb52b831d881 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1944885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.385489:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc1944885 (ffff94e619f4ec00) 00010000:00010000:1.0:1788572215.385491:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.385493:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.385614:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.385631:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.385634:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366961 00000020:00080000:1.0:1788572215.385638:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.385640:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366961 00000100:00100000:1.0:1788572215.389336:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615101312 00000100:00100000:1.0:1788572215.389349:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615101312 00000100:00100000:1.0:1788572215.389411:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10813 00000100:00100000:1.0:1788572215.389422:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+326:2382:x1875449615101312:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.389452:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366961, current: 214748366961, replaying 00000100:00100000:1.0:1788572215.389468:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+326:2382:x1875449615101312:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 49us (212us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.389476:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10813 00000100:00100000:3.0:1788572215.393282:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.393385:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615101696 00000100:00100000:2.0:1788572215.393397:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615101696 00000100:00100000:2.0:1788572215.393471:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10814 00000100:00100000:2.0:1788572215.393483:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+328:2382:x1875449615101696:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.393506:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366962, current: 214748366962, replaying 00000100:00100000:2.0:1788572215.393523:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+328:2382:x1875449615101696:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (252us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.393530:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10814 00000020:00080000:2.0:1788572215.393550:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.393554:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366962, next_transno: 214748366962 00010000:00080000:2.0:1788572215.393558:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366962) 00000020:00080000:2.0:1788572215.393561:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.393572:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615101696 t214748366962 from 192.168.202.13@tcp req@ffff94e633e2e680 x1875449615101696/t0(214748366962) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.393662:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d8a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.393690:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d8a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.393704:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d8a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.393717:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.393724:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.393730:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.393914:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d8b2 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3c1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.393924:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d8b2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.393944:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d8b2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.394202:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].81, 64 off13376 00010000:00010000:2.0:1788572215.394270:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d8b2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394279:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d8b2 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394285:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d8b2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394291:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600030200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.394296:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d8b2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394304:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d8b2 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394318:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3c1:0x0].0x0 (ffff94e6053c7800) 00010000:00010000:2.0:1788572215.394322:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.394328:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d8b2 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394334:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d8b2 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394357:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d8a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394362:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d8a4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394368:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d8a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394373:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.394376:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d8a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394383:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d8a4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394391:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7b00) 00010000:00010000:2.0:1788572215.394393:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.394398:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d8a4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394404:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d8a4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.394417:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfdf8801 reply state 0000000039fc60b5 transno 214748366962 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394429:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.394436:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ec2500f (ffff94e6053c7300) 00010000:00010000:2.0:1788572215.394439:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.394441:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.394545:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.394563:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.394566:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366963 00000020:00080000:2.0:1788572215.394570:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.394572:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366963 00000100:00100000:1.0:1788572215.404663:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.405117:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.405122:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366963, next_transno: 214748366963 00010000:00080000:1.0:1788572215.405127:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366963) 00000020:00080000:1.0:1788572215.405131:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.405143:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615102080 t214748366963 from 192.168.202.13@tcp req@ffff94e63a93b100 x1875449615102080/t0(214748366963) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.405253:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d8b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.405273:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d8b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.405286:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d8b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.405312:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.405319:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.405335:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.405699:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d8c7 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3c2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.405709:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d8c7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.405716:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d8c7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.405961:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].82, 64 off13440 00010000:00010000:1.0:1788572215.406060:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d8c7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406068:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d8c7 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406076:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d8c7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406082:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.406087:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d8c7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406094:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d8c7 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406107:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3c2:0x0].0x0 (ffff94e63ab76b00) 00010000:00010000:1.0:1788572215.406110:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.406114:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d8c7 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406120:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d8c7 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406141:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d8b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406151:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d8b9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406157:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d8b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406161:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.406163:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d8b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406169:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d8b9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406176:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.406178:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.406181:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d8b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406187:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d8b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.406198:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2985ce4 reply state 0000000030d71f76 transno 214748366963 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406208:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.406214:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa2fd3d12 (ffff94e63ab76500) 00010000:00010000:1.0:1788572215.406216:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.406219:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.406591:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.406614:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.406617:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366964 00000020:00080000:1.0:1788572215.406621:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.406623:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366964 00000100:00100000:1.0:1788572215.409429:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615102464 00000100:00100000:1.0:1788572215.409498:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615102464 00000100:00100000:1.0:1788572215.409564:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10816 00000100:00100000:1.0:1788572215.409575:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+332:2382:x1875449615102464:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.409595:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366964, current: 214748366964, replaying 00000100:00100000:1.0:1788572215.409616:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+332:2382:x1875449615102464:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (798us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.409623:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10816 00000020:00000004:2.0:1788572215.421702:0:112368:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572215.422146:0:112368:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788572215.432496:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615102848 00000100:00100000:2.0:1788572215.432507:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615102848 00000100:00100000:2.0:1788572215.432566:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10817 00000100:00100000:2.0:1788572215.432577:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+334:2382:x1875449615102848:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.432597:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366965, current: 214748366965, replaying 00000100:00100000:2.0:1788572215.432610:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+334:2382:x1875449615102848:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 36us (971us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.432617:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10817 00000100:00100000:2.0:1788572215.437725:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572215.454513:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.454888:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.454892:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366967, next_transno: 214748366967 00010000:00080000:1.0:1788572215.454897:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366967) 00000020:00080000:1.0:1788572215.454900:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.454919:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615103616 t214748366967 from 192.168.202.13@tcp req@ffff94e63a93b480 x1875449615103616/t0(214748366967) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.455049:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d90d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.455276:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d90d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.455292:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d90d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.455377:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x880645ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.455385:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x880645ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.455392:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x880645ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.455650:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d91b lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3c6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.455660:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d91b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.455667:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d91b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.455995:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].84, 64 off13568 00010000:00010000:1.0:1788572215.456597:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d91b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456608:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d91b lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456617:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d91b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456622:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.456627:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d91b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456639:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d91b lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456653:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3c6:0x0].0x0 (ffff94e63ab76a00) 00010000:00010000:1.0:1788572215.456656:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.456662:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d91b lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456669:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831d91b lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456706:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d90d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456712:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d90d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456718:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d90d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456723:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14a200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.456726:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d90d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456733:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d90d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456740:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.456743:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.456745:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d90d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456755:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831d90d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.456768:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba1b50dd reply state 00000000ecef5836 transno 214748366967 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x880645ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456780:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x880645ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.456786:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x880645ee (ffff94e63ab76b00) 00010000:00010000:1.0:1788572215.456789:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.456791:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.456945:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.456968:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.456972:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366968 00000020:00080000:1.0:1788572215.456976:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.456978:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366968 00000100:00100000:3.0:1788572215.467718:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.468385:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.468390:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366968, next_transno: 214748366968 00010000:00080000:1.0:1788572215.468395:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366968) 00000020:00080000:1.0:1788572215.468398:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.468408:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615104000 t214748366968 from 192.168.202.13@tcp req@ffff94e633e2c380 x1875449615104000/t0(214748366968) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.468513:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d922 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.468529:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.468545:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.468559:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.468566:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.468572:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.468767:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831d930 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3c7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.468776:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831d930 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.468784:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831d930 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.469066:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].84, 64 off13568 00010000:00010000:1.0:1788572215.469130:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831d930 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469138:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831d930 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469145:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831d930 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469151:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637696c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.469156:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831d930 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469165:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831d930 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469179:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3c7:0x0].0x0 (ffff94e63ab76f00) 00010000:00010000:1.0:1788572215.469183:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.469187:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831d930 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469199:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831d930 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469221:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469228:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d922 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469233:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d922 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469238:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.469241:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d922 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469246:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d922 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469254:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76d00) 00010000:00010000:1.0:1788572215.469256:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.469260:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d922 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469266:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831d922 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.469277:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009512ef34 reply state 0000000034a11c38 transno 214748366968 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469287:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.469292:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8234a13 (ffff94e63ab76000) 00010000:00010000:1.0:1788572215.470240:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.470250:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.470501:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.470524:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.470527:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366969 00000020:00080000:1.0:1788572215.470530:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.470532:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366969 00000100:00100000:3.0:1788572215.474973:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572215.475547:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615104384 00000100:00100000:1.0:1788572215.475558:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615104384 00000100:00100000:1.0:1788572215.475627:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10821 00000100:00100000:1.0:1788572215.475637:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+342:2382:x1875449615104384:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.475662:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366969, current: 214748366969, replaying 00000100:00100000:1.0:1788572215.475689:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+342:2382:x1875449615104384:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (722us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.475698:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10821 00000020:00080000:1.0:1788572215.475719:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.475724:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366969, next_transno: 214748366969 00010000:00080000:1.0:1788572215.475729:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366969) 00000020:00080000:1.0:1788572215.475732:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.475742:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615104384 t214748366969 from 192.168.202.13@tcp req@ffff94e503930a80 x1875449615104384/t0(214748366969) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.475835:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831d937 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.475852:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831d937 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.475866:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831d937 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.475880:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6e489268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.475887:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e489268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.475894:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e489268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476102:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831d945 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3c8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476112:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831d945 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476120:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831d945 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.476591:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].85, 64 off13632 00010000:00010000:1.0:1788572215.476651:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831d945 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476660:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831d945 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476667:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831d945 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476675:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.476689:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831d945 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476697:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831d945 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476710:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3c8:0x0].0x0 (ffff94e63ab76600) 00010000:00010000:1.0:1788572215.476713:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.476718:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831d945 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476724:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831d945 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476747:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831d937 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476753:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831d937 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476763:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831d937 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476768:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.476771:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831d937 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476777:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831d937 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476783:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76200) 00010000:00010000:1.0:1788572215.476785:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.476788:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831d937 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476793:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831d937 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.476804:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ad7fced reply state 00000000a2301b57 transno 214748366969 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e489268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476815:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e489268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.476822:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e489268 (ffff94e63ab76800) 00010000:00010000:1.0:1788572215.476824:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.476827:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.476922:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.476941:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.476944:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366970 00000020:00080000:1.0:1788572215.476948:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.476950:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366970 00000100:00100000:2.0:1788572215.495406:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.497275:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615104768 00000100:00100000:3.0:1788572215.497291:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615104768 00000100:00100000:3.0:1788572215.497361:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10822 00000100:00100000:3.0:1788572215.497373:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+344:2382:x1875449615104768:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.497393:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366970, current: 214748366970, replaying 00000100:00100000:3.0:1788572215.497411:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+344:2382:x1875449615104768:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 41us (2017us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.497419:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10822 00000020:00080000:2.0:1788572215.500273:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.500285:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366970, next_transno: 214748366970 00010000:00080000:2.0:1788572215.500291:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366970) 00000020:00080000:2.0:1788572215.500295:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.500311:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615104768 t214748366970 from 192.168.202.13@tcp req@ffff94e637798700 x1875449615104768/t0(214748366970) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.500438:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d94c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.500456:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d94c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.500469:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d94c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.500483:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x725dc75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.500490:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x725dc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.500497:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x725dc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.500704:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d95a lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3c9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.500712:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d95a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.500723:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d95a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.500972:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].85, 64 off13632 00010000:00010000:2.0:1788572215.501155:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d95a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501165:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d95a lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501172:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d95a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501179:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.501184:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d95a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501193:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d95a lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501210:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3c9:0x0].0x0 (ffff94e6053c7a00) 00010000:00010000:2.0:1788572215.501214:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.501220:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d95a lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501226:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d95a lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501250:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d94c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501260:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d94c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501266:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d94c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501271:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600030200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.501274:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d94c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501279:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d94c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501287:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7b00) 00010000:00010000:2.0:1788572215.501290:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.501293:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d94c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501299:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d94c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.501313:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edd0d7ec reply state 0000000061d3eadc transno 214748366970 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x725dc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501325:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x725dc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.501332:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x725dc75 (ffff94e6053c7800) 00010000:00010000:2.0:1788572215.501333:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.501337:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.501446:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1788572215.501468:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.501470:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366971 00000020:00080000:2.0:1788572215.501474:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.501476:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366971 00000100:00100000:3.0:1788572215.511696:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572215.511973:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.511979:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366971, next_transno: 214748366971 00010000:00080000:2.0:1788572215.511983:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366971) 00000020:00080000:2.0:1788572215.511987:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.511996:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615105152 t214748366971 from 192.168.202.13@tcp req@ffff94e503930380 x1875449615105152/t0(214748366971) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.512262:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d961 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512285:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d961 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512300:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d961 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512315:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512322:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512328:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512552:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831d96f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512566:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831d96f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512573:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831d96f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.512833:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].86, 64 off13696 00010000:00010000:2.0:1788572215.512897:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831d96f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512906:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831d96f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512912:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831d96f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512919:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.512924:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831d96f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512932:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831d96f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512945:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ca:0x0].0x0 (ffff94e6053c7f00) 00010000:00010000:2.0:1788572215.512949:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.512954:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831d96f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512961:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831d96f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512988:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d961 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.512995:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d961 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.513672:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d961 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.513695:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600030200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.513699:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d961 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.513708:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d961 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.513719:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7b00) 00010000:00010000:2.0:1788572215.513722:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.513726:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d961 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.513733:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d961 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.513750:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1dd8c10 reply state 000000003d61ef03 transno 214748366971 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.513762:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.513769:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74fcda9a (ffff94e6053c7a00) 00010000:00010000:2.0:1788572215.513772:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.513774:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.513867:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.513887:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.513890:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366972 00000020:00080000:2.0:1788572215.513894:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.513896:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366972 00000100:00100000:2.0:1788572215.516962:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615105536 00000100:00100000:2.0:1788572215.516973:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615105536 00000100:00100000:2.0:1788572215.517061:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10824 00000100:00100000:2.0:1788572215.517071:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+348:2382:x1875449615105536:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.517091:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366972, current: 214748366972, replaying 00000100:00100000:2.0:1788572215.517104:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+348:2382:x1875449615105536:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 35us (327us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.517111:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10824 00000020:00080000:2.0:1788572215.517127:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.517132:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366972, next_transno: 214748366972 00010000:00080000:2.0:1788572215.517136:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366972) 00000020:00080000:2.0:1788572215.517140:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.517150:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615105536 t214748366972 from 192.168.202.13@tcp req@ffff94e637596a00 x1875449615105536/t0(214748366972) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.517252:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d976 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517273:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d976 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517287:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d976 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517300:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2719debf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517307:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2719debf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517314:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2719debf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517490:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831d984 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3cb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517499:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831d984 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517519:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831d984 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.517759:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].86, 64 off13696 00010000:00010000:2.0:1788572215.517826:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831d984 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517834:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831d984 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517842:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831d984 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517847:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.517851:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831d984 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517864:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831d984 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517875:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3cb:0x0].0x0 (ffff94e6135f0700) 00010000:00010000:2.0:1788572215.517878:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.517882:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831d984 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517889:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831d984 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517910:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d976 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517916:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d976 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517922:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d976 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517927:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.517929:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d976 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517935:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d976 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517941:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7700) 00010000:00010000:2.0:1788572215.517943:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.517946:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d976 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517956:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d976 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.517966:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003749478d reply state 00000000d3caa323 transno 214748366972 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2719debf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517976:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2719debf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.517982:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2719debf (ffff94e6053c7100) 00010000:00010000:2.0:1788572215.517984:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.517987:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.518106:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.518124:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.518127:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366973 00000020:00080000:2.0:1788572215.518131:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.518133:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366973 00000100:00100000:1.0:1788572215.525790:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572215.526697:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.526702:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366973, next_transno: 214748366973 00010000:00080000:2.0:1788572215.526708:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366973) 00000020:00080000:2.0:1788572215.526711:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.526721:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615105920 t214748366973 from 192.168.202.13@tcp req@ffff94e63a939180 x1875449615105920/t0(214748366973) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.526826:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d98b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.526844:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d98b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.526862:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d98b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.526874:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.526880:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.526887:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527366:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d999 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527376:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d999 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527382:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d999 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.527597:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].87, 64 off13760 00010000:00010000:2.0:1788572215.527657:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d999 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527665:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d999 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527672:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d999 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527691:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600030200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.527696:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d999 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527704:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d999 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527716:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3cc:0x0].0x0 (ffff94e6053c7b00) 00010000:00010000:2.0:1788572215.527719:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.527723:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d999 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527730:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d999 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527747:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d98b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527752:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d98b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527757:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d98b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527761:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.527763:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d98b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527768:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d98b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527774:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572215.527776:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.527779:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d98b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527784:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d98b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.527792:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a5362eb reply state 0000000036f5127d transno 214748366973 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527801:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.527807:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5857e01 (ffff94e5042ea700) 00010000:00010000:2.0:1788572215.527810:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.527812:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.528475:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.528502:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.528506:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366974 00000020:00080000:2.0:1788572215.528510:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.528512:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366974 00000100:00100000:3.0:1788572215.536741:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.545994:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615106688 00000100:00100000:2.0:1788572215.546137:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615106688 00000100:00100000:2.0:1788572215.546198:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10827 00000100:00100000:2.0:1788572215.546208:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+354:2382:x1875449615106688:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.546384:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366975, current: 214748366975, replaying 00000100:00100000:2.0:1788572215.546505:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+354:2382:x1875449615106688:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 298us (653us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.546514:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10827 00000100:00100000:1.0:1788572215.566451:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.566527:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615107072 00000100:00100000:3.0:1788572215.566539:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615107072 00000100:00100000:3.0:1788572215.566601:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10828 00000100:00100000:3.0:1788572215.566611:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+356:2382:x1875449615107072:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.566630:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366976, current: 214748366976, replaying 00000100:00100000:3.0:1788572215.566645:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+356:2382:x1875449615107072:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 36us (204us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.566652:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10828 00000020:00080000:2.0:1788572215.567038:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.567044:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366976, next_transno: 214748366976 00010000:00080000:2.0:1788572215.567048:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366976) 00000020:00080000:2.0:1788572215.567051:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.567062:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615107072 t214748366976 from 192.168.202.13@tcp req@ffff94e63a93aa00 x1875449615107072/t0(214748366976) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.567169:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d9ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567188:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d9ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567204:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d9ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567218:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x556d2988 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567225:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x556d2988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567232:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x556d2988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567442:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d9d8 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567451:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d9d8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567458:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d9d8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.567702:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].88, 64 off13824 00010000:00010000:2.0:1788572215.567763:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d9d8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567771:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d9d8 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567778:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d9d8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567784:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.567789:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d9d8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567797:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d9d8 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567811:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3cf:0x0].0x0 (ffff94e6053c7f00) 00010000:00010000:2.0:1788572215.567814:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.567820:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d9d8 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567827:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831d9d8 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567846:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d9ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567852:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d9ca lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567863:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d9ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567868:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.567870:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d9ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567876:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d9ca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567883:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7b00) 00010000:00010000:2.0:1788572215.567885:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.567887:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d9ca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567893:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831d9ca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.567902:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a3fa63b reply state 0000000017c945cc transno 214748366976 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x556d2988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567912:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x556d2988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.567918:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x556d2988 (ffff94e6053c7700) 00010000:00010000:2.0:1788572215.567920:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.567922:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.568036:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.568056:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.568059:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366977 00000020:00080000:2.0:1788572215.568063:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.568065:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366977 00000100:00100000:1.0:1788572215.575506:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.577340:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615107456 00000100:00100000:2.0:1788572215.577358:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615107456 00000100:00100000:2.0:1788572215.577473:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10829 00000100:00100000:2.0:1788572215.577486:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+358:2382:x1875449615107456:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.577505:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366977, current: 214748366977, replaying 00000100:00100000:2.0:1788572215.577524:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+358:2382:x1875449615107456:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (2032us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.577531:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10829 00000020:00080000:1.0:1788572215.577567:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.577572:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366977, next_transno: 214748366977 00010000:00080000:1.0:1788572215.577576:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366977) 00000020:00080000:1.0:1788572215.577579:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.577590:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615107456 t214748366977 from 192.168.202.13@tcp req@ffff94e63a93bb80 x1875449615107456/t0(214748366977) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.577709:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.577726:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.577739:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.577751:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x608e86dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.577758:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x608e86dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.577764:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x608e86dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.577969:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9ed lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.577978:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9ed lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.577984:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9ed lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.578269:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].89, 64 off13888 00010000:00010000:1.0:1788572215.578325:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9ed lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578333:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9ed lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578340:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9ed lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578346:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.578351:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9ed lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578360:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9ed lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578372:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3d0:0x0].0x0 (ffff94e63ab76d00) 00010000:00010000:1.0:1788572215.578375:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.578379:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9ed lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578385:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9ed lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578407:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578413:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9df lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578419:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578424:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.578427:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578433:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9df lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578440:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76200) 00010000:00010000:1.0:1788572215.578443:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.578445:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9df lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578451:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9df lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.578462:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b78c8f4b reply state 000000000b2908ba transno 214748366977 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x608e86dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578473:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x608e86dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.578479:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x608e86dd (ffff94e63ab76600) 00010000:00010000:1.0:1788572215.578482:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.578485:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.578568:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.578706:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.578710:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366978 00000020:00080000:1.0:1788572215.578713:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.578715:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366978 00000020:00080000:1.0:1788572215.597954:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.597965:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366978, next_transno: 214748366978 00010000:00080000:1.0:1788572215.597970:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366978) 00000020:00080000:1.0:1788572215.597974:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.597989:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615107840 t214748366978 from 192.168.202.13@tcp req@ffff94e637597b80 x1875449615107840/t0(214748366978) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.598127:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.598145:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.598158:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.598170:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.598177:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.598184:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.598543:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831da02 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3d1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.598554:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831da02 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.598561:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831da02 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.598818:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].89, 64 off13888 00010000:00010000:1.0:1788572215.598897:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831da02 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599435:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831da02 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599445:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831da02 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599450:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.599455:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831da02 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599463:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831da02 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599476:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3d1:0x0].0x0 (ffff94e63ab76f00) 00010000:00010000:1.0:1788572215.599480:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.599485:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831da02 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599497:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831da02 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599519:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599525:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599530:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599535:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.599538:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599544:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599552:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76200) 00010000:00010000:1.0:1788572215.599554:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.599557:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599562:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831d9f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.599573:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d69a8280 reply state 00000000b664fb08 transno 214748366978 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599584:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.599592:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6b28eb02 (ffff94e63ab76d00) 00010000:00010000:1.0:1788572215.599594:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.599597:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.599692:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.599712:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.599715:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366979 00000020:00080000:1.0:1788572215.599719:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.599722:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366979 00000100:00100000:1.0:1788572215.602787:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.603025:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615108224 00000100:00100000:3.0:1788572215.603037:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615108224 00000100:00100000:3.0:1788572215.603097:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10831 00000100:00100000:3.0:1788572215.603109:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+362:2382:x1875449615108224:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.603132:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366979, current: 214748366979, replaying 00000100:00100000:3.0:1788572215.603145:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+362:2382:x1875449615108224:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (372us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.603153:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10831 00000020:00080000:1.0:1788572215.603400:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.603405:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366979, next_transno: 214748366979 00010000:00080000:1.0:1788572215.603409:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366979) 00000020:00080000:1.0:1788572215.603412:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.603422:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615108224 t214748366979 from 192.168.202.13@tcp req@ffff94e63a9b0a80 x1875449615108224/t0(214748366979) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.604248:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da09 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.604270:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da09 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.604284:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da09 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.604366:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.604375:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.604385:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.605743:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da17 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.605762:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da17 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.605771:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da17 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.607234:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].90, 64 off13952 00010000:00010000:1.0:1788572215.607331:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da17 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607342:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da17 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607350:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da17 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607356:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.607361:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da17 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607369:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da17 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607387:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3d2:0x0].0x0 (ffff94e63ab76400) 00010000:00010000:1.0:1788572215.607390:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.607396:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da17 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607403:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da17 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607432:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da09 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607438:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da09 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607443:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da09 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607448:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.607451:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da09 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607457:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da09 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607464:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.607467:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.607469:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da09 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607475:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da09 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.607487:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006246c9e2 reply state 000000004b95348a transno 214748366979 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607504:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.607512:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30fa3357 (ffff94e63ab76a00) 00010000:00010000:1.0:1788572215.607515:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.607518:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.607620:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.607645:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.607648:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366980 00000020:00080000:1.0:1788572215.607653:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.607656:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366980 00000100:00100000:3.0:1788572215.612543:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615108608 00000100:00100000:3.0:1788572215.612566:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615108608 00000100:00100000:3.0:1788572215.612656:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10832 00000100:00100000:3.0:1788572215.612667:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+364:2382:x1875449615108608:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.612699:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366980, current: 214748366980, replaying 00000100:00100000:3.0:1788572215.612722:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+364:2382:x1875449615108608:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 58us (592us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.612730:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10832 00000100:00100000:2.0:1788572215.617024:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615108992 00000100:00100000:2.0:1788572215.617036:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615108992 00000100:00100000:2.0:1788572215.617094:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10833 00000100:00100000:2.0:1788572215.617103:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+366:2382:x1875449615108992:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.617162:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366981, current: 214748366981, replaying 00000100:00100000:2.0:1788572215.617186:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+366:2382:x1875449615108992:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 75us (299us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.617194:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10833 00000100:00100000:2.0:1788572215.623597:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615109376 00000100:00100000:2.0:1788572215.623611:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615109376 00000100:00100000:2.0:1788572215.623723:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10834 00000100:00100000:2.0:1788572215.623737:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+368:2382:x1875449615109376:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.623767:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366982, current: 214748366982, replaying 00000100:00100000:2.0:1788572215.623791:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+368:2382:x1875449615109376:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 57us (399us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.623802:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10834 00000020:00080000:1.0:1788572215.623849:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.623854:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366982, next_transno: 214748366982 00010000:00080000:1.0:1788572215.623859:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366982) 00000020:00080000:1.0:1788572215.623863:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.623874:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615109376 t214748366982 from 192.168.202.13@tcp req@ffff94e637594a80 x1875449615109376/t0(214748366982) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.623987:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da48 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624019:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624031:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624045:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeea984ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624055:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeea984ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624062:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeea984ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624242:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da56 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624251:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da56 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624258:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da56 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.624701:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].91, 64 off14016 00010000:00010000:1.0:1788572215.624786:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da56 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624794:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da56 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624801:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da56 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624808:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.624812:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da56 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624820:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da56 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624838:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3d5:0x0].0x0 (ffff94e63ab76200) 00010000:00010000:1.0:1788572215.624841:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.624846:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da56 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624852:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da56 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624872:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da48 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624877:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da48 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624882:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da48 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624886:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.624889:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da48 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624894:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da48 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.624901:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.625197:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.625202:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da48 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.625209:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da48 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.625227:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094909398 reply state 00000000c9ea1aa5 transno 214748366982 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeea984ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.625240:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeea984ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.625248:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeea984ee (ffff94e63ab76400) 00010000:00010000:1.0:1788572215.625250:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.625253:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572215.629593:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.629636:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615109760 00000100:00100000:2.0:1788572215.629646:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615109760 00000100:00100000:2.0:1788572215.629760:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10835 00000100:00100000:2.0:1788572215.629772:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+370:2382:x1875449615109760:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.629794:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366983, current: 214748366983, replaying 00000100:00100000:2.0:1788572215.629854:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+370:2382:x1875449615109760:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 84us (270us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.629862:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10835 00000100:00100000:2.0:1788572215.637635:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615110144 00000100:00100000:2.0:1788572215.637646:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615110144 00000100:00100000:2.0:1788572215.637720:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10836 00000100:00100000:2.0:1788572215.637731:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+372:2382:x1875449615110144:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.637754:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366984, current: 214748366984, replaying 00000100:00100000:2.0:1788572215.637774:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+372:2382:x1875449615110144:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (224us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.637782:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10836 00000100:00100000:1.0:1788572215.641339:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.641550:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.641555:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366985, next_transno: 214748366985 00010000:00080000:1.0:1788572215.641559:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366985) 00000020:00080000:1.0:1788572215.641562:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.641572:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615110528 t214748366985 from 192.168.202.13@tcp req@ffff94e63a9b0e00 x1875449615110528/t0(214748366985) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.641660:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.641686:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.641698:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.641711:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x30a9536b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.641718:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30a9536b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.641725:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30a9536b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.641901:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831da95 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642124:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831da95 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642133:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831da95 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.642672:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].93, 64 off14144 00010000:00010000:1.0:1788572215.642747:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831da95 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642755:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831da95 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642762:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831da95 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642767:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.642772:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831da95 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642779:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831da95 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642792:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3d8:0x0].0x0 (ffff94e63ab76f00) 00010000:00010000:1.0:1788572215.642795:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.642801:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831da95 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642807:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831da95 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642828:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642834:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da87 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642839:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642844:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.642847:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642853:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642860:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.642862:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.642865:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da87 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642870:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831da87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.642880:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004212aedc reply state 000000006d06e06d transno 214748366985 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30a9536b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642895:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30a9536b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.642902:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30a9536b (ffff94e63ab76200) 00010000:00010000:1.0:1788572215.642904:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.643543:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.648856:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.648895:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.648899:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366986 00000020:00080000:1.0:1788572215.648905:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.648907:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366986 00000100:00100000:1.0:1788572215.652832:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.652914:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615110912 00000100:00100000:3.0:1788572215.652927:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615110912 00000100:00100000:3.0:1788572215.652985:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10838 00000100:00100000:3.0:1788572215.652995:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+376:2382:x1875449615110912:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.653185:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366986, current: 214748366986, replaying 00000100:00100000:3.0:1788572215.653222:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+376:2382:x1875449615110912:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 228us (401us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.653229:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10838 00000020:00080000:1.0:1788572215.653324:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.653328:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366986, next_transno: 214748366986 00010000:00080000:1.0:1788572215.653333:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366986) 00000020:00080000:1.0:1788572215.653347:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.653358:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615110912 t214748366986 from 192.168.202.13@tcp req@ffff94e63a9b2680 x1875449615110912/t0(214748366986) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.653524:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831da9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.653542:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831da9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.653554:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831da9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.653568:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x32593d78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.653611:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x32593d78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.653617:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x32593d78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.653845:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daaa lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.653854:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daaa lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.653861:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daaa lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.654177:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].93, 64 off14144 00010000:00010000:1.0:1788572215.654265:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daaa lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654274:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daaa lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654281:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daaa lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654298:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.654303:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daaa lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654311:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daaa lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654340:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3d9:0x0].0x0 (ffff94e63ab76300) 00010000:00010000:1.0:1788572215.654343:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.654348:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daaa lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654365:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daaa lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654419:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831da9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654427:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831da9c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654440:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831da9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654446:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.654449:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831da9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654454:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831da9c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654477:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76900) 00010000:00010000:1.0:1788572215.654480:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.654483:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831da9c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654489:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831da9c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.654508:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f30eee0 reply state 0000000039ab2711 transno 214748366986 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x32593d78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654519:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32593d78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.654526:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x32593d78 (ffff94e63ab76c00) 00010000:00010000:1.0:1788572215.654528:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.654531:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.654640:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.654673:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.654685:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366987 00000020:00080000:1.0:1788572215.654703:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.654705:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366987 00000100:00100000:2.0:1788572215.663760:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615111296 00000100:00100000:2.0:1788572215.663771:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615111296 00000100:00100000:2.0:1788572215.663850:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10839 00000100:00100000:2.0:1788572215.663861:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+378:2382:x1875449615111296:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.663883:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366987, current: 214748366987, replaying 00000100:00100000:2.0:1788572215.663906:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+378:2382:x1875449615111296:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (351us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.663917:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10839 00000020:00080000:1.0:1788572215.664086:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.664091:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366987, next_transno: 214748366987 00010000:00080000:1.0:1788572215.664115:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366987) 00000020:00080000:1.0:1788572215.664119:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.664130:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615111296 t214748366987 from 192.168.202.13@tcp req@ffff94e633db1f80 x1875449615111296/t0(214748366987) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.664287:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831dab1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664306:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831dab1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664319:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831dab1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664336:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664343:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664350:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664563:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dabf lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664572:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dabf lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664580:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dabf lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.664889:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].94, 64 off14208 00010000:00010000:1.0:1788572215.664949:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dabf lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664957:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dabf lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664964:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dabf lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664970:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.664975:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dabf lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664987:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dabf lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.664999:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3da:0x0].0x0 (ffff94e63ab76700) 00010000:00010000:1.0:1788572215.665027:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.665033:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dabf lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.665041:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dabf lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.665063:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831dab1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.665069:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831dab1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.665076:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831dab1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.665081:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.665083:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831dab1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.665090:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831dab1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.665097:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.665099:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.665102:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831dab1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.665112:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831dab1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.665124:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9fe2771 reply state 00000000790f6e21 transno 214748366987 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.665171:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.665189:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe57a9acd (ffff94e63ab76f00) 00010000:00010000:1.0:1788572215.665192:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.665196:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.665338:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.665356:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.665359:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366988 00000020:00080000:1.0:1788572215.665363:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.665365:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366988 00000100:00100000:1.0:1788572215.673646:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615111680 00000100:00100000:1.0:1788572215.673672:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615111680 00000100:00100000:1.0:1788572215.673811:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10840 00000100:00100000:1.0:1788572215.673822:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+380:2382:x1875449615111680:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.673844:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366988, current: 214748366988, replaying 00000100:00100000:1.0:1788572215.673864:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+380:2382:x1875449615111680:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (438us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.673872:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10840 00000100:00100000:3.0:1788572215.683969:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.684666:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.684672:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366989, next_transno: 214748366989 00010000:00080000:1.0:1788572215.684700:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366989) 00000020:00080000:1.0:1788572215.684703:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.684722:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615112064 t214748366989 from 192.168.202.13@tcp req@ffff94e618493100 x1875449615112064/t0(214748366989) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.684813:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dadb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.684829:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dadb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.684840:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dadb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.684853:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.684860:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.684867:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.685279:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831dae9 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.685556:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831dae9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.685587:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831dae9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.686542:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].95, 64 off14272 00010000:00010000:1.0:1788572215.686638:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831dae9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686648:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831dae9 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686655:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831dae9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686661:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.686665:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831dae9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686685:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831dae9 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686700:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3dc:0x0].0x0 (ffff94e63ab76900) 00010000:00010000:1.0:1788572215.686703:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.686708:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831dae9 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686714:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831dae9 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686740:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dadb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686746:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dadb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686750:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dadb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686760:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.686763:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dadb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686770:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dadb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686778:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.686780:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.686784:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dadb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686789:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831dadb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.686804:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ff3c631 reply state 0000000029a336bb transno 214748366989 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686815:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.686823:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ddbc747 (ffff94e63ab76700) 00010000:00010000:1.0:1788572215.686825:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.686828:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.688607:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.688668:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.688712:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366990 00000020:00080000:1.0:1788572215.688718:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.688720:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366990 00000100:00100000:1.0:1788572215.702359:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.702515:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615112448 00000100:00100000:2.0:1788572215.702527:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615112448 00000100:00100000:2.0:1788572215.702591:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10842 00000100:00100000:2.0:1788572215.702602:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+384:2382:x1875449615112448:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.702622:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366990, current: 214748366990, replaying 00000100:00100000:2.0:1788572215.702640:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+384:2382:x1875449615112448:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 41us (293us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.702649:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10842 00000020:00080000:1.0:1788572215.702820:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.702825:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366990, next_transno: 214748366990 00010000:00080000:1.0:1788572215.702829:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366990) 00000020:00080000:1.0:1788572215.702832:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.702842:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615112448 t214748366990 from 192.168.202.13@tcp req@ffff94e63a9b3800 x1875449615112448/t0(214748366990) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.702963:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831daf0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.702986:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831daf0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703001:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831daf0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703236:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x98234114 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703244:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x98234114 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703252:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x98234114 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703539:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831dafe lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703549:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831dafe lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703556:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831dafe lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.703799:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].95, 64 off14272 00010000:00010000:1.0:1788572215.703861:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831dafe lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703869:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831dafe lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703875:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831dafe lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703879:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.703882:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831dafe lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703888:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831dafe lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703897:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3dd:0x0].0x0 (ffff94e63ab76300) 00010000:00010000:1.0:1788572215.703899:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.703903:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831dafe lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.703918:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831dafe lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.704468:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831daf0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.704475:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831daf0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.704486:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831daf0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.704491:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.704494:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831daf0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.704501:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831daf0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.704510:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.704513:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.704516:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831daf0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.704522:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831daf0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.704535:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000554debce reply state 000000007d2f180e transno 214748366990 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x98234114 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.704547:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x98234114 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.704553:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x98234114 (ffff94e63ab76900) 00010000:00010000:1.0:1788572215.704555:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.704559:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.704657:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.704687:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.704691:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366991 00000020:00080000:1.0:1788572215.704695:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.704697:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366991 00000100:00100000:1.0:1788572215.707800:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615112832 00000100:00100000:1.0:1788572215.707811:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615112832 00000100:00100000:1.0:1788572215.707871:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10843 00000100:00100000:1.0:1788572215.707881:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+386:2382:x1875449615112832:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.707900:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366991, current: 214748366991, replaying 00000100:00100000:1.0:1788572215.707932:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+386:2382:x1875449615112832:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 53us (816us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.707939:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10843 00000100:00100000:3.0:1788572215.732129:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.733062:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.733069:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366992, next_transno: 214748366992 00010000:00080000:1.0:1788572215.733074:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366992) 00000020:00080000:1.0:1788572215.733078:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.733089:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615113216 t214748366992 from 192.168.202.13@tcp req@ffff94e618490380 x1875449615113216/t0(214748366992) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.733200:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db1a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.733218:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.733231:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.733246:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4b01139e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.733258:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b01139e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.733265:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b01139e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.734522:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db28 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.734540:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db28 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.734550:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db28 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.735249:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].96, 64 off14336 00010000:00010000:1.0:1788572215.735648:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db28 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735659:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db28 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735667:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db28 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735683:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.735688:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db28 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735696:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db28 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735714:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3df:0x0].0x0 (ffff94e63ab76e00) 00010000:00010000:1.0:1788572215.735716:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.735721:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db28 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735727:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db28 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735751:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db1a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735758:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db1a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735763:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735768:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.735771:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db1a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735776:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db1a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735783:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.735785:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.735788:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db1a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735793:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db1a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.735811:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ef50a42 reply state 000000002f21c24a transno 214748366992 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4b01139e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735823:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b01139e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.735830:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4b01139e (ffff94e63ab76300) 00010000:00010000:1.0:1788572215.735833:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.735836:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.735944:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.735970:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.735973:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366993 00000020:00080000:1.0:1788572215.735977:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.735979:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366993 00000100:00100000:1.0:1788572215.741595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.741716:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615113600 00000100:00100000:2.0:1788572215.741727:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615113600 00000100:00100000:2.0:1788572215.741788:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10845 00000100:00100000:2.0:1788572215.741799:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+390:2382:x1875449615113600:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.741822:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366993, current: 214748366993, replaying 00000100:00100000:2.0:1788572215.741840:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+390:2382:x1875449615113600:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (269us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.741847:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10845 00000020:00080000:1.0:1788572215.741933:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.741937:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366993, next_transno: 214748366993 00010000:00080000:1.0:1788572215.741942:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366993) 00000020:00080000:1.0:1788572215.741945:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.741955:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615113600 t214748366993 from 192.168.202.13@tcp req@ffff94e60fc45c00 x1875449615113600/t0(214748366993) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.742108:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db2f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742125:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742140:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742153:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742161:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742167:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742552:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db3d lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742563:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db3d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742581:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db3d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.742822:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].97, 64 off14400 00010000:00010000:1.0:1788572215.742885:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db3d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742893:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db3d lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742901:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db3d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742908:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.742912:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db3d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742935:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db3d lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742948:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3e0:0x0].0x0 (ffff94e602c23f00) 00010000:00010000:1.0:1788572215.742951:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.742956:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db3d lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742963:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db3d lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742989:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db2f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.742995:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db2f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.743001:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db2f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.743245:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.743249:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db2f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.743257:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db2f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.743267:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63aaace00) 00010000:00010000:1.0:1788572215.743269:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.743273:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db2f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.743284:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db2f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.743370:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8f38e64 reply state 00000000546de3e2 transno 214748366993 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.743383:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.743390:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf9c01ef (ffff94e602c23100) 00010000:00010000:1.0:1788572215.743392:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.743396:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572215.764965:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615113984 00000100:00100000:1.0:1788572215.764976:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615113984 00000020:00080000:1.0:1788572215.765995:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.766000:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366994, next_transno: 214748366994 00010000:00080000:1.0:1788572215.766023:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366994) 00000020:00080000:1.0:1788572215.766026:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.766036:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615113984 t214748366994 from 192.168.202.13@tcp req@ffff94e633db0a80 x1875449615113984/t0(214748366994) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.766146:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db44 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766163:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766176:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766189:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x96796b54 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766197:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96796b54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766203:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96796b54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766374:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db52 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766383:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db52 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766391:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db52 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.766615:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].97, 64 off14400 00010000:00010000:1.0:1788572215.766671:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db52 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766689:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db52 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766696:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db52 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766703:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.766707:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db52 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766715:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db52 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766731:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3e1:0x0].0x0 (ffff94e602c23700) 00010000:00010000:1.0:1788572215.766734:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.766739:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db52 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766745:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db52 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766768:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766774:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db44 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766780:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db44 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766784:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.766787:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db44 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766792:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db44 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766799:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23f00) 00010000:00010000:1.0:1788572215.766802:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.766804:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db44 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766809:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db44 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.766825:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067782893 reply state 00000000168e416d transno 214748366994 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96796b54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766836:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96796b54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.766842:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x96796b54 (ffff94e602c23000) 00010000:00010000:1.0:1788572215.766844:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.766847:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.766955:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.766976:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.766978:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366995 00000020:00080000:1.0:1788572215.766982:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.766984:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366995 00000100:00100000:1.0:1788572215.771804:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.781936:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615114368 00000100:00100000:2.0:1788572215.781961:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615114368 00000020:00080000:1.0:1788572215.782890:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.782897:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366995, next_transno: 214748366995 00010000:00080000:1.0:1788572215.782903:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366995) 00000020:00080000:1.0:1788572215.782906:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.782927:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615114368 t214748366995 from 192.168.202.13@tcp req@ffff94e60fc45880 x1875449615114368/t0(214748366995) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.783048:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db59 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783066:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783078:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783094:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x744968a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783100:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x744968a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783106:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x744968a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783278:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831db67 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3e2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783287:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831db67 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783293:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831db67 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.783513:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].98, 64 off14464 00010000:00010000:1.0:1788572215.783570:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831db67 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783578:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831db67 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783585:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831db67 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783591:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637696c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.783595:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831db67 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783608:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831db67 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783621:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3e2:0x0].0x0 (ffff94e602c23400) 00010000:00010000:1.0:1788572215.783624:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.783629:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831db67 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783635:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831db67 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783657:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783663:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db59 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783668:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783685:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.783688:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783694:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db59 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783701:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23300) 00010000:00010000:1.0:1788572215.783703:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.783706:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db59 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783716:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831db59 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.783728:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f623a25 reply state 00000000fec470b2 transno 214748366995 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x744968a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783739:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x744968a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.783745:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x744968a9 (ffff94e602c23900) 00010000:00010000:1.0:1788572215.783747:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.783750:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.783827:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.783844:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.783847:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366996 00000020:00080000:1.0:1788572215.783850:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.783852:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366996 00000100:00100000:3.0:1788572215.790154:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.791430:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615114752 00000100:00100000:2.0:1788572215.791444:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615114752 00000100:00100000:2.0:1788572215.791563:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10848 00000100:00100000:2.0:1788572215.791575:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+396:2382:x1875449615114752:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.791595:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366996, current: 214748366996, replaying 00000100:00100000:2.0:1788572215.791615:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+396:2382:x1875449615114752:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (1473us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.791624:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10848 00000020:00080000:1.0:1788572215.791663:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.791668:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366996, next_transno: 214748366996 00010000:00080000:1.0:1788572215.791681:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366996) 00000020:00080000:1.0:1788572215.791684:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.791694:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615114752 t214748366996 from 192.168.202.13@tcp req@ffff94e618493800 x1875449615114752/t0(214748366996) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.791790:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.791807:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.791823:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.791838:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.791846:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.791852:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792076:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831db7c lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792084:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831db7c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792092:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831db7c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.792329:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].98, 64 off14464 00010000:00010000:1.0:1788572215.792391:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831db7c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792399:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831db7c lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792406:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831db7c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792412:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14a200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.792417:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831db7c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792424:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831db7c lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792437:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3e3:0x0].0x0 (ffff94e602c23800) 00010000:00010000:1.0:1788572215.792440:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.792445:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831db7c lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792451:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831db7c lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792473:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792479:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db6e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792486:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792491:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.792494:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792499:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792506:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23f00) 00010000:00010000:1.0:1788572215.792508:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.792511:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db6e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792517:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831db6e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.792529:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c67792c reply state 00000000c5018576 transno 214748366996 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792540:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.792547:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbd7ad76 (ffff94e602c23700) 00010000:00010000:1.0:1788572215.792550:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.792552:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.792645:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.792797:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.792800:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366997 00000020:00080000:1.0:1788572215.792804:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.792806:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366997 00000100:00100000:3.0:1788572215.795274:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.795706:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.795710:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366997, next_transno: 214748366997 00010000:00080000:1.0:1788572215.795714:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366997) 00000020:00080000:1.0:1788572215.795717:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.795726:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615115136 t214748366997 from 192.168.202.13@tcp req@ffff94e618493b80 x1875449615115136/t0(214748366997) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.795811:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831db83 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.795827:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831db83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.795838:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831db83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.795851:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x54af8acb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.795858:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54af8acb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.795865:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54af8acb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796082:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831db91 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796091:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831db91 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796097:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831db91 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.796304:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].99, 64 off14528 00010000:00010000:1.0:1788572215.796359:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831db91 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796367:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831db91 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796375:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831db91 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796381:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.796385:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831db91 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796392:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831db91 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796404:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3e4:0x0].0x0 (ffff94e602c23e00) 00010000:00010000:1.0:1788572215.796407:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.796411:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831db91 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796416:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831db91 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796436:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831db83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796442:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831db83 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796447:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831db83 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796452:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.796455:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831db83 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796460:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831db83 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796468:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23c00) 00010000:00010000:1.0:1788572215.796470:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.796473:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831db83 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796479:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831db83 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.796491:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edd55a37 reply state 0000000004337941 transno 214748366997 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x54af8acb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796501:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54af8acb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.796507:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54af8acb (ffff94e602c23600) 00010000:00010000:1.0:1788572215.796509:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.796511:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.796577:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.796594:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.796596:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366998 00000020:00080000:1.0:1788572215.796601:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.796603:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366998 00000100:00100000:1.0:1788572215.799699:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.799782:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615115520 00000100:00100000:3.0:1788572215.799792:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615115520 00000100:00100000:3.0:1788572215.799860:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10850 00000100:00100000:3.0:1788572215.799871:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+400:2382:x1875449615115520:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.799892:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366998, current: 214748366998, replaying 00000100:00100000:3.0:1788572215.799914:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+400:2382:x1875449615115520:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (228us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.799928:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10850 00000020:00080000:2.0:1788572215.800046:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.800051:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366998, next_transno: 214748366998 00010000:00080000:2.0:1788572215.800057:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366998) 00000020:00080000:2.0:1788572215.800060:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.800071:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615115520 t214748366998 from 192.168.202.13@tcp req@ffff94e637795180 x1875449615115520/t0(214748366998) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.800165:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831db98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800183:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831db98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800196:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831db98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800209:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800217:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800225:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800414:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dba6 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800423:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dba6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800432:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dba6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.800646:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].99, 64 off14528 00010000:00010000:2.0:1788572215.800730:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dba6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800739:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dba6 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800746:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dba6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800752:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.800757:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dba6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800765:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dba6 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800778:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3e5:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572215.800781:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.800787:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dba6 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800794:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dba6 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800818:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831db98 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800829:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831db98 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800836:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831db98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800841:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.800844:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831db98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800850:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831db98 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800859:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7b00) 00010000:00010000:2.0:1788572215.800861:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.800865:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831db98 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800871:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831db98 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.800882:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008df74553 reply state 00000000c13b5b0e transno 214748366998 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800894:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.800901:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb9deef0 (ffff94e6053c7f00) 00010000:00010000:2.0:1788572215.800903:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.800906:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.800996:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.801039:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.801042:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366999 00000020:00080000:2.0:1788572215.801046:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.801048:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748366999 00000100:00100000:3.0:1788572215.803700:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572215.803790:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615115904 00000100:00100000:1.0:1788572215.803801:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615115904 00000100:00100000:1.0:1788572215.803850:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10851 00000100:00100000:1.0:1788572215.803860:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+402:2382:x1875449615115904:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.803879:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748366999, current: 214748366999, replaying 00000100:00100000:1.0:1788572215.803901:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+402:2382:x1875449615115904:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (212us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.803908:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10851 00000020:00080000:3.0:1788572215.804142:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.804146:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748366999, next_transno: 214748366999 00010000:00080000:3.0:1788572215.804150:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748366999) 00000020:00080000:3.0:1788572215.804153:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.804164:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615115904 t214748366999 from 192.168.202.13@tcp req@ffff94e618490a80 x1875449615115904/t0(214748366999) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.804262:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804281:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804305:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804319:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804327:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804334:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804534:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbbb lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3e6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804547:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbbb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804555:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbbb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.804790:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].100, 64 off14592 00010000:00010000:3.0:1788572215.804851:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbbb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804860:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbbb lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804867:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbbb lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804873:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.804877:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbbb lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804885:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbbb lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804897:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3e6:0x0].0x0 (ffff94e61a333500) 00010000:00010000:3.0:1788572215.804900:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.804905:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbbb lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.804912:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbbb lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.805315:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.805322:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbad lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.805328:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.805333:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.805337:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.805343:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.805352:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61a333400) 00010000:00010000:3.0:1788572215.805355:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.805358:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.805363:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.805375:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7f791e6 reply state 00000000efcdcc1d transno 214748366999 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.805385:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.805391:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8f1d745 (ffff94e61a333d00) 00010000:00010000:3.0:1788572215.805393:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.805396:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.805483:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.805503:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.805507:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367000 00000020:00080000:3.0:1788572215.805511:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.805513:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367000 00000100:00100000:3.0:1788572215.808262:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.808422:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615116288 00000100:00100000:2.0:1788572215.808434:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615116288 00000100:00100000:2.0:1788572215.808489:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10852 00000100:00100000:2.0:1788572215.808498:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+404:2382:x1875449615116288:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.808516:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367000, current: 214748367000, replaying 00000100:00100000:2.0:1788572215.808530:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+404:2382:x1875449615116288:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 34us (279us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.808537:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10852 00000100:00100000:1.0:1788572215.813346:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:3.0:1788572215.814041:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.814047:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367001, next_transno: 214748367001 00010000:00080000:3.0:1788572215.814052:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367001) 00000020:00080000:3.0:1788572215.814055:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.814066:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615116672 t214748367001 from 192.168.202.13@tcp req@ffff94e637794000 x1875449615116672/t0(214748367001) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.814179:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbd7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814200:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814213:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814227:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814234:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814240:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814456:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dbe5 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814466:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dbe5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814473:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dbe5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.814703:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].101, 64 off14656 00010000:00010000:3.0:1788572215.814761:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dbe5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814769:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dbe5 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814775:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dbe5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814781:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.814785:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dbe5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814793:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dbe5 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814805:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3e8:0x0].0x0 (ffff94e6029e1200) 00010000:00010000:3.0:1788572215.814808:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.814812:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dbe5 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814822:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dbe5 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814843:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814849:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbd7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814854:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbd7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814858:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.814861:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbd7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814866:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbd7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814873:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61a333400) 00010000:00010000:3.0:1788572215.814875:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.814877:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbd7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814882:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dbd7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.814893:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058f86172 reply state 00000000862c4059 transno 214748367001 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814902:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.814909:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9b911f77 (ffff94e61a333500) 00010000:00010000:3.0:1788572215.814912:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.814915:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.816258:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.816297:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.816302:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367002 00000020:00080000:3.0:1788572215.816307:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.816308:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367002 00000100:00100000:2.0:1788572215.819898:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.820902:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10854 00000100:00100000:2.0:1788572215.820914:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+408:2382:x1875449615117056:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.820944:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367002, current: 214748367002, replaying 00000100:00100000:2.0:1788572215.820962:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+408:2382:x1875449615117056:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 51us (1077us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.820969:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10854 00000020:00080000:3.0:1788572215.821030:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.821042:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367002, next_transno: 214748367002 00010000:00080000:3.0:1788572215.821047:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367002) 00000020:00080000:3.0:1788572215.821050:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.821060:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615117056 t214748367002 from 192.168.202.13@tcp req@ffff94e63779aa00 x1875449615117056/t0(214748367002) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.821159:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dbec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821174:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dbec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821185:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dbec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821196:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821203:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821214:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821597:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dbfa lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821607:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dbfa lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821615:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dbfa lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.821874:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].101, 64 off14656 00010000:00010000:3.0:1788572215.821941:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dbfa lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821949:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dbfa lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821956:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dbfa lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821962:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.821967:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dbfa lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821975:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dbfa lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.821987:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3e9:0x0].0x0 (ffff94e618898100) 00010000:00010000:3.0:1788572215.821989:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.821994:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dbfa lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.822000:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dbfa lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.822069:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dbec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.822076:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dbec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.822081:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dbec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.822087:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.822089:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dbec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.822096:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dbec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.822104:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e618898000) 00010000:00010000:3.0:1788572215.822107:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.822110:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dbec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.822116:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dbec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.822127:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000251ffd8a reply state 0000000064079856 transno 214748367002 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.822141:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.822146:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6c7f839c (ffff94e618898d00) 00010000:00010000:3.0:1788572215.822149:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.822151:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.822233:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.822252:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.822255:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367003 00000020:00080000:3.0:1788572215.822259:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.822260:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367003 00000100:00100000:3.0:1788572215.826449:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615117440 00000100:00100000:3.0:1788572215.826465:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615117440 00000100:00100000:3.0:1788572215.826549:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10855 00000100:00100000:3.0:1788572215.826561:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+410:2382:x1875449615117440:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.826584:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367003, current: 214748367003, replaying 00000100:00100000:3.0:1788572215.826607:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+410:2382:x1875449615117440:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 49us (549us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.826614:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10855 00000020:00080000:1.0:1788572215.826688:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.826694:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367003, next_transno: 214748367003 00010000:00080000:1.0:1788572215.826699:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367003) 00000020:00080000:1.0:1788572215.826702:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.826713:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615117440 t214748367003 from 192.168.202.13@tcp req@ffff94e633db3b80 x1875449615117440/t0(214748367003) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.826821:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dc01 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.826839:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dc01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.826852:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dc01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.826865:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8095535a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.826872:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8095535a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.826878:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8095535a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827182:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dc0f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827192:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dc0f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827206:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dc0f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.827728:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].102, 64 off14720 00010000:00010000:1.0:1788572215.827792:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dc0f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827801:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dc0f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827808:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dc0f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827814:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.827819:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dc0f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827827:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dc0f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827841:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ea:0x0].0x0 (ffff94e602c23f00) 00010000:00010000:1.0:1788572215.827844:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.827850:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dc0f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827857:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dc0f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827879:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dc01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827889:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dc01 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827895:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dc01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827900:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.827903:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dc01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.827909:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dc01 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.828158:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23c00) 00010000:00010000:1.0:1788572215.828162:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.828166:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dc01 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.828172:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dc01 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.828186:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcdcb3ef reply state 000000001660b81e transno 214748367003 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8095535a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.828196:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8095535a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.828203:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8095535a (ffff94e602c23e00) 00010000:00010000:1.0:1788572215.828205:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.828207:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.828467:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.828490:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.828493:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367004 00000020:00080000:1.0:1788572215.828497:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.828499:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367004 00000100:00100000:1.0:1788572215.831641:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:3.0:1788572215.832253:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.832258:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367004, next_transno: 214748367004 00010000:00080000:3.0:1788572215.832262:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367004) 00000020:00080000:3.0:1788572215.832266:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.832277:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615117824 t214748367004 from 192.168.202.13@tcp req@ffff94e637795f80 x1875449615117824/t0(214748367004) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.832511:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc16 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.832528:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.832544:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.832560:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.832567:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.832574:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.832760:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc24 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.832769:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc24 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.832775:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc24 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.833423:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].102, 64 off14720 00010000:00010000:3.0:1788572215.833491:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc24 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833500:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc24 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833508:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc24 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833514:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.833519:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc24 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833526:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc24 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833538:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3eb:0x0].0x0 (ffff94e6029e1200) 00010000:00010000:3.0:1788572215.833541:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.833545:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc24 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833550:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc24 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833574:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833581:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc16 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833586:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833591:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.833594:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833604:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc16 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833611:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e618898e00) 00010000:00010000:3.0:1788572215.833614:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.833616:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc16 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833621:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc16 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.833633:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002af9c7f5 reply state 00000000714a16ba transno 214748367004 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833643:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.833649:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd6eabd67 (ffff94e61a333400) 00010000:00010000:3.0:1788572215.833651:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.833654:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.833809:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.833832:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.833835:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367005 00000020:00080000:3.0:1788572215.833839:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.833841:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367005 00000100:00100000:2.0:1788572215.838761:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572215.839550:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.839554:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367005, next_transno: 214748367005 00010000:00080000:2.0:1788572215.839559:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367005) 00000020:00080000:2.0:1788572215.839562:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.839573:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615118208 t214748367005 from 192.168.202.13@tcp req@ffff94e637798380 x1875449615118208/t0(214748367005) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.839667:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dc2b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.839694:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dc2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.839706:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dc2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.839719:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.839725:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.839730:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840198:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831dc39 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840210:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831dc39 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840218:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831dc39 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.840609:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].103, 64 off14784 00010000:00010000:2.0:1788572215.840702:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831dc39 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840711:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831dc39 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840718:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831dc39 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840723:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.840729:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831dc39 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840737:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831dc39 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840753:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ec:0x0].0x0 (ffff94e6135f0700) 00010000:00010000:2.0:1788572215.840757:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.840762:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831dc39 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840769:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831dc39 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840799:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dc2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840806:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dc2b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840811:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dc2b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840816:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.840819:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dc2b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840830:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dc2b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840837:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572215.840840:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.840843:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dc2b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840848:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831dc2b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.840861:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a4d8c6e reply state 000000005ccd7c9b transno 214748367005 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840871:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.840877:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcb1a85bc (ffff94e6053c7b00) 00010000:00010000:2.0:1788572215.840879:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.840882:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.841514:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.841537:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.841541:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367006 00000020:00080000:2.0:1788572215.841545:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.841547:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367006 00000100:00100000:1.0:1788572215.844476:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:3.0:1788572215.844764:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.844768:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367006, next_transno: 214748367006 00010000:00080000:3.0:1788572215.844772:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367006) 00000020:00080000:3.0:1788572215.844775:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.844786:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615118592 t214748367006 from 192.168.202.13@tcp req@ffff94e637794e00 x1875449615118592/t0(214748367006) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.844866:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831dc40 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.844882:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831dc40 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.844893:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831dc40 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.844904:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.844911:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.844927:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845434:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dc4e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845446:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dc4e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845454:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dc4e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.845682:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].103, 64 off14784 00010000:00010000:3.0:1788572215.845742:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dc4e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845754:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dc4e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845761:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dc4e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845767:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.845773:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dc4e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845781:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dc4e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845793:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ed:0x0].0x0 (ffff94e64217cb00) 00010000:00010000:3.0:1788572215.845796:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.845801:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dc4e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845807:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831dc4e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845829:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831dc40 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845835:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831dc40 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845840:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831dc40 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845845:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145be00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.845848:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831dc40 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845854:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831dc40 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845861:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e618898000) 00010000:00010000:3.0:1788572215.845864:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.845866:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831dc40 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845871:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831dc40 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.845883:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000809b8314 reply state 0000000021c9b782 transno 214748367006 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845894:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.845900:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e54e9e1 (ffff94e618898100) 00010000:00010000:3.0:1788572215.845903:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.845906:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.846281:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.846314:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.846318:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367007 00000020:00080000:3.0:1788572215.846322:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.846324:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367007 00000100:00100000:1.0:1788572215.849808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.849986:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615118976 00000100:00100000:3.0:1788572215.849999:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615118976 00000100:00100000:3.0:1788572215.850253:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10859 00000100:00100000:3.0:1788572215.850265:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+418:2382:x1875449615118976:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.850286:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367007, current: 214748367007, replaying 00000100:00100000:3.0:1788572215.850321:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+418:2382:x1875449615118976:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 58us (524us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.850329:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10859 00000020:00080000:2.0:1788572215.850369:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.850374:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367007, next_transno: 214748367007 00010000:00080000:2.0:1788572215.850379:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367007) 00000020:00080000:2.0:1788572215.850381:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.850392:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615118976 t214748367007 from 192.168.202.13@tcp req@ffff94e637796a00 x1875449615118976/t0(214748367007) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.850486:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831dc55 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.850504:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831dc55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.850516:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831dc55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.850533:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.850540:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.850548:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.850733:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831dc63 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.850742:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831dc63 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.850749:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831dc63 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.851255:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].104, 64 off14848 00000004:00080000:2.0:1788572215.851265:0:112013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4132872259922ns, next at 4133872257164ns, rc = 0 00010000:00010000:2.0:1788572215.851400:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831dc63 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851409:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831dc63 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851417:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831dc63 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851424:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.851428:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831dc63 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851436:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831dc63 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851450:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ee:0x0].0x0 (ffff94e6158d6100) 00010000:00010000:2.0:1788572215.851453:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.851458:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831dc63 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851465:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831dc63 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851489:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831dc55 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851495:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831dc55 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851500:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831dc55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851505:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.851508:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831dc55 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851514:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831dc55 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851520:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6158d6b00) 00010000:00010000:2.0:1788572215.851522:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.851525:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831dc55 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851530:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831dc55 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.851540:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e61b14f7 reply state 000000003e248753 transno 214748367007 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851551:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.851557:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x40a4e736 (ffff94e6158d6500) 00010000:00010000:2.0:1788572215.851560:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.851562:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.851643:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.851664:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.851667:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367008 00000020:00080000:2.0:1788572215.851681:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.851683:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367008 00000100:00100000:1.0:1788572215.854539:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.854629:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615119360 00000100:00100000:3.0:1788572215.854640:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615119360 00000100:00100000:3.0:1788572215.854751:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10860 00000100:00100000:3.0:1788572215.854762:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+420:2382:x1875449615119360:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.854783:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367008, current: 214748367008, replaying 00000100:00100000:3.0:1788572215.854805:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+420:2382:x1875449615119360:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (275us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.854812:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10860 00000020:00080000:2.0:1788572215.854855:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.854860:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367008, next_transno: 214748367008 00010000:00080000:2.0:1788572215.854864:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367008) 00000020:00080000:2.0:1788572215.854868:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.854879:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615119360 t214748367008 from 192.168.202.13@tcp req@ffff94e62d28ce00 x1875449615119360/t0(214748367008) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.854981:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831dc6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.854998:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831dc6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855039:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831dc6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855054:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855061:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855067:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855263:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831dc78 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855273:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831dc78 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855281:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831dc78 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.855515:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].104, 64 off14848 00000004:00080000:2.0:1788572215.855523:0:112013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 4132876518229ns, next at 4133876516038ns, rc = 0 00010000:00010000:2.0:1788572215.855578:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831dc78 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855586:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831dc78 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855594:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831dc78 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855600:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.855605:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831dc78 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855613:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831dc78 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855625:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ef:0x0].0x0 (ffff94e6158d6800) 00010000:00010000:2.0:1788572215.855628:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.855632:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831dc78 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855638:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831dc78 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855663:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831dc6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855668:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831dc6a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855685:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831dc6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855694:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.855697:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831dc6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855703:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831dc6a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855712:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6158d6d00) 00010000:00010000:2.0:1788572215.855714:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.855717:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831dc6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855723:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831dc6a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.855736:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012e58e76 reply state 00000000725978af transno 214748367008 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855747:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.855753:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d932c03 (ffff94e6158d6700) 00010000:00010000:2.0:1788572215.855755:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.855758:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.855838:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.855856:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.855859:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367009 00000020:00080000:2.0:1788572215.855862:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.855864:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367009 00000100:00100000:1.0:1788572215.858631:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572215.858729:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615119744 00000100:00100000:2.0:1788572215.858741:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615119744 00000100:00100000:2.0:1788572215.858847:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10861 00000100:00100000:2.0:1788572215.858858:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+422:2382:x1875449615119744:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.858879:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367009, current: 214748367009, replaying 00000100:00100000:2.0:1788572215.858900:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+422:2382:x1875449615119744:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (281us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.858907:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10861 00000020:00080000:3.0:1788572215.858948:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.858952:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367009, next_transno: 214748367009 00010000:00080000:3.0:1788572215.858956:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367009) 00000020:00080000:3.0:1788572215.858960:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.858970:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615119744 t214748367009 from 192.168.202.13@tcp req@ffff94e62d28c000 x1875449615119744/t0(214748367009) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572215.859098:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc7f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859114:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859127:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859142:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7848958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859149:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7848958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859154:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7848958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859363:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc8d lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859373:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc8d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859381:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc8d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572215.859620:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].105, 64 off14912 00010000:00010000:3.0:1788572215.859689:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc8d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859697:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc8d lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859705:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc8d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859711:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.859716:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc8d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859727:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc8d lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859742:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3f0:0x0].0x0 (ffff94e64217c400) 00010000:00010000:3.0:1788572215.859745:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572215.859750:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc8d lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859756:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831dc8d lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859778:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859785:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc7f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859790:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859795:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572215.859797:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859803:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc7f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859810:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e64217c800) 00010000:00010000:3.0:1788572215.859813:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572215.859816:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc7f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859827:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831dc7f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572215.859838:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053ba9097 reply state 00000000ce8dcc74 transno 214748367009 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7848958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859848:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7848958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572215.859855:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7848958 (ffff94e64217c100) 00010000:00010000:3.0:1788572215.859857:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572215.859860:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572215.859934:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572215.859954:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.859957:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367010 00000020:00080000:3.0:1788572215.859961:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572215.859963:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367010 00000100:00100000:1.0:1788572215.863637:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.863944:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.863949:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367010, next_transno: 214748367010 00010000:00080000:1.0:1788572215.863953:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367010) 00000020:00080000:1.0:1788572215.863956:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.863966:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615120128 t214748367010 from 192.168.202.13@tcp req@ffff94e62d28ca80 x1875449615120128/t0(214748367010) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.864099:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dc94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864117:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dc94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864132:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dc94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864145:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864153:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864160:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864352:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dca2 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864361:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dca2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864369:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dca2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.864594:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].105, 64 off14912 00010000:00010000:1.0:1788572215.864650:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dca2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864658:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dca2 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864665:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dca2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864699:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.864705:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dca2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864713:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dca2 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864726:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3f1:0x0].0x0 (ffff94e602c23800) 00010000:00010000:1.0:1788572215.864729:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.864735:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dca2 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864742:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dca2 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864761:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dc94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864767:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dc94 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864772:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dc94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864778:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.864781:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dc94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864787:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dc94 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864793:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23c00) 00010000:00010000:1.0:1788572215.864796:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.864798:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dc94 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864803:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dc94 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.864814:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a12f27f4 reply state 0000000072464955 transno 214748367010 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864829:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.864834:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90bdf2bd (ffff94e602c23f00) 00010000:00010000:1.0:1788572215.864837:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.864839:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.864919:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.864937:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.864940:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367011 00000020:00080000:1.0:1788572215.864944:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.864946:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367011 00000100:00100000:1.0:1788572215.867398:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.867652:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.867656:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367011, next_transno: 214748367011 00010000:00080000:1.0:1788572215.867660:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367011) 00000020:00080000:1.0:1788572215.867663:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.867681:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615120512 t214748367011 from 192.168.202.13@tcp req@ffff94e62d28c700 x1875449615120512/t0(214748367011) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.867768:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dca9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.867784:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dca9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.867796:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dca9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.867810:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.867817:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.867823:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868000:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcb7 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868060:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcb7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868067:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcb7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.868293:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].106, 64 off14976 00010000:00010000:1.0:1788572215.868348:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcb7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868355:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcb7 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868362:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcb7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868367:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.868371:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcb7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868378:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcb7 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868395:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3f2:0x0].0x0 (ffff94e602c23d00) 00010000:00010000:1.0:1788572215.868398:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.868402:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcb7 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868408:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcb7 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868428:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dca9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868434:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dca9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868440:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dca9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868445:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.868448:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dca9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868454:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dca9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868461:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23300) 00010000:00010000:1.0:1788572215.868464:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.868467:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dca9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868473:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dca9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.868489:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c75c53a4 reply state 00000000e95b1c6e transno 214748367011 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868500:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.868507:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe403dbe2 (ffff94e602c23400) 00010000:00010000:1.0:1788572215.868509:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.868511:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.868578:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.868594:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.868597:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367012 00000020:00080000:1.0:1788572215.868601:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.868603:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367012 00000100:00100000:3.0:1788572215.871839:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615120896 00000100:00100000:3.0:1788572215.871849:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615120896 00000100:00100000:3.0:1788572215.871910:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10864 00000100:00100000:3.0:1788572215.871929:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+428:2382:x1875449615120896:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.871951:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367012, current: 214748367012, replaying 00000100:00100000:3.0:1788572215.871973:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+428:2382:x1875449615120896:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 55us (230us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.871980:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10864 00000020:00080000:1.0:1788572215.872192:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.872197:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367012, next_transno: 214748367012 00010000:00080000:1.0:1788572215.872201:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367012) 00000020:00080000:1.0:1788572215.872204:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.872213:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615120896 t214748367012 from 192.168.202.13@tcp req@ffff94e633db3480 x1875449615120896/t0(214748367012) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.872353:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dcbe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.872371:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dcbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.872382:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dcbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.872399:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe474c0af bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.872406:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe474c0af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.872411:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe474c0af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.872596:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dccc lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.872605:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dccc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.872613:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dccc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.872845:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].106, 64 off14976 00010000:00010000:1.0:1788572215.872901:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dccc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.872909:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dccc lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.872916:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dccc lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873077:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.873081:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dccc lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873094:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dccc lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873107:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3f3:0x0].0x0 (ffff94e63aaace00) 00010000:00010000:1.0:1788572215.873110:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.873114:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dccc lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873119:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dccc lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873143:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dcbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873148:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dcbe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873154:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dcbe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873158:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.873161:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dcbe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873167:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dcbe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873173:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23200) 00010000:00010000:1.0:1788572215.873176:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.873178:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dcbe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873188:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dcbe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.873201:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053816f9d reply state 0000000010543684 transno 214748367012 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe474c0af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873211:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe474c0af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.873217:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe474c0af (ffff94e602c23b00) 00010000:00010000:1.0:1788572215.873220:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.873223:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.873424:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.873445:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.873448:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367013 00000020:00080000:1.0:1788572215.873452:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.873454:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367013 00000100:00100000:3.0:1788572215.876845:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615121280 00000100:00100000:3.0:1788572215.876857:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615121280 00000100:00100000:3.0:1788572215.876925:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10865 00000100:00100000:3.0:1788572215.876937:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+430:2382:x1875449615121280:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.876958:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367013, current: 214748367013, replaying 00000100:00100000:3.0:1788572215.876978:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+430:2382:x1875449615121280:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (325us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.876984:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10865 00000020:00080000:1.0:1788572215.877065:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.877069:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367013, next_transno: 214748367013 00010000:00080000:1.0:1788572215.877074:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367013) 00000020:00080000:1.0:1788572215.877077:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.877086:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615121280 t214748367013 from 192.168.202.13@tcp req@ffff94e633db2680 x1875449615121280/t0(214748367013) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.877181:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dcd3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877199:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dcd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877215:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dcd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877229:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877236:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877242:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877445:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dce1 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877455:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dce1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877462:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dce1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.877700:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].107, 64 off15040 00010000:00010000:1.0:1788572215.877764:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dce1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877773:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dce1 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877780:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dce1 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877786:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.877792:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dce1 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877800:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dce1 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877813:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3f4:0x0].0x0 (ffff94e615913100) 00010000:00010000:1.0:1788572215.877816:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.877821:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dce1 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877828:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dce1 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877851:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dcd3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877858:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dcd3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877863:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dcd3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877867:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.877870:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dcd3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877876:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dcd3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877883:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.877885:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.877889:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dcd3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877895:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dcd3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.877908:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dffec886 reply state 00000000286613d2 transno 214748367013 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877920:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.877926:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6f3130a8 (ffff94e63ab76e00) 00010000:00010000:1.0:1788572215.877928:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.877930:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.878173:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.878192:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.878195:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367014 00000020:00080000:1.0:1788572215.878200:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.878202:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367014 00000100:00100000:2.0:1788572215.881096:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.881454:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.881459:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367014, next_transno: 214748367014 00010000:00080000:1.0:1788572215.881465:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367014) 00000020:00080000:1.0:1788572215.881467:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.881478:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615121664 t214748367014 from 192.168.202.13@tcp req@ffff94e637798a80 x1875449615121664/t0(214748367014) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.881586:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dce8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.881605:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dce8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.881619:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dce8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.881633:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.881639:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.881646:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.881856:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dcf6 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.881865:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dcf6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.881872:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dcf6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.882154:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].107, 64 off15040 00010000:00010000:1.0:1788572215.882217:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dcf6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882226:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dcf6 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882232:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dcf6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882238:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.882243:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dcf6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882252:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dcf6 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882264:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3f5:0x0].0x0 (ffff94e615913900) 00010000:00010000:1.0:1788572215.882267:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.882272:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dcf6 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882279:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dcf6 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882303:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dce8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882309:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dce8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882315:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dce8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882321:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.882323:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dce8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882329:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dce8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882336:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913700) 00010000:00010000:1.0:1788572215.882339:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.882343:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dce8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882348:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dce8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.882361:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006eecd04b reply state 00000000b55012a2 transno 214748367014 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882373:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.882379:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55eb8a75 (ffff94e615913d00) 00010000:00010000:1.0:1788572215.882382:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.882384:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.882468:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.882488:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.882491:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367015 00000020:00080000:1.0:1788572215.882496:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.882498:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367015 00000100:00100000:3.0:1788572215.885554:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615122048 00000100:00100000:3.0:1788572215.885568:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615122048 00000100:00100000:3.0:1788572215.885634:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10867 00000100:00100000:3.0:1788572215.885644:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+434:2382:x1875449615122048:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.885666:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367015, current: 214748367015, replaying 00000100:00100000:3.0:1788572215.885690:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50384e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+434:2382:x1875449615122048:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 49us (240us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.885698:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10867 00000020:00080000:1.0:1788572215.885824:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.885830:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367015, next_transno: 214748367015 00010000:00080000:1.0:1788572215.885833:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367015) 00000020:00080000:1.0:1788572215.885836:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.885845:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615122048 t214748367015 from 192.168.202.13@tcp req@ffff94e50384e300 x1875449615122048/t0(214748367015) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.885966:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dcfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.885983:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dcfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.885997:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dcfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886029:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886037:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886043:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886236:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd0b lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886245:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd0b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886252:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd0b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.886480:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].108, 64 off15104 00010000:00010000:1.0:1788572215.886535:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd0b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886543:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd0b lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886551:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd0b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886557:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.886562:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd0b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886570:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd0b lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886594:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3f6:0x0].0x0 (ffff94e615913e00) 00010000:00010000:1.0:1788572215.886597:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.886602:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd0b lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886609:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd0b lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886631:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dcfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886636:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dcfd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886642:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dcfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886647:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.886650:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dcfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886656:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dcfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886665:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913000) 00010000:00010000:1.0:1788572215.886667:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.886682:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dcfd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886689:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dcfd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.886701:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000081ebc3e reply state 000000008faadede transno 214748367015 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886711:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.886718:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3bcd2ca (ffff94e615913500) 00010000:00010000:1.0:1788572215.886721:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.886723:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.887645:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.887680:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.887684:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367016 00000020:00080000:1.0:1788572215.887688:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.887691:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367016 00000100:00100000:3.0:1788572215.894268:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615122432 00000100:00100000:3.0:1788572215.894279:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615122432 00000100:00100000:3.0:1788572215.894357:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10868 00000100:00100000:3.0:1788572215.894367:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+436:2382:x1875449615122432:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.894386:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367016, current: 214748367016, replaying 00000100:00100000:3.0:1788572215.894401:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50384df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+436:2382:x1875449615122432:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 36us (228us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.894408:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10868 00000020:00080000:1.0:1788572215.894756:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.894761:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367016, next_transno: 214748367016 00010000:00080000:1.0:1788572215.894765:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367016) 00000020:00080000:1.0:1788572215.894768:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.894777:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615122432 t214748367016 from 192.168.202.13@tcp req@ffff94e50384df80 x1875449615122432/t0(214748367016) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.894856:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.894868:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.894877:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.894885:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.894889:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.894893:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895089:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd20 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895095:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd20 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895100:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd20 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.895277:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].108, 64 off15104 00010000:00010000:1.0:1788572215.895353:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd20 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895360:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd20 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895366:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd20 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895371:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.895376:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd20 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895384:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd20 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895396:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3f7:0x0].0x0 (ffff94e615913b00) 00010000:00010000:1.0:1788572215.895399:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.895405:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd20 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895411:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd20 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895428:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895433:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd12 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895439:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd12 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895444:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.895447:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd12 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895452:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd12 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895460:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913100) 00010000:00010000:1.0:1788572215.895462:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.895466:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd12 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895470:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd12 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.895482:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d966b9c reply state 0000000036d506a7 transno 214748367016 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895492:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.895497:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe8cdd6ef (ffff94e615913200) 00010000:00010000:1.0:1788572215.895499:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.895501:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.895559:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.895572:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.895575:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367017 00000020:00080000:1.0:1788572215.895579:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.895581:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367017 00000100:00100000:2.0:1788572215.897797:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.898215:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.898219:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367017, next_transno: 214748367017 00010000:00080000:1.0:1788572215.898222:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367017) 00000020:00080000:1.0:1788572215.898224:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.898231:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615122816 t214748367017 from 192.168.202.13@tcp req@ffff94e63779b480 x1875449615122816/t0(214748367017) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.898311:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd27 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898323:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898331:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898338:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898343:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898347:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898494:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd35 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898501:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd35 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898506:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd35 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.898713:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].109, 64 off15168 00010000:00010000:1.0:1788572215.898762:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd35 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898768:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd35 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898773:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd35 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898776:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.898779:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd35 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898784:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd35 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898793:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3f8:0x0].0x0 (ffff94e615913700) 00010000:00010000:1.0:1788572215.898795:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.898797:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd35 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898801:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd35 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898814:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd27 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898818:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd27 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898821:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898824:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.898826:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd27 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898829:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd27 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898833:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913000) 00010000:00010000:1.0:1788572215.898834:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.898836:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd27 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898839:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd27 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.898845:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f5855e1 reply state 000000002daaf29f transno 214748367017 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898851:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.898855:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab9b3444 (ffff94e615913e00) 00010000:00010000:1.0:1788572215.898857:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.898858:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.898931:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.898946:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.898948:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367018 00000020:00080000:1.0:1788572215.898952:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.898954:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367018 00000100:00100000:3.0:1788572215.901235:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615123200 00000100:00100000:3.0:1788572215.901244:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615123200 00000100:00100000:3.0:1788572215.901291:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10870 00000100:00100000:3.0:1788572215.901298:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+440:2382:x1875449615123200:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.901315:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367018, current: 214748367018, replaying 00000100:00100000:3.0:1788572215.901326:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+440:2382:x1875449615123200:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 30us (160us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.901331:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10870 00000020:00080000:1.0:1788572215.901368:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.901371:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367018, next_transno: 214748367018 00010000:00080000:1.0:1788572215.901374:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367018) 00000020:00080000:1.0:1788572215.901376:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.901384:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615123200 t214748367018 from 192.168.202.13@tcp req@ffff94e637714a80 x1875449615123200/t0(214748367018) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.901462:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dd3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.901478:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dd3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.901491:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dd3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.901503:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5c897911 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.901507:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c897911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.901511:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c897911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.901661:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831dd4a lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.901678:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831dd4a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.901687:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831dd4a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.901900:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].109, 64 off15168 00010000:00010000:1.0:1788572215.901973:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831dd4a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.901982:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831dd4a lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.901988:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831dd4a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.901994:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.901999:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831dd4a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902055:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831dd4a lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902065:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3f9:0x0].0x0 (ffff94e615913300) 00010000:00010000:1.0:1788572215.902067:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.902070:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831dd4a lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902075:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831dd4a lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902089:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dd3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902092:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dd3c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902096:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dd3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902099:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.902101:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dd3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902104:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dd3c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902108:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913900) 00010000:00010000:1.0:1788572215.902109:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.902111:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dd3c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902115:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831dd3c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.902121:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000c3400d reply state 00000000fb00a783 transno 214748367018 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c897911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902128:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c897911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.902132:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c897911 (ffff94e615913400) 00010000:00010000:1.0:1788572215.902133:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.902135:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.902194:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.902207:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.902209:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367019 00000020:00080000:1.0:1788572215.902212:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.902213:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367019 00000100:00100000:3.0:1788572215.904363:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615123584 00000100:00100000:3.0:1788572215.904371:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615123584 00000100:00100000:3.0:1788572215.904419:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10871 00000100:00100000:3.0:1788572215.904426:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+442:2382:x1875449615123584:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.904444:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367019, current: 214748367019, replaying 00000100:00100000:3.0:1788572215.904461:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+442:2382:x1875449615123584:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 35us (237us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.904468:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10871 00000020:00080000:1.0:1788572215.904546:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.904549:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367019, next_transno: 214748367019 00010000:00080000:1.0:1788572215.904552:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367019) 00000020:00080000:1.0:1788572215.904554:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.904561:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615123584 t214748367019 from 192.168.202.13@tcp req@ffff94e637715500 x1875449615123584/t0(214748367019) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.904645:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd51 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.904661:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd51 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.904683:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd51 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.904696:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.904703:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.904709:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.904853:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831dd5f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.904860:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831dd5f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.904865:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831dd5f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.905114:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].110, 64 off15232 00010000:00010000:1.0:1788572215.905158:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831dd5f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905164:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831dd5f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905168:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831dd5f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905171:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14a200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.905175:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831dd5f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905179:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831dd5f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905187:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3fa:0x0].0x0 (ffff94e615913f00) 00010000:00010000:1.0:1788572215.905189:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.905192:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831dd5f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905195:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831dd5f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905211:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd51 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905214:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd51 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905218:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd51 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905221:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.905222:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd51 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905225:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd51 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905229:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913100) 00010000:00010000:1.0:1788572215.905230:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.905232:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd51 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905236:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831dd51 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.905242:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000853f10dc reply state 00000000174d4933 transno 214748367019 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905249:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.905252:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x96d6d666 (ffff94e615913b00) 00010000:00010000:1.0:1788572215.905254:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.905255:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.905416:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.905429:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.905432:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367020 00000020:00080000:1.0:1788572215.905436:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.905438:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367020 00000100:00100000:2.0:1788572215.907882:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.908345:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.908349:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367020, next_transno: 214748367020 00010000:00080000:1.0:1788572215.908352:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367020) 00000020:00080000:1.0:1788572215.908354:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.908362:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615123968 t214748367020 from 192.168.202.13@tcp req@ffff94e64173e300 x1875449615123968/t0(214748367020) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.908477:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831dd66 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.908492:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831dd66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.908503:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831dd66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.908513:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.908517:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.908522:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.908697:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831dd74 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.908706:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831dd74 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.908717:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831dd74 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.909285:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].110, 64 off15232 00010000:00010000:1.0:1788572215.909358:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831dd74 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909364:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831dd74 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909369:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831dd74 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909372:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637696c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.909376:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831dd74 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909381:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831dd74 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909399:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3fb:0x0].0x0 (ffff94e63aaace00) 00010000:00010000:1.0:1788572215.909401:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.909404:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831dd74 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909408:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831dd74 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909423:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831dd66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909427:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831dd66 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909431:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831dd66 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909436:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.909439:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831dd66 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909444:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831dd66 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909451:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913800) 00010000:00010000:1.0:1788572215.909453:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.909456:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831dd66 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909461:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831dd66 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.909473:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f7935b0 reply state 00000000b09ceb06 transno 214748367020 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909484:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.909490:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2136dfcb (ffff94e63ab76100) 00010000:00010000:1.0:1788572215.909492:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.909494:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.909564:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.909579:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.909582:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367021 00000020:00080000:1.0:1788572215.909586:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.909588:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367021 00000100:00100000:3.0:1788572215.911594:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615124352 00000100:00100000:3.0:1788572215.911604:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615124352 00000100:00100000:3.0:1788572215.911663:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10873 00000100:00100000:3.0:1788572215.911683:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+446:2382:x1875449615124352:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.911702:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367021, current: 214748367021, replaying 00000100:00100000:3.0:1788572215.911758:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+446:2382:x1875449615124352:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 87us (247us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.911765:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10873 00000020:00080000:1.0:1788572215.912059:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.912064:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367021, next_transno: 214748367021 00010000:00080000:1.0:1788572215.912068:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367021) 00000020:00080000:1.0:1788572215.912070:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.912078:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615124352 t214748367021 from 192.168.202.13@tcp req@ffff94e637714000 x1875449615124352/t0(214748367021) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.912163:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912176:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912185:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912193:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912197:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912201:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912345:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831dd89 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912351:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831dd89 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912355:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831dd89 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.912698:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].111, 64 off15296 00010000:00010000:1.0:1788572215.912761:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831dd89 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912769:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831dd89 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912775:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831dd89 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912780:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.912784:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831dd89 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912791:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831dd89 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912803:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3fc:0x0].0x0 (ffff94e602c23200) 00010000:00010000:1.0:1788572215.912806:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.912810:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831dd89 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912816:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831dd89 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912838:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912844:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd7b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912850:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912855:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.912858:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912862:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd7b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912867:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913000) 00010000:00010000:1.0:1788572215.912868:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.912871:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd7b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912874:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831dd7b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.912884:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005885c281 reply state 00000000813dc65e transno 214748367021 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912890:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.912894:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd891c8f0 (ffff94e615913700) 00010000:00010000:1.0:1788572215.912896:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.912897:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.913210:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.913228:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.913231:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367022 00000020:00080000:1.0:1788572215.913235:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.913236:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367022 00000100:00100000:3.0:1788572215.915341:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615124736 00000100:00100000:3.0:1788572215.915349:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615124736 00000100:00100000:3.0:1788572215.915482:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10874 00000100:00100000:3.0:1788572215.915493:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+448:2382:x1875449615124736:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.915508:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367022, current: 214748367022, replaying 00000100:00100000:3.0:1788572215.915522:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+448:2382:x1875449615124736:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 33us (305us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.915527:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10874 00000020:00080000:1.0:1788572215.915557:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.915560:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367022, next_transno: 214748367022 00010000:00080000:1.0:1788572215.915563:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367022) 00000020:00080000:1.0:1788572215.915565:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.915572:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615124736 t214748367022 from 192.168.202.13@tcp req@ffff94e637715880 x1875449615124736/t0(214748367022) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.915645:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831dd90 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.915657:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831dd90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.915666:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831dd90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.915686:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.915693:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.915704:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.915852:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dd9e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.915858:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dd9e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.915862:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dd9e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.916087:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].111, 64 off15296 00010000:00010000:1.0:1788572215.916130:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dd9e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916136:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dd9e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916140:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dd9e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916144:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.916147:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dd9e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916152:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dd9e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916161:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3fd:0x0].0x0 (ffff94e602c23c00) 00010000:00010000:1.0:1788572215.916162:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.916165:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dd9e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916169:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dd9e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916186:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831dd90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916189:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831dd90 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916193:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831dd90 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916195:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.916197:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831dd90 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916200:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831dd90 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916204:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23300) 00010000:00010000:1.0:1788572215.916205:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.916207:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831dd90 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916210:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831dd90 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.916217:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008b01e17 reply state 00000000b825992f transno 214748367022 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916223:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.916227:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c1f12fd (ffff94e602c23d00) 00010000:00010000:1.0:1788572215.916229:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.916231:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.916282:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.916303:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.916305:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367023 00000020:00080000:1.0:1788572215.916308:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.916310:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367023 00000100:00100000:2.0:1788572215.918501:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.919516:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.919521:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367023, next_transno: 214748367023 00010000:00080000:1.0:1788572215.919526:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367023) 00000020:00080000:1.0:1788572215.919528:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.919538:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615125120 t214748367023 from 192.168.202.13@tcp req@ffff94e64173fb80 x1875449615125120/t0(214748367023) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.919627:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831dda5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.919643:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831dda5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.919657:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831dda5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.919682:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34a5458 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.919690:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34a5458 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.919696:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34a5458 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.919880:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ddb3 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.919889:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ddb3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.919897:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ddb3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.920188:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].112, 64 off15360 00010000:00010000:1.0:1788572215.920246:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ddb3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920254:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ddb3 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920261:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ddb3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920267:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.920272:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ddb3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920280:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ddb3 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920304:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3fe:0x0].0x0 (ffff94e615913800) 00010000:00010000:1.0:1788572215.920307:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.920312:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ddb3 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920318:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ddb3 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920342:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831dda5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920348:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831dda5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920353:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831dda5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920357:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.920360:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831dda5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920366:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831dda5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920373:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23800) 00010000:00010000:1.0:1788572215.920375:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.920379:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831dda5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920384:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831dda5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.920396:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6159521 reply state 00000000b046bce4 transno 214748367023 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34a5458 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920407:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34a5458 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.920413:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34a5458 (ffff94e63aaace00) 00010000:00010000:1.0:1788572215.920415:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.920417:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.920497:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.920515:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.920518:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367024 00000020:00080000:1.0:1788572215.920521:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.920523:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367024 00000100:00100000:3.0:1788572215.923836:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615125504 00000100:00100000:3.0:1788572215.923847:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615125504 00000100:00100000:3.0:1788572215.923905:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10876 00000100:00100000:3.0:1788572215.923916:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+452:2382:x1875449615125504:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.923949:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367024, current: 214748367024, replaying 00000100:00100000:3.0:1788572215.923971:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+452:2382:x1875449615125504:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 57us (232us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.923979:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10876 00000020:00080000:1.0:1788572215.924066:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.924070:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367024, next_transno: 214748367024 00010000:00080000:1.0:1788572215.924075:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367024) 00000020:00080000:1.0:1788572215.924078:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.924089:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615125504 t214748367024 from 192.168.202.13@tcp req@ffff94e637717100 x1875449615125504/t0(214748367024) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.924180:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddba lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924198:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924211:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924224:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8389925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924231:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8389925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924238:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8389925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924439:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831ddc8 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x3ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924447:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831ddc8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924455:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831ddc8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.924698:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].112, 64 off15360 00010000:00010000:1.0:1788572215.924758:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831ddc8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924766:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831ddc8 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924771:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831ddc8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924776:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.924782:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831ddc8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924789:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831ddc8 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924800:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x3ff:0x0].0x0 (ffff94e615913900) 00010000:00010000:1.0:1788572215.924803:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.924807:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831ddc8 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924813:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831ddc8 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x3ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924841:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924846:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddba lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924851:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924856:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.924858:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924864:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddba lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924871:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913100) 00010000:00010000:1.0:1788572215.924874:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.924877:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddba lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924882:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddba lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.924893:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff5e34fd reply state 000000001de68b86 transno 214748367024 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8389925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924904:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8389925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.924910:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8389925 (ffff94e615913f00) 00010000:00010000:1.0:1788572215.924912:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.924915:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.924984:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.925043:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.925046:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367025 00000020:00080000:1.0:1788572215.925050:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.925052:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367025 00000100:00100000:2.0:1788572215.928846:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.929202:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.929206:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367025, next_transno: 214748367025 00010000:00080000:1.0:1788572215.929210:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367025) 00000020:00080000:1.0:1788572215.929214:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.929224:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615125888 t214748367025 from 192.168.202.13@tcp req@ffff94e64173d880 x1875449615125888/t0(214748367025) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.929338:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ddcf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929355:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ddcf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929368:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ddcf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929382:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xce09e17a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929389:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce09e17a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929409:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce09e17a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929595:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831dddd lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x400:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929604:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831dddd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929611:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831dddd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.929849:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].113, 64 off15424 00010000:00010000:1.0:1788572215.929913:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831dddd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929922:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831dddd lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929929:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831dddd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929935:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.929942:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831dddd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929950:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831dddd lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929963:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x400:0x0].0x0 (ffff94e602c23200) 00010000:00010000:1.0:1788572215.929967:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.929972:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831dddd lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.929979:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831dddd lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x400:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.930038:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ddcf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.930044:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ddcf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.930050:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ddcf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.930055:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.930057:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ddcf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.930064:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ddcf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.930071:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913000) 00010000:00010000:1.0:1788572215.930074:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.930077:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ddcf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.930082:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ddcf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.930096:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000461359dd reply state 000000009f1849f6 transno 214748367025 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce09e17a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.930106:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce09e17a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.930113:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce09e17a (ffff94e615913300) 00010000:00010000:1.0:1788572215.930115:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.930117:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.930190:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.930265:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.930268:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367026 00000020:00080000:1.0:1788572215.930273:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.930274:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367026 00000100:00100000:2.0:1788572215.933476:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.933620:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615126272 00000100:00100000:3.0:1788572215.933630:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615126272 00000100:00100000:3.0:1788572215.933712:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10878 00000100:00100000:3.0:1788572215.933724:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+456:2382:x1875449615126272:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.933749:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367026, current: 214748367026, replaying 00000100:00100000:3.0:1788572215.933771:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+456:2382:x1875449615126272:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 50us (309us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.933778:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10878 00000020:00080000:1.0:1788572215.933838:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.933843:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367026, next_transno: 214748367026 00010000:00080000:1.0:1788572215.933847:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367026) 00000020:00080000:1.0:1788572215.933850:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.933860:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615126272 t214748367026 from 192.168.202.13@tcp req@ffff94e64173f480 x1875449615126272/t0(214748367026) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.933961:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dde4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.933978:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dde4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.933990:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dde4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934042:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934050:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934057:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934223:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831ddf2 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x401:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934232:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831ddf2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934239:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831ddf2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.934481:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].113, 64 off15424 00010000:00010000:1.0:1788572215.934536:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831ddf2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934544:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831ddf2 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934551:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831ddf2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934557:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.934563:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831ddf2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934570:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831ddf2 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934582:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x401:0x0].0x0 (ffff94e6411e7e00) 00010000:00010000:1.0:1788572215.934585:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.934590:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831ddf2 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934597:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831ddf2 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x401:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934625:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dde4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934631:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dde4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934637:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dde4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934642:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.934644:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dde4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934650:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dde4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934657:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7a00) 00010000:00010000:1.0:1788572215.934659:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.934661:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dde4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934666:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dde4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.934690:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab127ef2 reply state 0000000018be7a18 transno 214748367026 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934700:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.934706:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43b9eadf (ffff94e6411e7700) 00010000:00010000:1.0:1788572215.934708:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.934711:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.934787:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.934803:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.934805:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367027 00000020:00080000:1.0:1788572215.934809:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.934811:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367027 00000100:00100000:3.0:1788572215.939148:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615126656 00000100:00100000:3.0:1788572215.939159:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615126656 00000100:00100000:3.0:1788572215.939224:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10879 00000100:00100000:3.0:1788572215.939234:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+458:2382:x1875449615126656:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.939257:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367027, current: 214748367027, replaying 00000100:00100000:3.0:1788572215.939275:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+458:2382:x1875449615126656:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (357us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.939283:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10879 00000020:00080000:1.0:1788572215.939343:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.939348:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367027, next_transno: 214748367027 00010000:00080000:1.0:1788572215.939353:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367027) 00000020:00080000:1.0:1788572215.939357:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.939367:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615126656 t214748367027 from 192.168.202.13@tcp req@ffff94e637717800 x1875449615126656/t0(214748367027) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.939479:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddf9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.939496:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddf9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.939507:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddf9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.939521:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6874834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.939527:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6874834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.939534:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6874834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.939717:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831de07 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x402:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.939725:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831de07 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.939732:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831de07 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.939986:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].114, 64 off15488 00010000:00010000:1.0:1788572215.940096:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831de07 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940105:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831de07 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940113:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831de07 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940119:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.940125:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831de07 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940132:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831de07 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940145:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x402:0x0].0x0 (ffff94e6411e7f00) 00010000:00010000:1.0:1788572215.940148:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.940153:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831de07 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940159:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831de07 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x402:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940184:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddf9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940189:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddf9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940195:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddf9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940199:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.940202:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddf9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940208:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddf9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940215:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7c00) 00010000:00010000:1.0:1788572215.940217:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.940221:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddf9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940227:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831ddf9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.940239:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053c189d8 reply state 00000000e09c1684 transno 214748367027 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6874834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940249:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6874834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.940255:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6874834 (ffff94e6411e7500) 00010000:00010000:1.0:1788572215.940257:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.940260:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.940330:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.940347:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.940350:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367028 00000020:00080000:1.0:1788572215.940354:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.940356:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367028 00000100:00100000:2.0:1788572215.943362:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.943791:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.943795:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367028, next_transno: 214748367028 00010000:00080000:1.0:1788572215.943800:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367028) 00000020:00080000:1.0:1788572215.943803:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.943813:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615127040 t214748367028 from 192.168.202.13@tcp req@ffff94e64173e680 x1875449615127040/t0(214748367028) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.943946:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831de0e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.943965:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831de0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.943978:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831de0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.943992:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.943999:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.944032:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.944217:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831de1c lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x403:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.944226:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831de1c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.944234:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831de1c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.944979:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].114, 64 off15488 00010000:00010000:1.0:1788572215.945081:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831de1c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945089:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831de1c lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945096:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831de1c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945103:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.945108:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831de1c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945116:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831de1c lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945130:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x403:0x0].0x0 (ffff94e6411e7d00) 00010000:00010000:1.0:1788572215.945133:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.945138:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831de1c lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945145:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831de1c lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x403:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945173:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831de0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945180:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831de0e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945185:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831de0e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945190:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.945193:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831de0e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945199:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831de0e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945207:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7800) 00010000:00010000:1.0:1788572215.945209:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.945212:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831de0e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945218:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831de0e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.945230:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4443513 reply state 00000000501bb086 transno 214748367028 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945242:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.945249:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e458d01 (ffff94e6411e7400) 00010000:00010000:1.0:1788572215.945252:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.945254:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.946065:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.946090:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.946094:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367029 00000020:00080000:1.0:1788572215.946098:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.946100:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367029 00000100:00100000:3.0:1788572215.948874:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.949590:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.949595:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367029, next_transno: 214748367029 00010000:00080000:1.0:1788572215.949600:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367029) 00000020:00080000:1.0:1788572215.949604:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.949615:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615127424 t214748367029 from 192.168.202.13@tcp req@ffff94e618490e00 x1875449615127424/t0(214748367029) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.949719:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de23 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.949737:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de23 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.949750:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de23 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.949762:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.949771:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.949778:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.949977:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831de31 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x404:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.949985:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831de31 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.949992:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831de31 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.950271:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].115, 64 off15552 00010000:00010000:1.0:1788572215.950333:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831de31 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950342:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831de31 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950348:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831de31 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950355:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.950360:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831de31 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950368:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831de31 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950380:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x404:0x0].0x0 (ffff94e6411e7b00) 00010000:00010000:1.0:1788572215.950383:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.950388:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831de31 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950395:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831de31 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x404:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950419:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de23 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950426:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de23 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950431:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de23 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950436:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.950439:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de23 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950445:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de23 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950452:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7a00) 00010000:00010000:1.0:1788572215.950454:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.950458:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de23 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950464:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de23 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.950479:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035a4fa72 reply state 000000008ed21ddc transno 214748367029 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950489:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.950495:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc71d6a56 (ffff94e6411e7e00) 00010000:00010000:1.0:1788572215.950497:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.950500:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.950572:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.950589:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.950592:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367030 00000020:00080000:1.0:1788572215.950596:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.950599:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367030 00000100:00100000:3.0:1788572215.954277:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615127808 00000100:00100000:3.0:1788572215.954287:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615127808 00000100:00100000:3.0:1788572215.954362:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10882 00000100:00100000:3.0:1788572215.954372:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+464:2382:x1875449615127808:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.954404:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367030, current: 214748367030, replaying 00000100:00100000:3.0:1788572215.954420:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+464:2382:x1875449615127808:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 51us (249us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.954427:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10882 00000020:00080000:1.0:1788572215.954629:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.954634:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367030, next_transno: 214748367030 00010000:00080000:1.0:1788572215.954638:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367030) 00000020:00080000:1.0:1788572215.954641:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.954652:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615127808 t214748367030 from 192.168.202.13@tcp req@ffff94e62dac6d80 x1875449615127808/t0(214748367030) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.954773:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831de38 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.954793:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831de38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.954806:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831de38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.954821:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.954828:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.954836:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.955150:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831de46 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x405:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.955159:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831de46 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.955167:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831de46 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.956067:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].115, 64 off15552 00010000:00010000:1.0:1788572215.956141:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831de46 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956151:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831de46 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956159:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831de46 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956164:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.956171:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831de46 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956180:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831de46 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956194:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x405:0x0].0x0 (ffff94e6411e7200) 00010000:00010000:1.0:1788572215.956197:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.956202:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831de46 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956208:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831de46 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x405:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956238:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831de38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956245:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831de38 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956251:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831de38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956256:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.956259:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831de38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956264:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831de38 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956271:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7300) 00010000:00010000:1.0:1788572215.956274:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.956277:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831de38 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956282:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831de38 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.956569:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b33274b7 reply state 00000000fc0021c4 transno 214748367030 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956584:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.956592:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd383ee7b (ffff94e6411e7600) 00010000:00010000:1.0:1788572215.956594:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.956597:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.956754:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.956775:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.956779:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367031 00000020:00080000:1.0:1788572215.956783:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.956785:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367031 00000100:00100000:2.0:1788572215.959866:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615128192 00000100:00100000:2.0:1788572215.959877:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615128192 00000100:00100000:2.0:1788572215.959945:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10883 00000100:00100000:2.0:1788572215.959956:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+466:2382:x1875449615128192:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572215.959980:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367031, current: 214748367031, replaying 00000100:00100000:2.0:1788572215.959999:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+466:2382:x1875449615128192:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (455us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572215.960040:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10883 00000020:00080000:1.0:1788572215.960198:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.960203:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367031, next_transno: 214748367031 00010000:00080000:1.0:1788572215.960207:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367031) 00000020:00080000:1.0:1788572215.960210:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.960219:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615128192 t214748367031 from 192.168.202.13@tcp req@ffff94e62dac6300 x1875449615128192/t0(214748367031) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.960333:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831de4d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.960350:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831de4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.960363:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831de4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.960377:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.960383:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.960400:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.960982:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831de5b lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x406:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.960995:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831de5b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961054:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831de5b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.961279:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].116, 64 off15616 00010000:00010000:1.0:1788572215.961643:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831de5b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961651:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831de5b lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961659:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831de5b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961664:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.961680:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831de5b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961689:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831de5b lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961701:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x406:0x0].0x0 (ffff94e6411e7100) 00010000:00010000:1.0:1788572215.961703:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.961708:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831de5b lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961715:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831de5b lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x406:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961740:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831de4d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961746:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831de4d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961752:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831de4d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961756:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637696c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.961759:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831de4d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961765:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831de4d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961772:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7900) 00010000:00010000:1.0:1788572215.961775:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.961778:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831de4d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961783:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831de4d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.961797:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edeacf46 reply state 00000000b0d37b1a transno 214748367031 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961807:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.961814:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8b735ce0 (ffff94e6411e7000) 00010000:00010000:1.0:1788572215.961817:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.961819:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.961956:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.961977:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.961980:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367032 00000020:00080000:1.0:1788572215.961984:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.961986:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367032 00000100:00100000:2.0:1788572215.965566:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.965884:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.965890:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367032, next_transno: 214748367032 00010000:00080000:1.0:1788572215.965895:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367032) 00000020:00080000:1.0:1788572215.965898:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.965908:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615128576 t214748367032 from 192.168.202.13@tcp req@ffff94e64173f100 x1875449615128576/t0(214748367032) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.966042:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831de62 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966060:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831de62 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966074:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831de62 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966089:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966095:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966101:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966316:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de70 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x407:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966326:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de70 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966333:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de70 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.966695:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].116, 64 off15616 00010000:00010000:1.0:1788572215.966753:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de70 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966761:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de70 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966768:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de70 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966774:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.966779:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de70 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966787:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de70 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966800:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x407:0x0].0x0 (ffff94e6411e7800) 00010000:00010000:1.0:1788572215.966803:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.966807:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de70 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966814:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831de70 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x407:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966836:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831de62 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966843:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831de62 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966848:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831de62 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966853:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.966856:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831de62 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966862:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831de62 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966870:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7a00) 00010000:00010000:1.0:1788572215.966872:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.966876:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831de62 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966881:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831de62 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.966893:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000042fc2b reply state 0000000065a1ed66 transno 214748367032 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966904:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.966910:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe861a1ad (ffff94e6411e7b00) 00010000:00010000:1.0:1788572215.966913:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.966915:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.966988:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.967028:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.967031:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367033 00000020:00080000:1.0:1788572215.967035:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.967037:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367033 00000100:00100000:1.0:1788572215.970209:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:2.0:1788572215.970812:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.970818:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367033, next_transno: 214748367033 00010000:00080000:2.0:1788572215.970821:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367033) 00000020:00080000:2.0:1788572215.970825:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.970836:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615128960 t214748367033 from 192.168.202.13@tcp req@ffff94e62d28f800 x1875449615128960/t0(214748367033) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572215.971119:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831de77 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971136:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831de77 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971149:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831de77 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971162:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe5341837 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971170:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5341837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971176:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5341837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971547:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831de85 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x408:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971556:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831de85 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971564:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831de85 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572215.971794:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].117, 64 off15680 00010000:00010000:2.0:1788572215.971853:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831de85 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971862:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831de85 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971869:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831de85 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971874:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.971879:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831de85 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971887:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831de85 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971898:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x408:0x0].0x0 (ffff94e6158d6b00) 00010000:00010000:2.0:1788572215.971901:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572215.971906:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831de85 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.971912:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831de85 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x408:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.972128:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831de77 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.972136:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831de77 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.972142:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831de77 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.972147:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572215.972150:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831de77 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.972157:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831de77 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.972165:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6158d6d00) 00010000:00010000:2.0:1788572215.972168:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572215.972171:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831de77 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.972177:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831de77 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572215.972191:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8ae7102 reply state 0000000004f7bc2e transno 214748367033 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5341837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.972202:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5341837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572215.972208:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe5341837 (ffff94e6158d6800) 00010000:00010000:2.0:1788572215.972211:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572215.972213:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572215.972528:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572215.972549:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.972553:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367034 00000020:00080000:2.0:1788572215.972557:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572215.972559:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367034 00000100:00100000:3.0:1788572215.979803:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.979845:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615129344 00000100:00100000:3.0:1788572215.979856:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615129344 00000100:00100000:3.0:1788572215.979913:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10886 00000100:00100000:3.0:1788572215.980051:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+472:2382:x1875449615129344:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.980072:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367034, current: 214748367034, replaying 00000100:00100000:3.0:1788572215.980094:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+472:2382:x1875449615129344:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (304us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.980101:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10886 00000100:00100000:3.0:1788572215.983868:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572215.989493:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572215.989581:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615130112 00000100:00100000:1.0:1788572215.989593:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615130112 00000100:00100000:1.0:1788572215.989661:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10888 00000100:00100000:1.0:1788572215.989680:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+476:2382:x1875449615130112:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572215.989701:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367036, current: 214748367036, replaying 00000100:00100000:1.0:1788572215.989720:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+476:2382:x1875449615130112:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 51us (242us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572215.989727:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10888 00000100:00100000:3.0:1788572215.993287:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615130496 00000100:00100000:3.0:1788572215.993297:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615130496 00000100:00100000:3.0:1788572215.993388:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10889 00000100:00100000:3.0:1788572215.993407:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+478:2382:x1875449615130496:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572215.993427:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367037, current: 214748367037, replaying 00000100:00100000:3.0:1788572215.993447:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+478:2382:x1875449615130496:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (276us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572215.993453:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10889 00000020:00080000:1.0:1788572215.993492:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.993497:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367037, next_transno: 214748367037 00010000:00080000:1.0:1788572215.993501:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367037) 00000020:00080000:1.0:1788572215.993504:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.993513:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615130496 t214748367037 from 192.168.202.13@tcp req@ffff94e62dac6680 x1875449615130496/t0(214748367037) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.993598:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831decb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.993613:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831decb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.993624:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831decb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.993637:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.993644:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.993650:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.993825:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ded9 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x40c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.993835:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ded9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.993842:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ded9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.994110:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].119, 64 off15808 00010000:00010000:1.0:1788572215.994165:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ded9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994174:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ded9 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994181:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ded9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994187:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.994192:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ded9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994198:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ded9 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994211:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x40c:0x0].0x0 (ffff94e6411e7300) 00010000:00010000:1.0:1788572215.994214:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.994219:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ded9 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994226:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ded9 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x40c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994247:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831decb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994254:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831decb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994265:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831decb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994270:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.994273:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831decb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994279:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831decb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994286:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7900) 00010000:00010000:1.0:1788572215.994289:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.994291:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831decb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994297:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831decb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.994309:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048012aa1 reply state 00000000fa9378fb transno 214748367037 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994319:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.994326:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x80a8c13 (ffff94e6411e7100) 00010000:00010000:1.0:1788572215.994328:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.994331:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.994406:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.994422:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.994425:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367038 00000020:00080000:1.0:1788572215.994429:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.994431:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367038 00000100:00100000:3.0:1788572215.996908:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572215.997309:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.997313:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367038, next_transno: 214748367038 00010000:00080000:1.0:1788572215.997317:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367038) 00000020:00080000:1.0:1788572215.997320:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.997329:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615130880 t214748367038 from 192.168.202.13@tcp req@ffff94e62d2d1050 x1875449615130880/t0(214748367038) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:631/0 lens 504/0 e 0 to 0 dl 1788572226 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572215.997525:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dee0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.997541:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dee0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.997553:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dee0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.997566:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.997571:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.997578:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.997793:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831deee lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x40d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.997802:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831deee lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.997810:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831deee lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572215.998196:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].119, 64 off15808 00010000:00010000:1.0:1788572215.998254:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831deee lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998263:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831deee lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998270:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831deee lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998275:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.998280:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831deee lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998456:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831deee lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998472:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x40d:0x0].0x0 (ffff94e6411e7200) 00010000:00010000:1.0:1788572215.998475:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572215.998480:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831deee lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998488:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831deee lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x40d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998511:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dee0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998521:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dee0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998527:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dee0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998532:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572215.998536:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dee0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998542:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dee0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998549:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7a00) 00010000:00010000:1.0:1788572215.998551:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572215.998554:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dee0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998559:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831dee0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572215.998570:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ab4a900 reply state 00000000fcd49bd2 transno 214748367038 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998581:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572215.998588:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99c8d0e0 (ffff94e6411e7800) 00010000:00010000:1.0:1788572215.998590:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572215.998593:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572215.998795:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572215.999866:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.999874:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367039 00000020:00080000:1.0:1788572215.999880:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572215.999882:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367039 00000100:00100000:2.0:1788572216.002371:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.002618:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615131264 00000100:00100000:1.0:1788572216.002628:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615131264 00000100:00100000:1.0:1788572216.002692:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10891 00000100:00100000:1.0:1788572216.002701:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+482:2382:x1875449615131264:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.002719:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367039, current: 214748367039, replaying 00000100:00100000:1.0:1788572216.002737:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+482:2382:x1875449615131264:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 38us (377us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.002744:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10891 00010000:00010000:1.0:1788572216.004689:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572216.006770:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572216.007187:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.007192:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367040, next_transno: 214748367040 00010000:00080000:1.0:1788572216.007198:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367040) 00000020:00080000:1.0:1788572216.007201:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.007212:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615131648 t214748367040 from 192.168.202.13@tcp req@ffff94e62d28e300 x1875449615131648/t0(214748367040) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.007341:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df0a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.007360:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.007373:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.007387:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe152379a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.007407:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe152379a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.007414:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe152379a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.007635:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df18 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x40f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.007644:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df18 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.007651:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df18 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.007891:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].120, 64 off15872 00010000:00010000:1.0:1788572216.007964:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df18 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.007972:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df18 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.007980:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df18 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.007986:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.007991:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df18 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008050:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df18 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008066:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x40f:0x0].0x0 (ffff94e6411e7d00) 00010000:00010000:1.0:1788572216.008069:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.008073:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df18 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008079:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df18 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x40f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008106:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df0a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008112:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df0a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008119:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df0a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008125:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.008128:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df0a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008135:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df0a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008143:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7900) 00010000:00010000:1.0:1788572216.008146:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.008149:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df0a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008159:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df0a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.008171:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079531a3f reply state 000000004eaec375 transno 214748367040 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe152379a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008181:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe152379a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.008188:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe152379a (ffff94e6411e7300) 00010000:00010000:1.0:1788572216.008190:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.008193:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.008276:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.008295:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.008298:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367041 00000020:00080000:1.0:1788572216.008303:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.008305:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367041 00000100:00100000:2.0:1788572216.011280:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572216.011696:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.011703:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367041, next_transno: 214748367041 00010000:00080000:1.0:1788572216.011708:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367041) 00000020:00080000:1.0:1788572216.011711:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.011723:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615132032 t214748367041 from 192.168.202.13@tcp req@ffff94e64173c000 x1875449615132032/t0(214748367041) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.011829:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.011846:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.011863:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.011876:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.011882:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.011888:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012125:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df2d lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x410:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012134:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df2d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012140:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df2d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.012564:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].121, 64 off15936 00010000:00010000:1.0:1788572216.012623:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df2d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012632:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df2d lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012640:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df2d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012646:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.012651:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df2d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012659:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df2d lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012683:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x410:0x0].0x0 (ffff94e615913000) 00010000:00010000:1.0:1788572216.012686:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.012691:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df2d lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012698:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df2d lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x410:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012720:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012727:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df1f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012733:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012739:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637696c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.012742:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012747:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df1f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012756:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7c00) 00010000:00010000:1.0:1788572216.012758:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.012761:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df1f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012767:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df1f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.012782:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062ef17b8 reply state 000000001c5c55eb transno 214748367041 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012794:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.012801:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ad20bf (ffff94e6411e7f00) 00010000:00010000:1.0:1788572216.012803:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.012806:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.012894:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.012917:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.012920:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367042 00000020:00080000:1.0:1788572216.012924:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.012926:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367042 00000100:00100000:1.0:1788572216.015870:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615132416 00000100:00100000:1.0:1788572216.015882:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615132416 00000100:00100000:1.0:1788572216.015952:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10894 00000100:00100000:1.0:1788572216.015963:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+488:2382:x1875449615132416:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.015984:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367042, current: 214748367042, replaying 00000100:00100000:1.0:1788572216.016037:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+488:2382:x1875449615132416:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (225us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.016044:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10894 00000100:00100000:3.0:1788572216.020652:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615132800 00000100:00100000:3.0:1788572216.020664:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615132800 00000100:00100000:3.0:1788572216.020743:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10895 00000100:00100000:3.0:1788572216.020754:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+490:2382:x1875449615132800:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.020778:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367043, current: 214748367043, replaying 00000100:00100000:3.0:1788572216.020798:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+490:2382:x1875449615132800:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (249us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.020805:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10895 00000100:00100000:2.0:1788572216.024968:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572216.025302:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.025308:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367044, next_transno: 214748367044 00010000:00080000:1.0:1788572216.025313:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367044) 00000020:00080000:1.0:1788572216.025316:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.025326:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615133184 t214748367044 from 192.168.202.13@tcp req@ffff94e64173f800 x1875449615133184/t0(214748367044) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.025433:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.025449:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.025460:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.025473:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.025480:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.025487:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.025653:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df6c lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x413:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.025662:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df6c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.025681:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df6c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.025907:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].122, 64 off16000 00010000:00010000:1.0:1788572216.025968:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df6c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.025977:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df6c lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.025983:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df6c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.025988:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.025992:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df6c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026000:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df6c lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026047:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x413:0x0].0x0 (ffff94e615913900) 00010000:00010000:1.0:1788572216.026050:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.026055:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df6c lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026061:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df6c lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x413:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026082:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026087:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df5e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026097:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026102:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.026105:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026111:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df5e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026119:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913000) 00010000:00010000:1.0:1788572216.026121:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.026123:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df5e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026129:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df5e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.026140:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4c66260 reply state 00000000a6d44904 transno 214748367044 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026149:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.026154:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa3f26d09 (ffff94e615913100) 00010000:00010000:1.0:1788572216.026156:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.026159:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.026232:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.026251:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.026254:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367045 00000020:00080000:1.0:1788572216.026258:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.026260:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367045 00000100:00100000:1.0:1788572216.029378:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572216.029730:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.029735:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367045, next_transno: 214748367045 00010000:00080000:1.0:1788572216.029740:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367045) 00000020:00080000:1.0:1788572216.029743:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.029755:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615133568 t214748367045 from 192.168.202.13@tcp req@ffff94e62d28f100 x1875449615133568/t0(214748367045) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.029863:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831df73 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.029880:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831df73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.029892:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831df73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.029907:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6146555e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.029925:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6146555e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.029932:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6146555e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.030183:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df81 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x414:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.030196:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df81 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.030202:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df81 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.031318:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].123, 64 off16064 00010000:00010000:1.0:1788572216.031536:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df81 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031546:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df81 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031553:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df81 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031559:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.031564:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df81 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031572:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df81 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031588:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x414:0x0].0x0 (ffff94e6411e7900) 00010000:00010000:1.0:1788572216.031591:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.031596:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df81 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031603:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831df81 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x414:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031635:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831df73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031642:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831df73 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031648:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831df73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031653:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.031656:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831df73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031661:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831df73 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031679:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913800) 00010000:00010000:1.0:1788572216.031682:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.031684:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831df73 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031690:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831df73 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.031707:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e181d1e reply state 000000004d5745fe transno 214748367045 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6146555e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031720:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6146555e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.031727:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6146555e (ffff94e6411e7c00) 00010000:00010000:1.0:1788572216.031730:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.031733:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.031870:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.031894:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.031897:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367046 00000020:00080000:1.0:1788572216.031900:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.031903:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367046 00000100:00100000:3.0:1788572216.035618:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615133952 00000100:00100000:3.0:1788572216.035628:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615133952 00000100:00100000:3.0:1788572216.035733:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10898 00000100:00100000:3.0:1788572216.035744:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+496:2382:x1875449615133952:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.035763:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367046, current: 214748367046, replaying 00000100:00100000:3.0:1788572216.035782:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+496:2382:x1875449615133952:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 41us (269us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.035789:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10898 00000020:00080000:1.0:1788572216.035826:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.035831:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367046, next_transno: 214748367046 00010000:00080000:1.0:1788572216.035835:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367046) 00000020:00080000:1.0:1788572216.035838:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.035846:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615133952 t214748367046 from 192.168.202.13@tcp req@ffff94e62dac5180 x1875449615133952/t0(214748367046) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.035939:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.035956:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.035968:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.035979:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.035985:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.035991:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036185:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831df96 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x415:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036194:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831df96 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036201:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831df96 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.036450:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].123, 64 off16064 00010000:00010000:1.0:1788572216.036504:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831df96 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036513:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831df96 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036519:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831df96 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036526:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.036530:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831df96 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036538:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831df96 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036549:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x415:0x0].0x0 (ffff94e6411e7200) 00010000:00010000:1.0:1788572216.036552:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.036557:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831df96 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036568:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831df96 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x415:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036588:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036594:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df88 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036600:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036605:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.036608:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036613:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df88 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036620:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7d00) 00010000:00010000:1.0:1788572216.036623:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.036625:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df88 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036631:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831df88 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.036642:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054bf2e9a reply state 00000000874ff4cc transno 214748367046 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036652:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.036659:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x971fbec3 (ffff94e6411e7a00) 00010000:00010000:1.0:1788572216.036661:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.036664:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.036748:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.036763:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.036765:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367047 00000020:00080000:1.0:1788572216.036769:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.036771:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367047 00000100:00100000:2.0:1788572216.041679:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000020:00080000:1.0:1788572216.041990:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.041995:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367047, next_transno: 214748367047 00010000:00080000:1.0:1788572216.041999:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367047) 00000020:00080000:1.0:1788572216.042002:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.042031:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615134336 t214748367047 from 192.168.202.13@tcp req@ffff94e64173c700 x1875449615134336/t0(214748367047) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.042136:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831df9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042154:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831df9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042166:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831df9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042180:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042187:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042198:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042382:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831dfab lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x416:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042402:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831dfab lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042410:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831dfab lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.042646:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].124, 64 off16128 00010000:00010000:1.0:1788572216.042720:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831dfab lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042728:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831dfab lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042735:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831dfab lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042740:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.042745:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831dfab lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042753:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831dfab lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042767:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x416:0x0].0x0 (ffff94e602c23200) 00010000:00010000:1.0:1788572216.042770:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.042775:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831dfab lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042782:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831dfab lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x416:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042802:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831df9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042808:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831df9d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042814:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831df9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042819:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.042822:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831df9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042828:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831df9d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042835:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913000) 00010000:00010000:1.0:1788572216.042837:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.042840:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831df9d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042845:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831df9d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.042856:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008ca31fd reply state 000000007f4e3f85 transno 214748367047 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042872:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.042878:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe0f11c18 (ffff94e615913900) 00010000:00010000:1.0:1788572216.042880:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.042883:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.042967:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.042984:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.042987:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367048 00000020:00080000:1.0:1788572216.042991:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.042992:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367048 00000100:00100000:1.0:1788572216.047116:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615134720 00000100:00100000:1.0:1788572216.047128:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615134720 00000100:00100000:1.0:1788572216.047190:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10900 00000100:00100000:1.0:1788572216.047200:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+500:2382:x1875449615134720:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.047222:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367048, current: 214748367048, replaying 00000100:00100000:1.0:1788572216.047233:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+500:2382:x1875449615134720:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 35us (260us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.047240:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10900 00000100:00100000:2.0:1788572216.052539:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615135104 00000100:00100000:2.0:1788572216.052550:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615135104 00000100:00100000:2.0:1788572216.052612:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10901 00000100:00100000:2.0:1788572216.052623:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+502:2382:x1875449615135104:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.052643:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367049, current: 214748367049, replaying 00000100:00100000:2.0:1788572216.052663:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+502:2382:x1875449615135104:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (229us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.052679:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10901 00010000:00010000:0.0:1788572216.052856:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729e00/0xdb7edb52b831dfce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc84f5e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.052862:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729e00/0xdb7edb52b831dfce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc84f5e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053197:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831dfd5 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x418:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053207:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831dfd5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053215:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831dfd5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.053486:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].125, 64 off16192 00010000:00010000:0.0:1788572216.053547:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831dfd5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053554:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831dfd5 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053561:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831dfd5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053567:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.053571:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831dfd5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053579:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831dfd5 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053607:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x418:0x0].0x0 (ffff94e619d6fd00) 00010000:00010000:0.0:1788572216.053610:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.053615:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831dfd5 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053621:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831dfd5 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x418:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053645:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831dfc7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053651:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831dfc7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053657:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831dfc7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053662:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.053666:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831dfc7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053682:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831dfc7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053690:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e619d6fc00) 00010000:00010000:0.0:1788572216.053693:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.053696:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831dfc7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053702:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831dfc7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.053716:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e537c6d reply state 000000006a5eff2a transno 214748367049 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729e00/0xdb7edb52b831dfce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc84f5e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053733:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729e00/0xdb7edb52b831dfce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc84f5e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.053740:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc84f5e3a (ffff94e619d6fe00) 00010000:00010000:0.0:1788572216.053742:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.053745:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.053833:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.053853:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.053856:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367050 00000020:00080000:0.0:1788572216.053861:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.053863:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367050 00000100:00100000:2.0:1788572216.057967:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.058122:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615135488 00000100:00100000:0.0:1788572216.058132:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615135488 00000100:00100000:0.0:1788572216.058193:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10902 00000100:00100000:0.0:1788572216.058204:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+504:2382:x1875449615135488:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.058224:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367050, current: 214748367050, replaying 00000100:00100000:0.0:1788572216.058247:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+504:2382:x1875449615135488:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (293us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.058254:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10902 00000020:00080000:2.0:1788572216.058553:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.058558:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367050, next_transno: 214748367050 00010000:00080000:2.0:1788572216.058562:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367050) 00000020:00080000:2.0:1788572216.058565:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.058575:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615135488 t214748367050 from 192.168.202.13@tcp req@ffff94e64173e300 x1875449615135488/t0(214748367050) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.058665:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831dfdc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.058696:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831dfdc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.058709:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831dfdc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.058724:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.058730:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.058737:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.058982:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831dfea lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x419:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.058991:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831dfea lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.058998:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831dfea lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.059265:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].125, 64 off16192 00010000:00010000:2.0:1788572216.059322:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831dfea lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059331:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831dfea lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059338:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831dfea lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059344:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.059350:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831dfea lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059358:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831dfea lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059370:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x419:0x0].0x0 (ffff94e6158d6100) 00010000:00010000:2.0:1788572216.059373:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.059379:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831dfea lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059386:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831dfea lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x419:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059584:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831dfdc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059592:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831dfdc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059598:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831dfdc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059603:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.059606:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831dfdc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059612:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831dfdc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059621:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6158d6d00) 00010000:00010000:2.0:1788572216.059624:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.059627:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831dfdc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059633:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831dfdc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.059647:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f7935b0 reply state 00000000dd0ce89a transno 214748367050 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059663:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.059681:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7ee9c25f (ffff94e6158d6b00) 00010000:00010000:2.0:1788572216.059684:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.059686:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.059767:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.059786:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.059789:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367051 00000020:00080000:2.0:1788572216.059792:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.059794:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367051 00000100:00100000:1.0:1788572216.063115:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.063234:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615135872 00000100:00100000:0.0:1788572216.063244:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615135872 00000100:00100000:0.0:1788572216.063315:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10903 00000100:00100000:0.0:1788572216.063326:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+506:2382:x1875449615135872:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.063347:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367051, current: 214748367051, replaying 00000100:00100000:0.0:1788572216.063366:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+506:2382:x1875449615135872:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (263us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.063374:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10903 00000020:00080000:2.0:1788572216.063531:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.063535:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367051, next_transno: 214748367051 00010000:00080000:2.0:1788572216.063540:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367051) 00000020:00080000:2.0:1788572216.063543:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.063553:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615135872 t214748367051 from 192.168.202.13@tcp req@ffff94e62d28d180 x1875449615135872/t0(214748367051) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.063644:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831dff1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.063661:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831dff1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.063684:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831dff1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.063700:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.063712:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.063719:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.063929:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831dfff lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x41a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.063939:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831dfff lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.063945:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831dfff lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.064231:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].126, 64 off16256 00010000:00010000:2.0:1788572216.064297:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831dfff lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064305:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831dfff lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064312:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831dfff lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064318:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.064322:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831dfff lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064330:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831dfff lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064349:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x41a:0x0].0x0 (ffff94e6158d6600) 00010000:00010000:2.0:1788572216.064352:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.064357:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831dfff lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064363:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831dfff lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x41a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064386:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831dff1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064556:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831dff1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064563:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831dff1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064569:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.064572:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831dff1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064577:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831dff1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064586:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6158d6a00) 00010000:00010000:2.0:1788572216.064588:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.064592:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831dff1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064597:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831dff1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.064616:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009538f222 reply state 000000008e698b4e transno 214748367051 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064628:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.064634:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8e3b0c4 (ffff94e6158d6000) 00010000:00010000:2.0:1788572216.064636:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.064639:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.064825:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.064845:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.064848:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367052 00000020:00080000:2.0:1788572216.064852:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.064855:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367052 00000100:00100000:0.0:1788572216.069120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.069473:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615136256 00000100:00100000:2.0:1788572216.069486:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615136256 00000100:00100000:2.0:1788572216.069558:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10904 00000100:00100000:2.0:1788572216.069578:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+508:2382:x1875449615136256:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.069601:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367052, current: 214748367052, replaying 00000100:00100000:2.0:1788572216.069614:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+508:2382:x1875449615136256:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (507us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.069621:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10904 00000020:00080000:0.0:1788572216.069736:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.069740:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367052, next_transno: 214748367052 00010000:00080000:0.0:1788572216.069744:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367052) 00000020:00080000:0.0:1788572216.069747:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.069757:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615136256 t214748367052 from 192.168.202.13@tcp req@ffff94e62dac7b80 x1875449615136256/t0(214748367052) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.069865:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e006 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.069884:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e006 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.069896:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e006 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.069927:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.069934:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.069941:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070148:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e014 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x41b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070157:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e014 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070164:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e014 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.070386:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].126, 64 off16256 00010000:00010000:0.0:1788572216.070449:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e014 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070457:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e014 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070464:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e014 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070470:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.070474:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e014 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070482:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e014 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070496:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x41b:0x0].0x0 (ffff94e619d6f900) 00010000:00010000:0.0:1788572216.070500:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.070504:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e014 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070511:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e014 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x41b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070535:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e006 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070545:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e006 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070551:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e006 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070557:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.070560:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e006 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070566:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e006 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070574:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e619d6fc00) 00010000:00010000:0.0:1788572216.070576:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.070580:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e006 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070585:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e006 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.070597:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000214423a4 reply state 000000007c2962d7 transno 214748367052 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070609:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.070615:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8af5f591 (ffff94e619d6fd00) 00010000:00010000:0.0:1788572216.070618:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.070621:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.070717:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.070736:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.070739:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367053 00000020:00080000:0.0:1788572216.070742:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.070744:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367053 00000100:00100000:3.0:1788572216.074278:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.074448:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615136640 00000100:00100000:0.0:1788572216.074459:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615136640 00000100:00100000:0.0:1788572216.074530:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10905 00000100:00100000:0.0:1788572216.074542:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+510:2382:x1875449615136640:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.074568:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367053, current: 214748367053, replaying 00000100:00100000:0.0:1788572216.074594:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+510:2382:x1875449615136640:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 54us (328us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.074602:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10905 00000020:00080000:2.0:1788572216.074651:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.074656:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367053, next_transno: 214748367053 00010000:00080000:2.0:1788572216.074661:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367053) 00000020:00080000:2.0:1788572216.074665:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.074686:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615136640 t214748367053 from 192.168.202.13@tcp req@ffff94e6349e8e00 x1875449615136640/t0(214748367053) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.074791:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e01b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.074809:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e01b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.074822:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e01b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.074839:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbe163740 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.074846:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe163740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.074852:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe163740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075098:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e029 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x41c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075108:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e029 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075116:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e029 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.075391:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].127, 64 off16320 00010000:00010000:2.0:1788572216.075452:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e029 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075465:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e029 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075471:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e029 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075478:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.075483:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e029 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075490:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e029 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075502:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x41c:0x0].0x0 (ffff94e6158d6f00) 00010000:00010000:2.0:1788572216.075505:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.075510:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e029 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075516:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e029 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x41c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075538:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e01b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075545:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e01b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075550:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e01b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075555:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.075559:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e01b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075564:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e01b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075572:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6158d6d00) 00010000:00010000:2.0:1788572216.075574:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.075577:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e01b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075583:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e01b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.075596:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000358ae7b0 reply state 000000002e3eafc3 transno 214748367053 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbe163740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075607:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe163740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.075613:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe163740 (ffff94e6158d6100) 00010000:00010000:2.0:1788572216.075615:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.075618:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.075704:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.075724:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.075727:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367054 00000020:00080000:2.0:1788572216.075732:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.075734:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367054 00000100:00100000:1.0:1788572216.079513:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.079585:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615137024 00000100:00100000:0.0:1788572216.079598:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615137024 00000100:00100000:0.0:1788572216.079664:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10906 00000100:00100000:0.0:1788572216.079684:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+512:2382:x1875449615137024:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.079706:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367054, current: 214748367054, replaying 00000100:00100000:0.0:1788572216.079727:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+512:2382:x1875449615137024:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (224us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.079733:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10906 00000020:00080000:2.0:1788572216.079783:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.079788:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367054, next_transno: 214748367054 00010000:00080000:2.0:1788572216.079794:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367054) 00000020:00080000:2.0:1788572216.079798:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.079808:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615137024 t214748367054 from 192.168.202.13@tcp req@ffff94e62d28ce00 x1875449615137024/t0(214748367054) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.079933:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e030 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.079950:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e030 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.079960:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e030 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.079972:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.079978:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.079984:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080221:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e03e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x41d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080230:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e03e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080238:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e03e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.080451:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].127, 64 off16320 00010000:00010000:2.0:1788572216.080505:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e03e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080512:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e03e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080518:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e03e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080523:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.080527:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e03e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080534:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e03e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080568:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x41d:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572216.080571:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.080576:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e03e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080582:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e03e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x41d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080603:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e030 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080609:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e030 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080614:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e030 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080619:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.080622:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e030 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080628:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e030 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080634:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6158d6400) 00010000:00010000:2.0:1788572216.080636:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.080638:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e030 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080643:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e030 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.080653:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012e58e76 reply state 000000001eec2b0f transno 214748367054 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080663:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.080681:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe8871c0d (ffff94e6158d6200) 00010000:00010000:2.0:1788572216.080683:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.080686:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.080760:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.080775:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.080778:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367055 00000020:00080000:2.0:1788572216.080782:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.080784:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367055 00000100:00100000:0.0:1788572216.084254:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.084487:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615137408 00000100:00100000:2.0:1788572216.084499:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615137408 00000100:00100000:2.0:1788572216.084560:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10907 00000100:00100000:2.0:1788572216.084571:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+514:2382:x1875449615137408:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.084596:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367055, current: 214748367055, replaying 00000100:00100000:2.0:1788572216.084610:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+514:2382:x1875449615137408:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (370us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.084617:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10907 00000020:00080000:0.0:1788572216.084679:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.084683:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367055, next_transno: 214748367055 00010000:00080000:0.0:1788572216.084688:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367055) 00000020:00080000:0.0:1788572216.084691:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.084701:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615137408 t214748367055 from 192.168.202.13@tcp req@ffff94e62dac5880 x1875449615137408/t0(214748367055) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.084794:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e045 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.084811:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.084823:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.084836:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.084844:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.084850:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.085169:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e053 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x41e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.085179:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e053 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.085186:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e053 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.085809:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].128, 64 off16384 00010000:00010000:0.0:1788572216.085872:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e053 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.085885:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e053 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.085892:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e053 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.085911:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.086074:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e053 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086083:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e053 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086098:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x41e:0x0].0x0 (ffff94e619d6f600) 00010000:00010000:0.0:1788572216.086102:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.086107:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e053 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086113:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e053 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x41e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086140:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086147:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e045 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086153:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e045 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086158:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.086162:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e045 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086168:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e045 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086174:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e619d6fc00) 00010000:00010000:0.0:1788572216.086177:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.086179:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e045 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086185:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e045 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.086196:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc91fd91 reply state 00000000c04591b8 transno 214748367055 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086208:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.086215:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9eac6462 (ffff94e619d6f900) 00010000:00010000:0.0:1788572216.086217:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.086220:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.086334:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.086357:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.086361:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367056 00000020:00080000:0.0:1788572216.086365:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.086366:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367056 00000100:00100000:0.0:1788572216.089171:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.089303:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615137792 00000100:00100000:3.0:1788572216.089314:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615137792 00000100:00100000:3.0:1788572216.089374:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10908 00000100:00100000:3.0:1788572216.089386:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+516:2382:x1875449615137792:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.089405:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367056, current: 214748367056, replaying 00000100:00100000:3.0:1788572216.089427:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+516:2382:x1875449615137792:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (269us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.089434:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10908 00000020:00080000:2.0:1788572216.089497:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.089502:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367056, next_transno: 214748367056 00010000:00080000:2.0:1788572216.089506:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367056) 00000020:00080000:2.0:1788572216.089509:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.089519:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615137792 t214748367056 from 192.168.202.13@tcp req@ffff94e62dac5f80 x1875449615137792/t0(214748367056) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.089623:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e05a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.089639:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e05a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.089651:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e05a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.089666:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.089685:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.089691:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.089869:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e068 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x41f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.089878:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e068 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.089885:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e068 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.090154:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].128, 64 off16384 00010000:00010000:2.0:1788572216.090215:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e068 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090223:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e068 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090230:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e068 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090235:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.090239:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e068 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090248:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e068 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090261:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x41f:0x0].0x0 (ffff94e6158d6d00) 00010000:00010000:2.0:1788572216.090263:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.090268:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e068 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090278:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e068 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x41f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090298:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e05a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090304:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e05a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090309:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e05a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090313:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.090315:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e05a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090321:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e05a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090328:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572216.090329:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.090332:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e05a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090337:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e05a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.090348:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9bba261 reply state 00000000058f810d transno 214748367056 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090358:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.090365:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe85cdc7 (ffff94e6158d6400) 00010000:00010000:2.0:1788572216.090367:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.090370:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.090839:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.090860:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.090863:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367057 00000020:00080000:2.0:1788572216.090867:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.090869:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367057 00000100:00100000:1.0:1788572216.094343:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.094419:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615138176 00000100:00100000:0.0:1788572216.094429:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615138176 00000100:00100000:0.0:1788572216.094494:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10909 00000100:00100000:0.0:1788572216.094504:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+518:2382:x1875449615138176:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.094523:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367057, current: 214748367057, replaying 00000100:00100000:0.0:1788572216.094541:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+518:2382:x1875449615138176:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (206us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.094548:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10909 00000020:00080000:2.0:1788572216.094594:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.094599:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367057, next_transno: 214748367057 00010000:00080000:2.0:1788572216.094603:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367057) 00000020:00080000:2.0:1788572216.094606:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.094616:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615138176 t214748367057 from 192.168.202.13@tcp req@ffff94e62d28c000 x1875449615138176/t0(214748367057) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.094715:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e06f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.094731:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e06f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.094742:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e06f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.094754:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x19532b1c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.094761:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19532b1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.094770:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19532b1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.094954:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e07d lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x420:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.094963:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e07d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.094971:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e07d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.095366:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].129, 64 off16448 00010000:00010000:2.0:1788572216.095428:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e07d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095436:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e07d lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095443:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e07d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095448:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.095453:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e07d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095459:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e07d lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095471:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x420:0x0].0x0 (ffff94e6158d6600) 00010000:00010000:2.0:1788572216.095473:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.095478:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e07d lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095485:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e07d lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x420:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095506:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e06f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095513:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e06f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095519:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e06f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095525:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.095527:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e06f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095534:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e06f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095542:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6158d6f00) 00010000:00010000:2.0:1788572216.095544:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.095547:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e06f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095552:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e06f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.095565:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053ba9097 reply state 00000000e1d07385 transno 214748367057 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19532b1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095580:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19532b1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.095586:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19532b1c (ffff94e6158d6a00) 00010000:00010000:2.0:1788572216.095589:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.095591:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.095678:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.095696:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.095699:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367058 00000020:00080000:2.0:1788572216.095703:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.095705:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367058 00000100:00100000:1.0:1788572216.098435:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.099236:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615138560 00000100:00100000:2.0:1788572216.099250:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615138560 00000100:00100000:2.0:1788572216.099329:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10910 00000100:00100000:2.0:1788572216.099340:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+520:2382:x1875449615138560:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.099364:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367058, current: 214748367058, replaying 00000100:00100000:2.0:1788572216.099385:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+520:2382:x1875449615138560:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 48us (963us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.099393:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10910 00000020:00080000:0.0:1788572216.099449:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.099454:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367058, next_transno: 214748367058 00010000:00080000:0.0:1788572216.099459:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367058) 00000020:00080000:0.0:1788572216.099461:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.099471:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615138560 t214748367058 from 192.168.202.13@tcp req@ffff94e62d28ca80 x1875449615138560/t0(214748367058) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.099562:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e084 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.099578:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e084 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.099590:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e084 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.099603:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.099611:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.099618:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.099986:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e092 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x421:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.099996:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e092 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100034:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e092 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.100474:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].129, 64 off16448 00010000:00010000:0.0:1788572216.100539:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e092 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100548:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e092 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100555:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e092 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100561:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.100566:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e092 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100574:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e092 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100587:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x421:0x0].0x0 (ffff94e6414be200) 00010000:00010000:0.0:1788572216.100591:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.100595:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e092 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100605:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e092 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x421:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100626:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e084 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100633:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e084 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100638:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e084 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100643:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.100646:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e084 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100652:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e084 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100660:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e619d6fc00) 00010000:00010000:0.0:1788572216.100662:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.100665:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e084 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100681:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e084 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.100695:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a12f27f4 reply state 00000000cd92c626 transno 214748367058 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100706:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.100713:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfa940fe9 (ffff94e619d6f600) 00010000:00010000:0.0:1788572216.100715:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.100718:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.100806:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.100825:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.100829:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367059 00000020:00080000:0.0:1788572216.100833:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.100835:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367059 00000100:00100000:0.0:1788572216.104278:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.104482:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615138944 00000100:00100000:3.0:1788572216.104495:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615138944 00000100:00100000:3.0:1788572216.104564:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10911 00000100:00100000:3.0:1788572216.104576:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+522:2382:x1875449615138944:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.104598:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367059, current: 214748367059, replaying 00000100:00100000:3.0:1788572216.104620:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+522:2382:x1875449615138944:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (354us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.104627:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10911 00000020:00080000:2.0:1788572216.104704:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.104709:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367059, next_transno: 214748367059 00010000:00080000:2.0:1788572216.104714:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367059) 00000020:00080000:2.0:1788572216.104717:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.104728:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615138944 t214748367059 from 192.168.202.13@tcp req@ffff94e62dac4e00 x1875449615138944/t0(214748367059) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.104831:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e099 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.104847:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e099 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.104860:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e099 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.104874:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.104881:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.104888:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105117:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0a7 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x422:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105126:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0a7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105134:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0a7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.105363:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].130, 64 off16512 00010000:00010000:2.0:1788572216.105421:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0a7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105428:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0a7 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105437:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0a7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105443:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.105447:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0a7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105455:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0a7 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105468:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x422:0x0].0x0 (ffff94e6158d6d00) 00010000:00010000:2.0:1788572216.105471:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.105476:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0a7 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105483:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0a7 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x422:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105505:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e099 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105511:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e099 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105517:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e099 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105521:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.105524:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e099 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105533:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e099 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105541:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6158d6f00) 00010000:00010000:2.0:1788572216.105543:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.105546:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e099 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105552:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e099 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.105563:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000752f6e5a reply state 00000000aec628e3 transno 214748367059 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105574:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.105581:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6db56d3e (ffff94e6158d6600) 00010000:00010000:2.0:1788572216.105583:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.105586:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.106051:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.106072:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.106075:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367060 00000020:00080000:2.0:1788572216.106079:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.106081:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367060 00000100:00100000:1.0:1788572216.108455:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.108523:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615139328 00000100:00100000:0.0:1788572216.108536:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615139328 00000100:00100000:0.0:1788572216.108714:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10912 00000100:00100000:0.0:1788572216.108729:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+524:2382:x1875449615139328:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.108752:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367060, current: 214748367060, replaying 00000100:00100000:0.0:1788572216.108771:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+524:2382:x1875449615139328:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (327us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.108778:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10912 00000020:00080000:2.0:1788572216.108846:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.108851:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367060, next_transno: 214748367060 00010000:00080000:2.0:1788572216.108856:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367060) 00000020:00080000:2.0:1788572216.108859:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.108870:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615139328 t214748367060 from 192.168.202.13@tcp req@ffff94e62d28c700 x1875449615139328/t0(214748367060) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.108988:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109040:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109054:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109068:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x244fd163 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109076:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x244fd163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109083:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x244fd163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109264:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e0bc lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x423:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109273:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e0bc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109280:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e0bc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.109528:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].130, 64 off16512 00010000:00010000:2.0:1788572216.109588:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e0bc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109601:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e0bc lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109608:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e0bc lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109614:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.109619:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e0bc lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109626:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e0bc lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109639:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x423:0x0].0x0 (ffff94e6118eb500) 00010000:00010000:2.0:1788572216.109642:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.109648:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e0bc lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109654:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e0bc lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x423:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109685:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109691:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ae lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109696:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109702:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.109706:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109712:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109720:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572216.109723:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.109726:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ae lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109731:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ae lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.109744:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c75c53a4 reply state 00000000039ee671 transno 214748367060 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x244fd163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109755:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x244fd163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.109761:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x244fd163 (ffff94e6135f0700) 00010000:00010000:2.0:1788572216.109764:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.109766:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.109851:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.109869:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.109872:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367061 00000020:00080000:2.0:1788572216.109876:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.109878:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367061 00000100:00100000:1.0:1788572216.112510:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.112596:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615139712 00000100:00100000:2.0:1788572216.112608:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615139712 00000100:00100000:2.0:1788572216.112688:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10913 00000100:00100000:2.0:1788572216.112700:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+526:2382:x1875449615139712:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.112724:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367061, current: 214748367061, replaying 00000100:00100000:2.0:1788572216.112746:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+526:2382:x1875449615139712:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 48us (249us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.112753:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10913 00000020:00080000:1.0:1788572216.112850:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.112855:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367061, next_transno: 214748367061 00010000:00080000:1.0:1788572216.112859:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367061) 00000020:00080000:1.0:1788572216.112861:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.112873:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615139712 t214748367061 from 192.168.202.13@tcp req@ffff94e62d28f800 x1875449615139712/t0(214748367061) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.112989:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e0c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113045:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e0c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113059:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e0c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113074:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113082:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113088:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113276:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e0d1 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x424:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113285:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e0d1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113305:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e0d1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.113549:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].131, 64 off16576 00010000:00010000:1.0:1788572216.113609:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e0d1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113618:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e0d1 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113625:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e0d1 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113632:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.113635:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e0d1 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113643:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e0d1 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113656:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x424:0x0].0x0 (ffff94e602c23300) 00010000:00010000:1.0:1788572216.113660:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.113665:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e0d1 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113683:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e0d1 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x424:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113705:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e0c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113711:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e0c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113721:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e0c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113725:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.113728:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e0c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113734:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e0c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113741:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23200) 00010000:00010000:1.0:1788572216.113743:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.113746:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e0c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113751:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e0c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.113761:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8ae7102 reply state 000000002913efd7 transno 214748367061 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113770:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.113777:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc83f3fc8 (ffff94e602c23800) 00010000:00010000:1.0:1788572216.113779:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.113782:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.113867:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.113884:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.113887:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367062 00000020:00080000:1.0:1788572216.113891:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.113894:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367062 00000100:00100000:0.0:1788572216.116541:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.116623:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615140096 00000100:00100000:3.0:1788572216.116633:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615140096 00000100:00100000:3.0:1788572216.116703:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10914 00000100:00100000:3.0:1788572216.116714:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+528:2382:x1875449615140096:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.116736:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367062, current: 214748367062, replaying 00000100:00100000:3.0:1788572216.116756:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+528:2382:x1875449615140096:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (224us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.116763:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10914 00000020:00080000:1.0:1788572216.116818:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.116823:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367062, next_transno: 214748367062 00010000:00080000:1.0:1788572216.116827:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367062) 00000020:00080000:1.0:1788572216.116830:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.116839:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615140096 t214748367062 from 192.168.202.13@tcp req@ffff94e62dac4a80 x1875449615140096/t0(214748367062) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.116942:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e0d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.116961:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.116972:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.116986:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.116993:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117000:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117202:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e0e6 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x425:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117211:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e0e6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117218:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e0e6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.117437:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].131, 64 off16576 00010000:00010000:1.0:1788572216.117499:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e0e6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117507:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e0e6 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117514:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e0e6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117520:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.117524:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e0e6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117533:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e0e6 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117545:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x425:0x0].0x0 (ffff94e615913800) 00010000:00010000:1.0:1788572216.117548:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.117553:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e0e6 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117559:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e0e6 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x425:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117579:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117590:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e0d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117596:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117600:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.117603:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117608:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e0d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117614:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23c00) 00010000:00010000:1.0:1788572216.117616:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.117619:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e0d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117624:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e0d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.117636:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e260e392 reply state 000000005e300dac transno 214748367062 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117648:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.117654:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8aa5a495 (ffff94e615913000) 00010000:00010000:1.0:1788572216.117656:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.117659:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.117754:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.117771:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.117775:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367063 00000020:00080000:1.0:1788572216.117779:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.117781:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367063 00000100:00100000:0.0:1788572216.120517:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.120600:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615140480 00000100:00100000:1.0:1788572216.120610:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615140480 00000100:00100000:1.0:1788572216.120682:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10915 00000100:00100000:1.0:1788572216.120694:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+530:2382:x1875449615140480:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.120722:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367063, current: 214748367063, replaying 00000100:00100000:1.0:1788572216.120745:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+530:2382:x1875449615140480:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 53us (242us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.120752:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10915 00000020:00080000:2.0:1788572216.120810:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.120815:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367063, next_transno: 214748367063 00010000:00080000:2.0:1788572216.120820:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367063) 00000020:00080000:2.0:1788572216.120823:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.120833:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615140480 t214748367063 from 192.168.202.13@tcp req@ffff94e62dac6d80 x1875449615140480/t0(214748367063) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.120940:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.120959:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.120972:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.120986:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.120993:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121000:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121238:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e0fb lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x426:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121248:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e0fb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121256:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e0fb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.121479:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].132, 64 off16640 00010000:00010000:2.0:1788572216.121533:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e0fb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121541:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e0fb lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121547:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e0fb lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121553:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.121556:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e0fb lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121564:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e0fb lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121576:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x426:0x0].0x0 (ffff94e6118eb800) 00010000:00010000:2.0:1788572216.121579:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.121584:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e0fb lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121594:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e0fb lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x426:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121614:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121620:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ed lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121626:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121630:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.121634:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121640:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121647:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6118eb500) 00010000:00010000:2.0:1788572216.121650:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.121653:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121659:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e0ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.121679:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b33274b7 reply state 000000001e0693c6 transno 214748367063 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121690:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.121698:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9af7cb30 (ffff94e6118eb200) 00010000:00010000:2.0:1788572216.121700:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.121702:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.121794:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.121812:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.121815:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367064 00000020:00080000:2.0:1788572216.121819:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.121821:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367064 00000100:00100000:2.0:1788572216.124816:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.124924:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615140864 00000100:00100000:3.0:1788572216.124937:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615140864 00000100:00100000:3.0:1788572216.125176:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10916 00000100:00100000:3.0:1788572216.125192:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+532:2382:x1875449615140864:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.125220:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367064, current: 214748367064, replaying 00000100:00100000:3.0:1788572216.125240:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+532:2382:x1875449615140864:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 54us (437us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.125247:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10916 00000020:00080000:2.0:1788572216.125310:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.125315:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367064, next_transno: 214748367064 00010000:00080000:2.0:1788572216.125320:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367064) 00000020:00080000:2.0:1788572216.125323:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.125334:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615140864 t214748367064 from 192.168.202.13@tcp req@ffff94e64173fb80 x1875449615140864/t0(214748367064) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.125431:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e102 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.125449:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e102 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.125461:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e102 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.125475:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.125483:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.125490:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.125685:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e110 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x427:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.125694:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e110 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.125701:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e110 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.125949:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].132, 64 off16640 00010000:00010000:2.0:1788572216.126195:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e110 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126204:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e110 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126211:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e110 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126217:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.126222:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e110 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126229:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e110 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126243:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x427:0x0].0x0 (ffff94e6118ebc00) 00010000:00010000:2.0:1788572216.126245:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.126251:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e110 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126258:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e110 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x427:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126280:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e102 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126286:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e102 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126292:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e102 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126297:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.126300:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e102 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126306:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e102 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126313:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6118eb900) 00010000:00010000:2.0:1788572216.126317:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.126319:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e102 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126324:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e102 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.126336:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6159521 reply state 0000000004cd38cb transno 214748367064 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126352:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.126359:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x88493fa9 (ffff94e6118eb300) 00010000:00010000:2.0:1788572216.126361:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.126364:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.126491:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.126511:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.126514:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367065 00000020:00080000:2.0:1788572216.126519:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.126521:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367065 00000100:00100000:0.0:1788572216.129368:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.129466:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615141248 00000100:00100000:3.0:1788572216.129477:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615141248 00000100:00100000:3.0:1788572216.129572:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10917 00000100:00100000:3.0:1788572216.129584:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+534:2382:x1875449615141248:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.129605:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367065, current: 214748367065, replaying 00000100:00100000:3.0:1788572216.129625:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+534:2382:x1875449615141248:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (267us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.129631:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10917 00000020:00080000:2.0:1788572216.129679:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.129683:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367065, next_transno: 214748367065 00010000:00080000:2.0:1788572216.129688:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367065) 00000020:00080000:2.0:1788572216.129692:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.129703:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615141248 t214748367065 from 192.168.202.13@tcp req@ffff94e62dac6300 x1875449615141248/t0(214748367065) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.129801:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e117 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.129818:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e117 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.129830:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e117 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.129842:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa58df852 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.129854:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa58df852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.129861:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa58df852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130099:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e125 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x428:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130109:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e125 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130117:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e125 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.130390:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].133, 64 off16704 00010000:00010000:2.0:1788572216.130453:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e125 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130461:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e125 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130468:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e125 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130475:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.130479:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e125 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130487:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e125 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130505:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x428:0x0].0x0 (ffff94e6118ebf00) 00010000:00010000:2.0:1788572216.130508:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.130512:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e125 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130519:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e125 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x428:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130540:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e117 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130547:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e117 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130552:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e117 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130558:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.130561:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e117 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130567:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e117 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130575:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6118eb500) 00010000:00010000:2.0:1788572216.130577:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.130580:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e117 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130586:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e117 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.130601:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edeacf46 reply state 0000000015bf321e transno 214748367065 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa58df852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130613:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58df852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.130620:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa58df852 (ffff94e6118eb800) 00010000:00010000:2.0:1788572216.130622:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.130624:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.130705:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.130722:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.130724:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367066 00000020:00080000:2.0:1788572216.130728:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.130730:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367066 00000100:00100000:1.0:1788572216.133752:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.133857:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615141632 00000100:00100000:0.0:1788572216.133868:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615141632 00000100:00100000:0.0:1788572216.134044:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10918 00000100:00100000:0.0:1788572216.134057:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+536:2382:x1875449615141632:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.134079:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367066, current: 214748367066, replaying 00000100:00100000:0.0:1788572216.134094:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+536:2382:x1875449615141632:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (354us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.134102:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10918 00000020:00080000:2.0:1788572216.134170:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.134176:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367066, next_transno: 214748367066 00010000:00080000:2.0:1788572216.134180:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367066) 00000020:00080000:2.0:1788572216.134184:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.134194:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615141632 t214748367066 from 192.168.202.13@tcp req@ffff94e62d28df80 x1875449615141632/t0(214748367066) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.134298:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e12c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134315:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e12c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134327:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e12c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134345:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134351:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134357:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134517:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e13a lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x429:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134527:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e13a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134534:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e13a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.134747:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].133, 64 off16704 00010000:00010000:2.0:1788572216.134807:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e13a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134816:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e13a lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134823:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e13a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134829:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.134833:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e13a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134845:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e13a lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134858:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x429:0x0].0x0 (ffff94e6118ebe00) 00010000:00010000:2.0:1788572216.134862:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.134867:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e13a lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134873:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e13a lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x429:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134896:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e12c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134903:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e12c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134909:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e12c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134923:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.134926:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e12c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134932:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e12c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134940:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6118eb700) 00010000:00010000:2.0:1788572216.134942:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.134946:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e12c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134956:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e12c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.134970:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5d671d5 reply state 00000000ab5488b9 transno 214748367066 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134981:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.134987:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f1e61cb (ffff94e6118eba00) 00010000:00010000:2.0:1788572216.134989:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.134992:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.135097:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.135114:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.135118:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367067 00000020:00080000:2.0:1788572216.135122:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.135123:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367067 00000100:00100000:1.0:1788572216.137831:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.137920:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615142016 00000100:00100000:3.0:1788572216.137931:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615142016 00000100:00100000:3.0:1788572216.138067:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10919 00000100:00100000:3.0:1788572216.138078:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+538:2382:x1875449615142016:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.138097:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367067, current: 214748367067, replaying 00000100:00100000:3.0:1788572216.138112:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+538:2382:x1875449615142016:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 38us (294us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.138120:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10919 00000020:00080000:2.0:1788572216.138193:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.138198:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367067, next_transno: 214748367067 00010000:00080000:2.0:1788572216.138202:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367067) 00000020:00080000:2.0:1788572216.138205:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.138215:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615142016 t214748367067 from 192.168.202.13@tcp req@ffff94e62d28d880 x1875449615142016/t0(214748367067) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.138313:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e141 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138329:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e141 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138345:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e141 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138358:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138365:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138371:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138545:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e14f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x42a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138554:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e14f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138561:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e14f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.138808:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].134, 64 off16768 00010000:00010000:2.0:1788572216.138867:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e14f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138874:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e14f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138880:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e14f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138887:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.138892:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e14f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138900:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e14f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138913:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x42a:0x0].0x0 (ffff94e6118eb400) 00010000:00010000:2.0:1788572216.138916:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.138921:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e14f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138927:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e14f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x42a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138950:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e141 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138956:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e141 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138962:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e141 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138967:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.138970:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e141 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138976:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e141 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138983:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6118eb900) 00010000:00010000:2.0:1788572216.138985:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.138989:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e141 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.138995:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e141 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.139039:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d363aa21 reply state 000000009060e6f6 transno 214748367067 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.139051:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.139058:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6245b9cc (ffff94e6118ebc00) 00010000:00010000:2.0:1788572216.139060:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.139063:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.139133:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.139151:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.139153:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367068 00000020:00080000:2.0:1788572216.139158:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.139160:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367068 00000100:00100000:1.0:1788572216.142447:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.142549:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615142400 00000100:00100000:0.0:1788572216.142559:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615142400 00000100:00100000:0.0:1788572216.142623:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10920 00000100:00100000:0.0:1788572216.142634:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+540:2382:x1875449615142400:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.142655:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367068, current: 214748367068, replaying 00000100:00100000:0.0:1788572216.142684:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+540:2382:x1875449615142400:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 53us (247us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.142690:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10920 00000020:00080000:1.0:1788572216.142744:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.142748:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367068, next_transno: 214748367068 00010000:00080000:1.0:1788572216.142753:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367068) 00000020:00080000:1.0:1788572216.142756:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.142767:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615142400 t214748367068 from 192.168.202.13@tcp req@ffff94e62d28f480 x1875449615142400/t0(214748367068) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.142873:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e156 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.142889:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e156 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.142906:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e156 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.142931:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.142939:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.142946:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143151:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e164 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x42b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143162:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e164 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143170:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e164 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.143418:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].134, 64 off16768 00010000:00010000:1.0:1788572216.143479:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e164 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143488:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e164 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x42b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143495:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e164 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143501:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.143506:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e164 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143515:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e164 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x42b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143528:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x42b:0x0].0x0 (ffff94e602c23200) 00010000:00010000:1.0:1788572216.143531:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.143536:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e164 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x42b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143542:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e164 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x42b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143562:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e156 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143568:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e156 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143573:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e156 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143579:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.143582:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e156 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143588:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e156 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143595:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e615913800) 00010000:00010000:1.0:1788572216.143597:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.143601:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e156 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143606:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e156 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.143619:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9dffac1 reply state 0000000063d97d7a transno 214748367068 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143629:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.143635:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa09fb385 (ffff94e602c23c00) 00010000:00010000:1.0:1788572216.143638:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.143640:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.143752:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.143773:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.143775:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367069 00000020:00080000:1.0:1788572216.143779:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.143781:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367069 00000100:00100000:3.0:1788572216.146709:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.146824:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615142784 00000100:00100000:0.0:1788572216.146836:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615142784 00000100:00100000:0.0:1788572216.146907:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10921 00000100:00100000:0.0:1788572216.146927:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+542:2382:x1875449615142784:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.146951:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367069, current: 214748367069, replaying 00000100:00100000:0.0:1788572216.146971:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+542:2382:x1875449615142784:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 56us (275us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.146979:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10921 00000020:00080000:1.0:1788572216.147063:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.147068:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367069, next_transno: 214748367069 00010000:00080000:1.0:1788572216.147073:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367069) 00000020:00080000:1.0:1788572216.147076:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.147087:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615142784 t214748367069 from 192.168.202.13@tcp req@ffff94e6349ebb80 x1875449615142784/t0(214748367069) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.147188:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e16b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147205:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e16b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147221:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e16b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147236:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6097012e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147243:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6097012e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147250:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6097012e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147461:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e179 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x42c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147470:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e179 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147478:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e179 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.147719:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].135, 64 off16832 00010000:00010000:1.0:1788572216.147784:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e179 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147793:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e179 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x42c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147799:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e179 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147805:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.147811:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e179 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147820:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e179 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x42c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147833:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x42c:0x0].0x0 (ffff94e6411e7200) 00010000:00010000:1.0:1788572216.147836:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.147842:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e179 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x42c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147849:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e179 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x42c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147872:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e16b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147878:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e16b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147884:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e16b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147889:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.147892:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e16b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147898:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e16b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147906:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23300) 00010000:00010000:1.0:1788572216.147908:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.147912:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e16b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147918:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e16b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.147930:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022749324 reply state 0000000080fc6f7c transno 214748367069 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6097012e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147941:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6097012e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.147947:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6097012e (ffff94e6411e7d00) 00010000:00010000:1.0:1788572216.147950:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.147953:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.148055:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.148073:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.148077:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367070 00000020:00080000:1.0:1788572216.148081:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.148082:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367070 00000100:00100000:0.0:1788572216.150894:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.151063:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615143168 00000100:00100000:1.0:1788572216.151075:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615143168 00000100:00100000:1.0:1788572216.151138:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10922 00000100:00100000:1.0:1788572216.151149:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+544:2382:x1875449615143168:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.151177:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367070, current: 214748367070, replaying 00000100:00100000:1.0:1788572216.151203:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+544:2382:x1875449615143168:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 56us (323us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.151211:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10922 00000020:00080000:2.0:1788572216.151283:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.151288:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367070, next_transno: 214748367070 00010000:00080000:2.0:1788572216.151303:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367070) 00000020:00080000:2.0:1788572216.151307:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.151318:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615143168 t214748367070 from 192.168.202.13@tcp req@ffff94e62dac6680 x1875449615143168/t0(214748367070) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.151423:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e180 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.151441:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e180 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.151456:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e180 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.151470:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.151478:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.151484:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.151682:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e18e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x42d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.151691:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e18e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.151699:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e18e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.152342:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].135, 64 off16832 00010000:00010000:2.0:1788572216.152415:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e18e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152424:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e18e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152431:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e18e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152437:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.152442:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e18e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152450:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e18e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152462:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x42d:0x0].0x0 (ffff94e6118eb700) 00010000:00010000:2.0:1788572216.152466:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.152470:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e18e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152477:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e18e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x42d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152504:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e180 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152510:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e180 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152516:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e180 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152522:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.152524:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e180 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152530:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e180 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152539:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6118eb900) 00010000:00010000:2.0:1788572216.152541:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.152545:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e180 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152551:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e180 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.152564:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048012aa1 reply state 000000004c1772d1 transno 214748367070 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152575:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.152581:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc05b55a7 (ffff94e6118eb400) 00010000:00010000:2.0:1788572216.152584:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.152586:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.152795:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.152815:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.152819:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367071 00000020:00080000:2.0:1788572216.152823:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.152825:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367071 00000100:00100000:0.0:1788572216.155794:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.155892:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615143552 00000100:00100000:3.0:1788572216.155903:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615143552 00000100:00100000:3.0:1788572216.156113:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10923 00000100:00100000:3.0:1788572216.156125:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+546:2382:x1875449615143552:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.156148:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367071, current: 214748367071, replaying 00000100:00100000:3.0:1788572216.156264:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+546:2382:x1875449615143552:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 141us (482us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.156272:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10923 00000020:00080000:1.0:1788572216.156393:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.156399:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367071, next_transno: 214748367071 00010000:00080000:1.0:1788572216.156404:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367071) 00000020:00080000:1.0:1788572216.156407:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.156416:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615143552 t214748367071 from 192.168.202.13@tcp req@ffff94e60fc8c700 x1875449615143552/t0(214748367071) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.156511:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e195 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.156528:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.156540:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.156556:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.156563:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.156570:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.156778:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e1a3 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x42e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.156788:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e1a3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.156796:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e1a3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.157240:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].136, 64 off16896 00010000:00010000:1.0:1788572216.157320:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e1a3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157329:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e1a3 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x42e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157336:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e1a3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157342:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.157347:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e1a3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157356:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e1a3 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x42e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157369:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x42e:0x0].0x0 (ffff94e612b14900) 00010000:00010000:1.0:1788572216.157373:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.157378:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e1a3 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x42e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157385:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e1a3 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x42e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157406:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157412:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e195 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157422:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e195 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157427:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.157430:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e195 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157437:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e195 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157445:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7900) 00010000:00010000:1.0:1788572216.157447:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.157450:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e195 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157455:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e195 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.157468:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2d1d6b1 reply state 00000000c64e4a2b transno 214748367071 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157479:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.157486:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe68c4e78 (ffff94e612b14b00) 00010000:00010000:1.0:1788572216.157489:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.157491:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.157564:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.157582:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.157586:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367072 00000020:00080000:1.0:1788572216.157590:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.157592:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367072 00000100:00100000:2.0:1788572216.161086:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.161182:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615143936 00000100:00100000:0.0:1788572216.161192:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615143936 00000100:00100000:0.0:1788572216.161251:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10924 00000100:00100000:0.0:1788572216.161261:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+548:2382:x1875449615143936:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.161293:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367072, current: 214748367072, replaying 00000100:00100000:0.0:1788572216.161310:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+548:2382:x1875449615143936:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 51us (235us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.161316:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10924 00000020:00080000:2.0:1788572216.161361:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.161365:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367072, next_transno: 214748367072 00010000:00080000:2.0:1788572216.161370:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367072) 00000020:00080000:2.0:1788572216.161374:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.161383:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615143936 t214748367072 from 192.168.202.13@tcp req@ffff94e64173d880 x1875449615143936/t0(214748367072) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.161472:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.161493:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.161505:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.161517:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9d424831 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.161524:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d424831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.161530:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d424831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.161712:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1b8 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x42f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.161721:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1b8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.161729:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1b8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.161957:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].136, 64 off16896 00010000:00010000:2.0:1788572216.162037:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1b8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x42f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162045:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1b8 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x42f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162052:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1b8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162059:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.162063:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1b8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x42f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162071:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1b8 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x42f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162081:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x42f:0x0].0x0 (ffff94e6118ebf00) 00010000:00010000:2.0:1788572216.162084:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.162089:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1b8 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x42f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162095:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1b8 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x42f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162114:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162120:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1aa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162126:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162130:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.162133:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162139:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162150:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6118ebe00) 00010000:00010000:2.0:1788572216.162152:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.162154:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1aa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162159:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.162169:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000461359dd reply state 000000009c9f6d6a transno 214748367072 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9d424831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162179:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d424831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.162184:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9d424831 (ffff94e6118eb500) 00010000:00010000:2.0:1788572216.162186:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.162189:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.162268:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.162285:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.162288:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367073 00000020:00080000:2.0:1788572216.162292:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.162294:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367073 00000100:00100000:0.0:1788572216.164591:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.164703:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615144320 00000100:00100000:2.0:1788572216.164717:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615144320 00000100:00100000:2.0:1788572216.164794:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10925 00000100:00100000:2.0:1788572216.164806:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+550:2382:x1875449615144320:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.164834:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367073, current: 214748367073, replaying 00000100:00100000:2.0:1788572216.164857:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+550:2382:x1875449615144320:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 54us (278us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.164866:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10925 00000020:00080000:3.0:1788572216.164983:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.164988:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367073, next_transno: 214748367073 00010000:00080000:3.0:1788572216.164993:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367073) 00000020:00080000:3.0:1788572216.164996:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.165072:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615144320 t214748367073 from 192.168.202.13@tcp req@ffff94e60fc8ca80 x1875449615144320/t0(214748367073) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.165171:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e1bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165190:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e1bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165202:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e1bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165215:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x58b645d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165222:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x58b645d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165228:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x58b645d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165529:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1cd lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x430:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165539:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1cd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x430:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165546:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1cd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x430:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.165792:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].137, 64 off16960 00010000:00010000:3.0:1788572216.165858:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1cd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x430:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165867:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1cd lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x430:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165875:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1cd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x430:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165882:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.165887:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1cd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x430:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165896:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1cd lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x430:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.165910:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x430:0x0].0x0 (ffff94e64217cb00) 00010000:00010000:3.0:1788572216.166219:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.166227:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1cd lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x430:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.166235:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1cd lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x430:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.166264:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e1bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.166270:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e1bf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.166276:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e1bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.166281:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.166353:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e1bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.166363:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e1bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.166372:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e64217c800) 00010000:00010000:3.0:1788572216.166375:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.166378:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e1bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.166384:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e1bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.166399:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000521ed143 reply state 000000004c4ba65b transno 214748367073 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x58b645d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.166410:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x58b645d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.166417:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x58b645d (ffff94e64217c400) 00010000:00010000:3.0:1788572216.166420:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.166423:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.166630:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.166656:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.166659:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367074 00000020:00080000:0.0:1788572216.166663:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.166676:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367074 00000100:00100000:0.0:1788572216.169101:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.169202:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615144704 00000100:00100000:3.0:1788572216.169213:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615144704 00000100:00100000:3.0:1788572216.169274:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10926 00000100:00100000:3.0:1788572216.169296:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+552:2382:x1875449615144704:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.169320:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367074, current: 214748367074, replaying 00000100:00100000:3.0:1788572216.169339:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+552:2382:x1875449615144704:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 56us (248us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.169347:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10926 00000020:00080000:2.0:1788572216.169539:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.169544:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367074, next_transno: 214748367074 00010000:00080000:2.0:1788572216.169549:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367074) 00000020:00080000:2.0:1788572216.169552:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.169561:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615144704 t214748367074 from 192.168.202.13@tcp req@ffff94e60fc8ea00 x1875449615144704/t0(214748367074) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.169655:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e1d4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.169683:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e1d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.169695:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e1d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.169710:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe079a92a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.169717:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe079a92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.169725:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe079a92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.169902:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e1e2 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x431:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.169912:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e1e2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x431:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.169920:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e1e2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x431:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.170315:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].137, 64 off16960 00010000:00010000:2.0:1788572216.170381:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e1e2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x431:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170389:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e1e2 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x431:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170397:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e1e2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x431:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170403:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.170408:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e1e2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x431:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170415:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e1e2 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x431:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170431:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x431:0x0].0x0 (ffff94e6118ebd00) 00010000:00010000:2.0:1788572216.170435:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.170441:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e1e2 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x431:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170447:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e1e2 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x431:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170476:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e1d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170487:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e1d4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170492:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e1d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170497:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.170500:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e1d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170505:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e1d4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170513:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6118eb900) 00010000:00010000:2.0:1788572216.170515:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.170518:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e1d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170523:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e1d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.170537:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d8da708 reply state 000000007ed9e928 transno 214748367074 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe079a92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170548:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe079a92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.170554:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe079a92a (ffff94e6118eb700) 00010000:00010000:2.0:1788572216.170556:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.170559:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.170637:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.170654:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.170658:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367075 00000020:00080000:2.0:1788572216.170661:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.170663:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367075 00000100:00100000:2.0:1788572216.173937:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.174197:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615145088 00000100:00100000:0.0:1788572216.174207:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615145088 00000100:00100000:0.0:1788572216.174276:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10927 00000100:00100000:0.0:1788572216.174296:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+554:2382:x1875449615145088:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.174317:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367075, current: 214748367075, replaying 00000100:00100000:0.0:1788572216.174332:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+554:2382:x1875449615145088:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 48us (416us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.174339:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10927 00000020:00080000:2.0:1788572216.174454:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.174459:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367075, next_transno: 214748367075 00010000:00080000:2.0:1788572216.174463:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367075) 00000020:00080000:2.0:1788572216.174466:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.174477:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615145088 t214748367075 from 192.168.202.13@tcp req@ffff94e64173f480 x1875449615145088/t0(214748367075) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.174572:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.174589:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.174601:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.174616:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa64af17f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.174624:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa64af17f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.174632:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa64af17f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.174841:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e1f7 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x432:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.174851:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e1f7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x432:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.174859:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e1f7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x432:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.175269:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].138, 64 off17024 00010000:00010000:2.0:1788572216.175333:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e1f7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x432:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175342:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e1f7 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x432:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175348:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e1f7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x432:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175354:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.175359:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e1f7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x432:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175369:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e1f7 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x432:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175382:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x432:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572216.175385:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.175390:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e1f7 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x432:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175401:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e1f7 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x432:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175421:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175427:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175433:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175438:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.175440:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175446:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175454:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6118ebe00) 00010000:00010000:2.0:1788572216.175456:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.175459:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175466:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e1e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.175480:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab127ef2 reply state 00000000a6ac414a transno 214748367075 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa64af17f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175491:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa64af17f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.175498:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa64af17f (ffff94e6118ebf00) 00010000:00010000:2.0:1788572216.175501:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.175504:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.175583:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.175601:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.175604:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367076 00000020:00080000:2.0:1788572216.175609:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.175611:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367076 00000100:00100000:0.0:1788572216.178070:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.178348:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615145472 00000100:00100000:2.0:1788572216.178360:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615145472 00000100:00100000:2.0:1788572216.178422:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10928 00000100:00100000:2.0:1788572216.178433:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+556:2382:x1875449615145472:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.178453:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367076, current: 214748367076, replaying 00000100:00100000:2.0:1788572216.178478:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+556:2382:x1875449615145472:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (420us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.178485:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10928 00000020:00080000:3.0:1788572216.178581:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.178585:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367076, next_transno: 214748367076 00010000:00080000:3.0:1788572216.178589:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367076) 00000020:00080000:3.0:1788572216.178592:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.178602:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615145472 t214748367076 from 192.168.202.13@tcp req@ffff94e60fc3df80 x1875449615145472/t0(214748367076) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.178704:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.178720:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.178733:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.178746:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.178753:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.178760:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.178944:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e20c lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x433:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.178953:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e20c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x433:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.178959:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e20c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x433:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.179210:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].138, 64 off17024 00010000:00010000:3.0:1788572216.179270:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e20c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x433:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179278:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e20c lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x433:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179284:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e20c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x433:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179289:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.179294:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e20c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x433:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179302:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e20c lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x433:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179315:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x433:0x0].0x0 (ffff94e64217c700) 00010000:00010000:3.0:1788572216.179318:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.179323:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e20c lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x433:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179329:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e20c lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x433:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179349:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179354:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179359:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179365:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.179367:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179373:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179380:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e64217c800) 00010000:00010000:3.0:1788572216.179383:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.179386:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179391:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e1fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.179402:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e28e0159 reply state 00000000e283388c transno 214748367076 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179416:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.179422:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa8880aa4 (ffff94e64217cb00) 00010000:00010000:3.0:1788572216.179424:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.179427:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.179502:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.179518:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.179521:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367077 00000020:00080000:3.0:1788572216.179524:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.179526:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367077 00000100:00100000:0.0:1788572216.182292:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.182425:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615145856 00000100:00100000:3.0:1788572216.182436:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615145856 00000100:00100000:3.0:1788572216.182496:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10929 00000100:00100000:3.0:1788572216.182507:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+558:2382:x1875449615145856:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.182529:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367077, current: 214748367077, replaying 00000100:00100000:3.0:1788572216.182548:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+558:2382:x1875449615145856:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (267us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.182556:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10929 00000020:00080000:2.0:1788572216.182889:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.182894:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367077, next_transno: 214748367077 00010000:00080000:2.0:1788572216.182898:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367077) 00000020:00080000:2.0:1788572216.182903:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.182922:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615145856 t214748367077 from 192.168.202.13@tcp req@ffff94e60fc3ca80 x1875449615145856/t0(214748367077) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.183062:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e213 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183081:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e213 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183093:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e213 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183106:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183112:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183118:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183302:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e221 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x434:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183310:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e221 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x434:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183317:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e221 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x434:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.183556:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].139, 64 off17088 00010000:00010000:2.0:1788572216.183619:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e221 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x434:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183628:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e221 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x434:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183634:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e221 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x434:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183640:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.183646:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e221 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x434:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183654:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e221 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x434:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183676:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x434:0x0].0x0 (ffff94e6118eb900) 00010000:00010000:2.0:1788572216.183680:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.183685:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e221 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x434:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183692:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e221 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x434:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183714:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e213 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183721:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e213 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183726:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e213 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183731:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.183735:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e213 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183741:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e213 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183748:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572216.183750:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.183753:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e213 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183758:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e213 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.183767:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000094e2572 reply state 00000000ffcaad1d transno 214748367077 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183775:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.183779:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x20d952f9 (ffff94e6118ebe00) 00010000:00010000:2.0:1788572216.183781:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.183782:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.183845:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.183858:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.183860:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367078 00000020:00080000:2.0:1788572216.183863:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.183864:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367078 00000100:00100000:2.0:1788572216.186612:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.186712:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615146240 00000100:00100000:0.0:1788572216.186724:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615146240 00000100:00100000:0.0:1788572216.186788:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10930 00000100:00100000:0.0:1788572216.186798:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+560:2382:x1875449615146240:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.186823:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367078, current: 214748367078, replaying 00000100:00100000:0.0:1788572216.186842:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+560:2382:x1875449615146240:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (240us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.186850:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10930 00000020:00080000:2.0:1788572216.186899:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.186903:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367078, next_transno: 214748367078 00010000:00080000:2.0:1788572216.186907:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367078) 00000020:00080000:2.0:1788572216.186918:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.186928:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615146240 t214748367078 from 192.168.202.13@tcp req@ffff94e64173e680 x1875449615146240/t0(214748367078) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.187062:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e228 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187083:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e228 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187093:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e228 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187107:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x46869d06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187113:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x46869d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187119:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x46869d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187300:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e236 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x435:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187310:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e236 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x435:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187317:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e236 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x435:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.187532:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].139, 64 off17088 00010000:00010000:2.0:1788572216.187590:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e236 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x435:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187599:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e236 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x435:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187606:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e236 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x435:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187612:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.187617:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e236 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x435:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187625:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e236 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x435:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187637:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x435:0x0].0x0 (ffff94e6158d6d00) 00010000:00010000:2.0:1788572216.187641:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.187645:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e236 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x435:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187652:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e236 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x435:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187683:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e228 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187691:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e228 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187697:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e228 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187702:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.187705:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e228 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187711:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e228 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187723:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6118ebd00) 00010000:00010000:2.0:1788572216.187725:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.187729:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e228 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187735:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e228 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.187747:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4443513 reply state 00000000bb1a66e2 transno 214748367078 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x46869d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187758:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46869d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.187765:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x46869d06 (ffff94e6158d6f00) 00010000:00010000:2.0:1788572216.187767:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.187770:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.187843:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.187858:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.187861:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367079 00000020:00080000:2.0:1788572216.187865:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.187867:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367079 00000100:00100000:1.0:1788572216.190551:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.190686:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615146624 00000100:00100000:2.0:1788572216.190700:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615146624 00000100:00100000:2.0:1788572216.190759:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10931 00000100:00100000:2.0:1788572216.190769:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+562:2382:x1875449615146624:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.190791:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367079, current: 214748367079, replaying 00000100:00100000:2.0:1788572216.190815:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+562:2382:x1875449615146624:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 48us (277us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.190823:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10931 00000020:00080000:3.0:1788572216.191314:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.191333:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367079, next_transno: 214748367079 00010000:00080000:3.0:1788572216.191338:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367079) 00000020:00080000:3.0:1788572216.191341:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.191353:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615146624 t214748367079 from 192.168.202.13@tcp req@ffff94e62d28e680 x1875449615146624/t0(214748367079) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.191453:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e23d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.191470:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e23d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.191484:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e23d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.191500:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.191508:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.191515:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.191708:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e24b lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x436:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.191718:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e24b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x436:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.191726:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e24b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x436:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.192744:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].140, 64 off17152 00010000:00010000:2.0:1788572216.192856:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e24b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x436:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.192867:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e24b lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x436:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.192876:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e24b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x436:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.192881:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.192886:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e24b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x436:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.192894:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e24b lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x436:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.192907:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x436:0x0].0x0 (ffff94e64217cc00) 00010000:00010000:2.0:1788572216.192911:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.192977:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e24b lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x436:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.192985:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e24b lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x436:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.193032:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e23d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.193039:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e23d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.193050:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e23d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.193054:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.193057:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e23d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.193063:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e23d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.193071:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e64217c800) 00010000:00010000:2.0:1788572216.193073:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.193076:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e23d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.193081:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e23d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.193094:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8c4a635 reply state 0000000081644ce3 transno 214748367079 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.193106:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.193113:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6153fa5b (ffff94e64217c700) 00010000:00010000:2.0:1788572216.193115:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.193118:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.193265:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.195294:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.195306:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367080 00000020:00080000:2.0:1788572216.195312:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.195315:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367080 00000100:00100000:0.0:1788572216.195700:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.195802:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615147008 00000100:00100000:3.0:1788572216.195816:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615147008 00000100:00100000:3.0:1788572216.195977:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10932 00000100:00100000:3.0:1788572216.195989:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+564:2382:x1875449615147008:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.196041:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367080, current: 214748367080, replaying 00000100:00100000:3.0:1788572216.196057:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+564:2382:x1875449615147008:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 71us (364us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.196065:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10932 00000020:00080000:2.0:1788572216.196129:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.196133:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367080, next_transno: 214748367080 00010000:00080000:2.0:1788572216.196137:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367080) 00000020:00080000:2.0:1788572216.196140:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.196149:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615147008 t214748367080 from 192.168.202.13@tcp req@ffff94e60fc3c380 x1875449615147008/t0(214748367080) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.196238:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e252 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196254:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e252 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196267:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e252 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196279:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196294:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196302:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196508:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e260 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x437:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196517:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e260 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x437:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196525:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e260 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x437:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.196756:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].140, 64 off17152 00010000:00010000:2.0:1788572216.196823:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e260 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x437:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196831:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e260 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x437:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196837:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e260 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x437:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196843:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.196847:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e260 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x437:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196854:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e260 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x437:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196866:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x437:0x0].0x0 (ffff94e502297800) 00010000:00010000:2.0:1788572216.196869:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.196873:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e260 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x437:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196879:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e260 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x437:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196900:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e252 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196910:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e252 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196925:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e252 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196930:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.196933:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e252 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196939:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e252 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196947:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572216.196949:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.196952:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e252 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196959:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e252 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.196971:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a360907d reply state 0000000019d3f797 transno 214748367080 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196981:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.196987:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xabc4fe80 (ffff94e6118eb900) 00010000:00010000:2.0:1788572216.196989:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.196991:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.197098:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.197117:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.197119:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367081 00000020:00080000:2.0:1788572216.197123:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.197125:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367081 00000100:00100000:1.0:1788572216.199487:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.199577:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615147392 00000100:00100000:0.0:1788572216.199590:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615147392 00000100:00100000:0.0:1788572216.199696:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10933 00000100:00100000:0.0:1788572216.199707:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+566:2382:x1875449615147392:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.199734:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367081, current: 214748367081, replaying 00000100:00100000:0.0:1788572216.199779:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+566:2382:x1875449615147392:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 75us (305us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.199784:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10933 00000020:00080000:2.0:1788572216.199822:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.199825:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367081, next_transno: 214748367081 00010000:00080000:2.0:1788572216.199829:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367081) 00000020:00080000:2.0:1788572216.199832:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.199840:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615147392 t214748367081 from 192.168.202.13@tcp req@ffff94e62d28ed80 x1875449615147392/t0(214748367081) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.199947:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e267 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.199964:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e267 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.199976:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e267 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.199990:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.199998:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200029:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200203:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e275 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x438:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200210:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e275 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x438:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200214:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e275 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x438:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.200544:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].141, 64 off17216 00010000:00010000:2.0:1788572216.200609:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e275 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x438:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200617:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e275 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x438:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200624:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e275 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x438:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200630:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.200634:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e275 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x438:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200642:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e275 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x438:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200655:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x438:0x0].0x0 (ffff94e502297f00) 00010000:00010000:2.0:1788572216.200658:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.200663:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e275 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x438:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200680:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e275 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x438:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200703:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e267 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200710:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e267 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200715:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e267 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200721:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.200723:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e267 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200729:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e267 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200737:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297500) 00010000:00010000:2.0:1788572216.200739:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.200742:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e267 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200748:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e267 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.200761:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a70c3e2d reply state 00000000ed9a7b72 transno 214748367081 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200772:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.200778:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25a9ece5 (ffff94e502297400) 00010000:00010000:2.0:1788572216.200781:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.200784:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.200992:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.202775:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.202787:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367082 00000020:00080000:2.0:1788572216.202792:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.202794:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367082 00000100:00100000:1.0:1788572216.205140:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.205184:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615147776 00000100:00100000:2.0:1788572216.205194:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615147776 00000100:00100000:2.0:1788572216.205309:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10934 00000100:00100000:2.0:1788572216.205320:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+568:2382:x1875449615147776:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.205342:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367082, current: 214748367082, replaying 00000100:00100000:2.0:1788572216.205366:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+568:2382:x1875449615147776:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 49us (234us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.205373:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10934 00000020:00080000:3.0:1788572216.205403:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.205408:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367082, next_transno: 214748367082 00010000:00080000:3.0:1788572216.205412:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367082) 00000020:00080000:3.0:1788572216.205415:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.205425:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615147776 t214748367082 from 192.168.202.13@tcp req@ffff94e62d28fb80 x1875449615147776/t0(214748367082) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.205527:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e27c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.205546:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e27c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.205560:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e27c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.205576:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x396831b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.205584:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x396831b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.205592:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x396831b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.205793:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e28a lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x439:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.205802:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e28a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x439:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.205809:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e28a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x439:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.206067:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].141, 64 off17216 00010000:00010000:3.0:1788572216.206128:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e28a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x439:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206136:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e28a lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x439:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206142:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e28a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x439:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206148:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.206153:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e28a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x439:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206161:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e28a lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x439:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206173:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x439:0x0].0x0 (ffff94e618898000) 00010000:00010000:3.0:1788572216.206176:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.206181:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e28a lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x439:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206187:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e28a lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x439:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206215:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e27c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206222:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e27c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206229:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e27c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206234:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.206237:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e27c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206242:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e27c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206249:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e64217c600) 00010000:00010000:3.0:1788572216.206252:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.206255:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e27c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206260:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e27c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.206272:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073499f9e reply state 00000000323caa34 transno 214748367082 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x396831b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206283:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x396831b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.206299:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x396831b2 (ffff94e64217c000) 00010000:00010000:3.0:1788572216.206302:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.206304:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.206386:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.206404:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.206407:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367083 00000020:00080000:3.0:1788572216.206411:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.206413:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367083 00000100:00100000:1.0:1788572216.208551:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.208652:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615148160 00000100:00100000:0.0:1788572216.208661:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615148160 00000100:00100000:0.0:1788572216.208742:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10935 00000100:00100000:0.0:1788572216.208754:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+570:2382:x1875449615148160:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.208774:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367083, current: 214748367083, replaying 00000100:00100000:0.0:1788572216.208794:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+570:2382:x1875449615148160:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (257us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.208801:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10935 00000020:00080000:2.0:1788572216.209806:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.209814:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367083, next_transno: 214748367083 00010000:00080000:2.0:1788572216.209819:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367083) 00000020:00080000:2.0:1788572216.209822:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.209835:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615148160 t214748367083 from 192.168.202.13@tcp req@ffff94e62d28d500 x1875449615148160/t0(214748367083) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.209948:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e291 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.209964:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e291 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.209977:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e291 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.209989:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.209996:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210025:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210177:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e29f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x43a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210185:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e29f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210191:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e29f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.210407:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].142, 64 off17280 00010000:00010000:2.0:1788572216.210457:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e29f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210466:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e29f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x43a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210473:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e29f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210479:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.210484:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e29f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210497:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e29f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x43a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210510:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x43a:0x0].0x0 (ffff94e502297100) 00010000:00010000:2.0:1788572216.210513:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.210517:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e29f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x43a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210524:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e29f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x43a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210543:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e291 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210549:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e291 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210555:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e291 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210560:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.210562:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e291 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210568:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e291 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210574:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297800) 00010000:00010000:2.0:1788572216.210576:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.210578:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e291 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210588:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e291 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.210598:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c97b585 reply state 000000003a44909d transno 214748367083 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210607:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.210614:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8dd8730d (ffff94e502297600) 00010000:00010000:2.0:1788572216.210616:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.210619:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.210723:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.210743:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.210745:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367084 00000020:00080000:2.0:1788572216.210749:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.210751:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367084 00000100:00100000:1.0:1788572216.223820:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.223940:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615148544 00000100:00100000:3.0:1788572216.223953:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615148544 00000100:00100000:3.0:1788572216.224052:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10936 00000100:00100000:3.0:1788572216.224062:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+572:2382:x1875449615148544:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.224084:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367084, current: 214748367084, replaying 00000100:00100000:3.0:1788572216.224303:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+572:2382:x1875449615148544:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 232us (484us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.224312:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10936 00000020:00080000:2.0:1788572216.227586:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.227600:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367084, next_transno: 214748367084 00010000:00080000:2.0:1788572216.227608:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367084) 00000020:00080000:2.0:1788572216.227612:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.227630:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615148544 t214748367084 from 192.168.202.13@tcp req@ffff94e62d28dc00 x1875449615148544/t0(214748367084) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.228183:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2a6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.228205:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.228220:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.228235:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.228242:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.228250:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.228535:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2b4 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x43b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.228545:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2b4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.228600:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2b4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.229124:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].142, 64 off17280 00010000:00010000:1.0:1788572216.229203:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2b4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229212:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2b4 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x43b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229220:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2b4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229228:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.229233:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2b4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229242:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2b4 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x43b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229257:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x43b:0x0].0x0 (ffff94e612b14800) 00010000:00010000:1.0:1788572216.229260:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.229265:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2b4 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x43b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229272:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2b4 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x43b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229371:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229378:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2a6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229390:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229395:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.229398:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229405:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2a6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229413:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e612b14900) 00010000:00010000:1.0:1788572216.229416:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.229418:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2a6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229425:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2a6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.229437:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ce2a552 reply state 0000000024ac76e6 transno 214748367084 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229450:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.229456:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x143bccc6 (ffff94e612b14300) 00010000:00010000:1.0:1788572216.229458:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.229461:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.230105:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.230134:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.230137:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367085 00000020:00080000:1.0:1788572216.230142:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.230144:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367085 00000100:00100000:1.0:1788572216.233514:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.233677:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615148928 00000100:00100000:0.0:1788572216.233691:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615148928 00000100:00100000:0.0:1788572216.233803:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10937 00000100:00100000:0.0:1788572216.233816:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+574:2382:x1875449615148928:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.233839:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367085, current: 214748367085, replaying 00000100:00100000:0.0:1788572216.233858:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+574:2382:x1875449615148928:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (356us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.233866:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10937 00000020:00080000:1.0:1788572216.233920:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.233924:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367085, next_transno: 214748367085 00010000:00080000:1.0:1788572216.233930:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367085) 00000020:00080000:1.0:1788572216.233933:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.233944:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615148928 t214748367085 from 192.168.202.13@tcp req@ffff94e6184d5f80 x1875449615148928/t0(214748367085) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.234073:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e2bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234090:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e2bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234101:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e2bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234115:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd737056f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234122:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd737056f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234128:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd737056f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234326:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e2c9 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x43c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234338:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e2c9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234345:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e2c9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.234585:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].143, 64 off17344 00010000:00010000:1.0:1788572216.234642:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e2c9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234650:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e2c9 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x43c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234657:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e2c9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234662:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.234675:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e2c9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234682:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e2c9 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x43c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234693:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x43c:0x0].0x0 (ffff94e6411e7900) 00010000:00010000:1.0:1788572216.234696:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.234701:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e2c9 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x43c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234707:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e2c9 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x43c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234736:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e2bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234743:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e2bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234748:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e2bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234753:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.234755:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e2bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234761:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e2bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234768:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e612b14500) 00010000:00010000:1.0:1788572216.234770:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.234773:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e2bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234779:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e2bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.234789:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7a08a76 reply state 00000000be3c6c95 transno 214748367085 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd737056f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234799:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd737056f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.234804:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd737056f (ffff94e612b14600) 00010000:00010000:1.0:1788572216.234806:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.234808:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.234881:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.234897:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.234900:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367086 00000020:00080000:1.0:1788572216.234904:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.234906:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367086 00000100:00100000:1.0:1788572216.238461:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.239770:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615149312 00000100:00100000:2.0:1788572216.239784:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615149312 00000100:00100000:2.0:1788572216.239855:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10938 00000100:00100000:2.0:1788572216.239865:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+576:2382:x1875449615149312:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.239886:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367086, current: 214748367086, replaying 00000100:00100000:2.0:1788572216.239906:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+576:2382:x1875449615149312:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 34us (1453us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.239918:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10938 00000020:00080000:1.0:1788572216.240077:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.240081:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367086, next_transno: 214748367086 00010000:00080000:1.0:1788572216.240086:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367086) 00000020:00080000:1.0:1788572216.240090:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.240101:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615149312 t214748367086 from 192.168.202.13@tcp req@ffff94e6184d7100 x1875449615149312/t0(214748367086) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.240204:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e2d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.240222:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e2d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.240234:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e2d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.240247:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.240254:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.240260:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.240440:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e2de lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x43d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.240449:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e2de lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.240455:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e2de lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.240848:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].143, 64 off17344 00010000:00010000:1.0:1788572216.241144:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e2de lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241153:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e2de lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x43d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241159:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e2de lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241164:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.241169:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e2de lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241176:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e2de lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x43d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241188:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x43d:0x0].0x0 (ffff94e602c23300) 00010000:00010000:1.0:1788572216.241201:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.241207:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e2de lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x43d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241218:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e2de lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x43d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241242:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e2d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241248:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e2d0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241254:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e2d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241259:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.241262:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e2d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241268:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e2d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241276:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7200) 00010000:00010000:1.0:1788572216.241278:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.241281:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e2d0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241510:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e2d0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.241527:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b105652d reply state 00000000b75d4e87 transno 214748367086 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241539:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.241546:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb11b6ee8 (ffff94e615913800) 00010000:00010000:1.0:1788572216.241548:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.241616:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.241728:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.241752:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.241756:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367087 00000020:00080000:1.0:1788572216.241760:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.241762:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367087 00000100:00100000:0.0:1788572216.246983:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.247128:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615149696 00000100:00100000:3.0:1788572216.247139:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615149696 00000100:00100000:3.0:1788572216.247191:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10939 00000100:00100000:3.0:1788572216.247200:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+578:2382:x1875449615149696:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.247219:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367087, current: 214748367087, replaying 00000100:00100000:3.0:1788572216.247234:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+578:2382:x1875449615149696:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 36us (262us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.247241:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10939 00000020:00080000:1.0:1788572216.247293:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.247298:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367087, next_transno: 214748367087 00010000:00080000:1.0:1788572216.247302:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367087) 00000020:00080000:1.0:1788572216.247306:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.247316:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615149696 t214748367087 from 192.168.202.13@tcp req@ffff94e60fc3dc00 x1875449615149696/t0(214748367087) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.247414:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.247430:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.247442:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.247456:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.247463:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.247474:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.247807:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e2f3 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x43e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.247817:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e2f3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.247825:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e2f3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.248086:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].144, 64 off17408 00010000:00010000:1.0:1788572216.248136:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e2f3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248144:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e2f3 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x43e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248151:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e2f3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248157:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.248162:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e2f3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248171:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e2f3 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x43e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248184:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x43e:0x0].0x0 (ffff94e612b14800) 00010000:00010000:1.0:1788572216.248187:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.248192:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e2f3 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x43e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248198:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e2f3 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x43e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248217:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248222:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2e5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248229:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248234:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.248236:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248242:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248249:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23200) 00010000:00010000:1.0:1788572216.248251:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.248253:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2e5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248259:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e2e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.248269:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002156e4e5 reply state 00000000e98f644e transno 214748367087 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248729:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.248738:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bc566e9 (ffff94e612b14900) 00010000:00010000:1.0:1788572216.248741:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.248744:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.248844:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.248865:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.248869:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367088 00000020:00080000:1.0:1788572216.248872:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.248874:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367088 00000100:00100000:1.0:1788572216.253037:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.253227:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615150080 00000100:00100000:3.0:1788572216.253239:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615150080 00000100:00100000:3.0:1788572216.253321:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10940 00000100:00100000:3.0:1788572216.253333:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+580:2382:x1875449615150080:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.253358:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367088, current: 214748367088, replaying 00000100:00100000:3.0:1788572216.253372:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+580:2382:x1875449615150080:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (386us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.253379:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10940 00000020:00080000:0.0:1788572216.253617:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.253622:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367088, next_transno: 214748367088 00010000:00080000:0.0:1788572216.253626:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367088) 00000020:00080000:0.0:1788572216.253630:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.253640:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615150080 t214748367088 from 192.168.202.13@tcp req@ffff94e6184d4000 x1875449615150080/t0(214748367088) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.253753:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e2fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.253770:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e2fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.253783:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e2fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.253795:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.253801:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.253807:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254041:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e308 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x43f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254050:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e308 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254057:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e308 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.254682:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].144, 64 off17408 00010000:00010000:0.0:1788572216.254754:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e308 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x43f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254763:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e308 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x43f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254771:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e308 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254777:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.254782:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e308 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x43f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254792:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e308 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x43f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254806:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x43f:0x0].0x0 (ffff94e6414bee00) 00010000:00010000:0.0:1788572216.254809:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.254814:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e308 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x43f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254827:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e308 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x43f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254850:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e2fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254857:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e2fa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254864:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e2fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254869:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.254873:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e2fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254880:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e2fa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254888:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6414be200) 00010000:00010000:0.0:1788572216.254891:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.254907:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e2fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254921:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e2fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.254934:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000621ac305 reply state 00000000f428f829 transno 214748367088 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254947:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.254954:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53a9bb62 (ffff94e6414beb00) 00010000:00010000:0.0:1788572216.254957:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.254959:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.255078:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.255098:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.255102:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367089 00000020:00080000:0.0:1788572216.255106:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.255108:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367089 00000100:00100000:0.0:1788572216.258996:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.259125:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615150464 00000100:00100000:1.0:1788572216.259140:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615150464 00000100:00100000:1.0:1788572216.259213:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10941 00000100:00100000:1.0:1788572216.259225:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+582:2382:x1875449615150464:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.259247:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367089, current: 214748367089, replaying 00000100:00100000:1.0:1788572216.259262:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+582:2382:x1875449615150464:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (279us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.259269:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10941 00000020:00080000:2.0:1788572216.259349:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.259354:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367089, next_transno: 214748367089 00010000:00080000:2.0:1788572216.259358:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367089) 00000020:00080000:2.0:1788572216.259361:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.259372:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615150464 t214748367089 from 192.168.202.13@tcp req@ffff94e60fc3f480 x1875449615150464/t0(214748367089) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.259495:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e30f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.259512:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e30f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.259525:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e30f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.259537:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x85ea890b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.259544:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85ea890b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.259550:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85ea890b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.259751:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e31d lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x440:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.259761:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e31d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x440:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.259768:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e31d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x440:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.260331:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].145, 64 off17472 00010000:00010000:2.0:1788572216.260590:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e31d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x440:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260599:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e31d lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x440:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260607:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e31d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x440:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260612:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.260617:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e31d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x440:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260626:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e31d lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x440:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260640:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x440:0x0].0x0 (ffff94e502297500) 00010000:00010000:2.0:1788572216.260643:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.260649:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e31d lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x440:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260655:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e31d lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x440:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260694:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e30f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260701:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e30f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260707:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e30f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260713:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.260716:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e30f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260722:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e30f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260730:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297800) 00010000:00010000:2.0:1788572216.260732:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.260735:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e30f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260741:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e30f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.260754:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8dfd446 reply state 000000009176f532 transno 214748367089 ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85ea890b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260764:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85ea890b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.260771:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85ea890b (ffff94e502297100) 00010000:00010000:2.0:1788572216.260773:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.260776:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.260905:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.260925:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.260929:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367090 00000020:00080000:2.0:1788572216.260932:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.260934:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367090 00000100:00100000:3.0:1788572216.268076:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.273209:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615150848 00000100:00100000:0.0:1788572216.273225:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615150848 00000100:00100000:0.0:1788572216.273311:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10942 00000100:00100000:0.0:1788572216.273322:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+584:2382:x1875449615150848:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.273342:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367090, current: 214748367090, replaying 00000100:00100000:0.0:1788572216.273355:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+584:2382:x1875449615150848:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 36us (5295us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.273361:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10942 00000020:00080000:1.0:1788572216.274652:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.274661:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367090, next_transno: 214748367090 00010000:00080000:1.0:1788572216.274676:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367090) 00000020:00080000:1.0:1788572216.274680:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.274694:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615150848 t214748367090 from 192.168.202.13@tcp req@ffff94e6349eb800 x1875449615150848/t0(214748367090) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.274817:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e324 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.274836:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e324 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.274851:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e324 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.274864:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.274871:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.274877:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.275148:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e332 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x441:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.275159:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e332 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.275166:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e332 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.276069:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].145, 64 off17472 00010000:00010000:1.0:1788572216.276137:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e332 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276146:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e332 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276154:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e332 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276160:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.276164:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e332 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276173:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e332 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276189:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x441:0x0].0x0 (ffff94e602c23200) 00010000:00010000:1.0:1788572216.276192:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.276196:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e332 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276203:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e332 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x441:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276225:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e324 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276231:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e324 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276236:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e324 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276240:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.276243:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e324 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276251:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e324 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276258:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e612b14800) 00010000:00010000:1.0:1788572216.276260:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.276263:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e324 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.276267:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e324 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.276278:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bee7a8c3 reply state 00000000fa0fd97b transno 214748367090 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.277926:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.277940:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b2b02c4 (ffff94e612b14500) 00010000:00010000:1.0:1788572216.277943:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.277949:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.278087:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.278118:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.278122:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367091 00000020:00080000:1.0:1788572216.278127:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.278129:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367091 00000100:00100000:1.0:1788572216.287134:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.287264:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615151232 00000100:00100000:2.0:1788572216.287278:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615151232 00000100:00100000:2.0:1788572216.287349:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10943 00000100:00100000:2.0:1788572216.287359:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+586:2382:x1875449615151232:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.287392:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367091, current: 214748367091, replaying 00000100:00100000:2.0:1788572216.287403:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+586:2382:x1875449615151232:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (285us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.287410:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10943 00000020:00080000:1.0:1788572216.287574:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.287579:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367091, next_transno: 214748367091 00010000:00080000:1.0:1788572216.287584:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367091) 00000020:00080000:1.0:1788572216.287587:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.287599:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615151232 t214748367091 from 192.168.202.13@tcp req@ffff94e6184d5880 x1875449615151232/t0(214748367091) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.287706:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e339 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.287722:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e339 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.287739:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e339 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.287752:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.287759:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.287765:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.287969:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e347 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x442:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.287978:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e347 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x442:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.287985:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e347 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x442:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.288258:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].146, 64 off17536 00010000:00010000:1.0:1788572216.288319:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e347 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x442:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288328:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e347 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x442:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288335:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e347 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x442:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288341:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.288346:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e347 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x442:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288354:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e347 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x442:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288367:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x442:0x0].0x0 (ffff94e6411e7900) 00010000:00010000:1.0:1788572216.288371:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.288375:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e347 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x442:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288382:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e347 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x442:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288621:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e339 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288628:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e339 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288633:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e339 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288638:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.288641:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e339 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288648:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e339 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288656:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23300) 00010000:00010000:1.0:1788572216.288659:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.288661:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e339 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288679:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e339 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.288692:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee541c3d reply state 0000000033906d02 transno 214748367091 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288704:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.288711:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xacb17b95 (ffff94e6411e7200) 00010000:00010000:1.0:1788572216.288714:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.288716:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.288873:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.288892:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.288958:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367092 00000020:00080000:1.0:1788572216.288963:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.288965:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367092 00000100:00100000:0.0:1788572216.303769:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.303857:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615151616 00000100:00100000:1.0:1788572216.303869:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615151616 00000100:00100000:1.0:1788572216.303950:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10944 00000100:00100000:1.0:1788572216.303960:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+588:2382:x1875449615151616:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.303979:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367092, current: 214748367092, replaying 00000100:00100000:1.0:1788572216.304033:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+588:2382:x1875449615151616:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (244us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.304042:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10944 00000020:00080000:2.0:1788572216.304104:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.304109:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367092, next_transno: 214748367092 00010000:00080000:2.0:1788572216.304114:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367092) 00000020:00080000:2.0:1788572216.304117:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.304127:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615151616 t214748367092 from 192.168.202.13@tcp req@ffff94e60fc3c700 x1875449615151616/t0(214748367092) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.304231:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e34e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304248:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e34e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304262:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e34e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304278:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd534d54e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304285:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd534d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304305:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd534d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304485:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e35c lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x443:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304495:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e35c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x443:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304502:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e35c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x443:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.304764:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].146, 64 off17536 00010000:00010000:2.0:1788572216.304834:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e35c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x443:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304842:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e35c lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x443:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304849:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e35c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x443:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304855:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.304860:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e35c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x443:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304872:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e35c lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x443:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304886:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x443:0x0].0x0 (ffff94e502297f00) 00010000:00010000:2.0:1788572216.304889:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.304895:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e35c lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x443:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304901:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e35c lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x443:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304923:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e34e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304928:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e34e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304933:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e34e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304939:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.304941:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e34e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304948:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e34e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304954:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297800) 00010000:00010000:2.0:1788572216.304956:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.304959:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e34e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304969:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e34e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.304980:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c269c55e reply state 00000000a948971b transno 214748367092 ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd534d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304990:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd534d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.304996:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd534d54e (ffff94e502297500) 00010000:00010000:2.0:1788572216.304999:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.305048:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.305131:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.305152:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.305156:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367093 00000020:00080000:2.0:1788572216.305160:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.305162:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367093 00000100:00100000:1.0:1788572216.309440:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.309546:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615152000 00000100:00100000:0.0:1788572216.309558:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615152000 00000100:00100000:0.0:1788572216.309619:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10945 00000100:00100000:0.0:1788572216.309629:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+590:2382:x1875449615152000:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.309649:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367093, current: 214748367093, replaying 00000100:00100000:0.0:1788572216.309676:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+590:2382:x1875449615152000:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 49us (247us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.309687:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10945 00000020:00080000:2.0:1788572216.309740:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.309745:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367093, next_transno: 214748367093 00010000:00080000:2.0:1788572216.309750:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367093) 00000020:00080000:2.0:1788572216.309753:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.309764:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615152000 t214748367093 from 192.168.202.13@tcp req@ffff94e6184d7480 x1875449615152000/t0(214748367093) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.309863:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e363 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.309882:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e363 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.309900:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e363 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.309929:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.309936:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.309943:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310165:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e371 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x444:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310174:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e371 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x444:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310181:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e371 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x444:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.310402:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].147, 64 off17600 00010000:00010000:2.0:1788572216.310460:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e371 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x444:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310468:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e371 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x444:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310474:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e371 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x444:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310480:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.310485:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e371 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x444:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310493:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e371 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x444:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310506:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x444:0x0].0x0 (ffff94e502297d00) 00010000:00010000:2.0:1788572216.310509:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.310514:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e371 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x444:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310521:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e371 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x444:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310544:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e363 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310551:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e363 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310556:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e363 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310560:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.310563:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e363 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310569:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e363 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310576:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297000) 00010000:00010000:2.0:1788572216.310579:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.310583:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e363 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310588:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e363 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.310599:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e031f5a1 reply state 00000000af20cf50 transno 214748367093 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310610:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.310617:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb7c88751 (ffff94e502297700) 00010000:00010000:2.0:1788572216.310619:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.310621:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.310708:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.310726:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.310729:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367094 00000020:00080000:2.0:1788572216.310734:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.310736:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367094 00000100:00100000:1.0:1788572216.316422:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.316508:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615152384 00000100:00100000:2.0:1788572216.316521:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615152384 00000100:00100000:2.0:1788572216.316607:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10946 00000100:00100000:2.0:1788572216.316618:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+592:2382:x1875449615152384:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.316644:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367094, current: 214748367094, replaying 00000100:00100000:2.0:1788572216.316678:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+592:2382:x1875449615152384:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 62us (267us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.316686:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10946 00000020:00080000:3.0:1788572216.316877:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.316882:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367094, next_transno: 214748367094 00010000:00080000:3.0:1788572216.316887:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367094) 00000020:00080000:3.0:1788572216.316891:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.316902:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615152384 t214748367094 from 192.168.202.13@tcp req@ffff94e6184d5c00 x1875449615152384/t0(214748367094) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.317057:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e378 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317074:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e378 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317086:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e378 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317101:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x958cdbca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317108:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x958cdbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317114:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x958cdbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317305:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e386 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x445:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317315:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e386 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x445:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317322:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e386 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x445:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.317532:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].147, 64 off17600 00010000:00010000:3.0:1788572216.317733:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e386 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x445:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317741:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e386 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x445:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317747:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e386 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x445:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317753:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.317758:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e386 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x445:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317767:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e386 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x445:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317781:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x445:0x0].0x0 (ffff94e6029e1200) 00010000:00010000:3.0:1788572216.317785:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.317790:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e386 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x445:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317802:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e386 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x445:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317826:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e378 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317832:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e378 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317837:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e378 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317842:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.317845:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e378 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317850:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e378 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317858:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e618898000) 00010000:00010000:3.0:1788572216.317860:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.317863:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e378 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317868:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e378 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.317882:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008a1bb31 reply state 00000000054191c6 transno 214748367094 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x958cdbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317893:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x958cdbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.317900:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x958cdbca (ffff94e618898e00) 00010000:00010000:3.0:1788572216.317902:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.317905:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.318086:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.318109:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.318112:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367095 00000020:00080000:3.0:1788572216.318116:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.318118:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367095 00000100:00100000:0.0:1788572216.326637:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.326776:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615152768 00000100:00100000:2.0:1788572216.326788:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615152768 00000100:00100000:2.0:1788572216.326853:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10947 00000100:00100000:2.0:1788572216.326865:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+594:2382:x1875449615152768:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.326888:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367095, current: 214748367095, replaying 00000100:00100000:2.0:1788572216.326917:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+594:2382:x1875449615152768:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 55us (289us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.326932:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10947 00000020:00080000:3.0:1788572216.327124:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.327129:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367095, next_transno: 214748367095 00010000:00080000:3.0:1788572216.327134:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367095) 00000020:00080000:3.0:1788572216.327137:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.327148:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615152768 t214748367095 from 192.168.202.13@tcp req@ffff94e60fc3e680 x1875449615152768/t0(214748367095) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.327258:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e38d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.327277:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e38d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.327303:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e38d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.327318:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x500ab473 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.327326:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x500ab473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.327338:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x500ab473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.327891:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e39b lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x446:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.328120:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e39b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x446:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.328129:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e39b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x446:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.328772:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].148, 64 off17664 00010000:00010000:3.0:1788572216.328851:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e39b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x446:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.328860:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e39b lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x446:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.328868:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e39b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x446:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.328874:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.328879:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e39b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x446:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.328888:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e39b lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x446:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.330068:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x446:0x0].0x0 (ffff94e613194b00) 00010000:00010000:3.0:1788572216.330077:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.330085:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e39b lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x446:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.330094:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e39b lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x446:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.330120:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e38d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.330126:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e38d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.330132:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e38d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.330137:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.330141:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e38d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.330149:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e38d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.330158:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194700) 00010000:00010000:3.0:1788572216.330160:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.330164:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e38d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.330170:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e38d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.330184:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009b31ba1 reply state 00000000c86ca152 transno 214748367095 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x500ab473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.330203:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x500ab473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.330210:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x500ab473 (ffff94e613194000) 00010000:00010000:3.0:1788572216.330213:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.330216:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.331476:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.331505:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.331509:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367096 00000020:00080000:3.0:1788572216.331513:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.331516:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367096 00000100:00100000:2.0:1788572216.342260:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.342348:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615153152 00000100:00100000:0.0:1788572216.342360:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615153152 00000100:00100000:0.0:1788572216.342435:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10948 00000100:00100000:0.0:1788572216.342445:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+596:2382:x1875449615153152:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.342467:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367096, current: 214748367096, replaying 00000100:00100000:0.0:1788572216.342487:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+596:2382:x1875449615153152:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (242us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.342495:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10948 00000020:00080000:2.0:1788572216.342608:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.342612:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367096, next_transno: 214748367096 00010000:00080000:2.0:1788572216.342617:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367096) 00000020:00080000:2.0:1788572216.342619:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.342630:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615153152 t214748367096 from 192.168.202.13@tcp req@ffff94e64173f100 x1875449615153152/t0(214748367096) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.342746:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e3a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.342766:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e3a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.342781:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e3a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.342800:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.342807:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.342817:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343053:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e3b0 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x447:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343062:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e3b0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x447:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343070:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e3b0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x447:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.343349:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].148, 64 off17664 00010000:00010000:2.0:1788572216.343435:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e3b0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x447:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343443:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e3b0 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x447:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343449:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e3b0 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x447:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343455:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.343460:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e3b0 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x447:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343468:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e3b0 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x447:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343482:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x447:0x0].0x0 (ffff94e502297800) 00010000:00010000:2.0:1788572216.343485:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.343491:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e3b0 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x447:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343497:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e3b0 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x447:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343529:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e3a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343538:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e3a2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343544:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e3a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343552:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.343626:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e3a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343635:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e3a2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343643:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297000) 00010000:00010000:2.0:1788572216.343649:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.343655:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e3a2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343672:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e3a2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.343684:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000042fc2b reply state 0000000031680276 transno 214748367096 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343703:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.343712:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbb9b1dec (ffff94e502297d00) 00010000:00010000:2.0:1788572216.343715:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.343718:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.343903:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.343979:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.343982:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367097 00000020:00080000:2.0:1788572216.343987:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.343992:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367097 00000100:00100000:2.0:1788572216.350001:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.350707:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615153536 00000100:00100000:3.0:1788572216.350721:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615153536 00000100:00100000:3.0:1788572216.350790:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10949 00000100:00100000:3.0:1788572216.350804:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+598:2382:x1875449615153536:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.350827:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367097, current: 214748367097, replaying 00000100:00100000:3.0:1788572216.350845:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+598:2382:x1875449615153536:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (857us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.350853:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10949 00000020:00080000:2.0:1788572216.351140:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.351145:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367097, next_transno: 214748367097 00010000:00080000:2.0:1788572216.351150:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367097) 00000020:00080000:2.0:1788572216.351153:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.351166:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615153536 t214748367097 from 192.168.202.13@tcp req@ffff94e641356300 x1875449615153536/t0(214748367097) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.351274:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e3b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.351361:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e3b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.351375:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e3b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.351400:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.351409:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.351416:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.351685:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3c5 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x448:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.351695:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3c5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x448:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.351705:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3c5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x448:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.352206:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].149, 64 off17728 00010000:00010000:2.0:1788572216.352277:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3c5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x448:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352352:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3c5 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x448:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352359:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3c5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x448:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352369:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.352374:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3c5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x448:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352446:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3c5 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x448:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352466:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x448:0x0].0x0 (ffff94e502297300) 00010000:00010000:2.0:1788572216.352469:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.352474:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3c5 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x448:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352481:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3c5 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x448:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352718:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e3b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352729:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e3b7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352735:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e3b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352741:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.352747:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e3b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352753:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e3b7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352762:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297f00) 00010000:00010000:2.0:1788572216.352767:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.352770:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e3b7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352776:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e3b7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.352796:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009d35f9a reply state 00000000a5b6f600 transno 214748367097 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352809:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.352816:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6520f5ed (ffff94e502297b00) 00010000:00010000:2.0:1788572216.352821:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.352824:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.355434:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.355468:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.355472:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367098 00000020:00080000:2.0:1788572216.355477:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.355480:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367098 00000100:00100000:3.0:1788572216.358616:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.358716:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615153920 00000100:00100000:2.0:1788572216.358727:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615153920 00000100:00100000:2.0:1788572216.358792:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10950 00000100:00100000:2.0:1788572216.358802:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+600:2382:x1875449615153920:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.358825:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367098, current: 214748367098, replaying 00000100:00100000:2.0:1788572216.358847:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+600:2382:x1875449615153920:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (244us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.358854:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10950 00000020:00080000:3.0:1788572216.359163:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.359169:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367098, next_transno: 214748367098 00010000:00080000:3.0:1788572216.359177:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367098) 00000020:00080000:3.0:1788572216.359180:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.359190:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615153920 t214748367098 from 192.168.202.13@tcp req@ffff94e6349ead80 x1875449615153920/t0(214748367098) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.359313:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e3cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.359330:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e3cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.359344:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e3cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.359359:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.359366:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.359371:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.359679:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e3da lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x449:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.359689:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e3da lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x449:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.359701:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e3da lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x449:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.360920:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].149, 64 off17728 00010000:00010000:2.0:1788572216.361030:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e3da lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x449:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361041:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e3da lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x449:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361050:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e3da lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x449:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361056:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.361061:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e3da lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x449:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361070:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e3da lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x449:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361084:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x449:0x0].0x0 (ffff94e613194500) 00010000:00010000:2.0:1788572216.361087:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.361094:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e3da lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x449:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361100:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e3da lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x449:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361125:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e3cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361132:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e3cc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361138:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e3cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361143:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.361145:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e3cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361154:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e3cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361161:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194700) 00010000:00010000:2.0:1788572216.361163:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.361166:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e3cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361171:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e3cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.361184:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c552e5a6 reply state 00000000b70a2e8e transno 214748367098 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361196:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.361203:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8da44fa6 (ffff94e613194b00) 00010000:00010000:2.0:1788572216.361205:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.361208:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.361554:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.361576:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.361579:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367099 00000020:00080000:2.0:1788572216.361584:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.361586:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367099 00000100:00100000:1.0:1788572216.364378:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.364515:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615154304 00000100:00100000:0.0:1788572216.364526:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615154304 00000100:00100000:0.0:1788572216.364599:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10951 00000100:00100000:0.0:1788572216.364610:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+602:2382:x1875449615154304:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.364631:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367099, current: 214748367099, replaying 00000100:00100000:0.0:1788572216.364646:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+602:2382:x1875449615154304:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 39us (280us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.364653:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10951 00000020:00080000:2.0:1788572216.365212:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.365218:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367099, next_transno: 214748367099 00010000:00080000:2.0:1788572216.365222:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367099) 00000020:00080000:2.0:1788572216.365225:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.365237:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615154304 t214748367099 from 192.168.202.13@tcp req@ffff94e63c506680 x1875449615154304/t0(214748367099) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.365348:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3e1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.365367:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.365379:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.365633:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x227f380f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.365642:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x227f380f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.365649:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x227f380f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.365857:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e3ef lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x44a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.365866:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e3ef lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.365874:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e3ef lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.366725:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].150, 64 off17792 00010000:00010000:2.0:1788572216.366804:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e3ef lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.366817:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e3ef lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x44a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.366825:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e3ef lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.366830:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.366834:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e3ef lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.366843:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e3ef lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x44a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.366856:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x44a:0x0].0x0 (ffff94e502297000) 00010000:00010000:2.0:1788572216.366860:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.366864:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e3ef lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x44a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.366871:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e3ef lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x44a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.367153:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.367162:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3e1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.367168:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.367173:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.367177:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.367184:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3e1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.367193:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297f00) 00010000:00010000:2.0:1788572216.367195:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.367199:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3e1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.367205:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e3e1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.367219:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d9f8f72 reply state 0000000040245939 transno 214748367099 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x227f380f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.367231:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x227f380f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.367239:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x227f380f (ffff94e502297300) 00010000:00010000:2.0:1788572216.367242:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.367244:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.367548:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.367570:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.367573:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367100 00000020:00080000:2.0:1788572216.367578:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.367580:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367100 00000100:00100000:1.0:1788572216.370533:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.370714:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615154688 00000100:00100000:3.0:1788572216.370727:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615154688 00000100:00100000:3.0:1788572216.370798:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10952 00000100:00100000:3.0:1788572216.370808:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+604:2382:x1875449615154688:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.370832:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367100, current: 214748367100, replaying 00000100:00100000:3.0:1788572216.370854:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+604:2382:x1875449615154688:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 48us (332us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.370861:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10952 00000020:00080000:2.0:1788572216.370932:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.370937:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367100, next_transno: 214748367100 00010000:00080000:2.0:1788572216.370943:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367100) 00000020:00080000:2.0:1788572216.370946:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.370957:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615154688 t214748367100 from 192.168.202.13@tcp req@ffff94e63c504e00 x1875449615154688/t0(214748367100) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.371085:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e3f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371102:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e3f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371114:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e3f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371128:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371134:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371140:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371345:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e404 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x44b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371357:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e404 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371364:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e404 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.371829:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].150, 64 off17792 00010000:00010000:2.0:1788572216.371898:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e404 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371907:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e404 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x44b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371914:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e404 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371919:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.371923:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e404 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371931:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e404 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x44b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371945:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x44b:0x0].0x0 (ffff94e502297c00) 00010000:00010000:2.0:1788572216.371948:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.371953:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e404 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x44b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.371960:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e404 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x44b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.372095:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e3f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.372106:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e3f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.372112:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e3f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.372120:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.372124:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e3f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.372130:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e3f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.372137:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297800) 00010000:00010000:2.0:1788572216.372140:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.372145:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e3f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.372152:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e3f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.372167:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000cedbfb0 reply state 000000001e0b3083 transno 214748367100 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.372178:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.372187:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa8e291c8 (ffff94e502297200) 00010000:00010000:2.0:1788572216.372190:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.372192:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.372520:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.372542:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.372545:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367101 00000020:00080000:2.0:1788572216.372549:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.372551:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367101 00000100:00100000:3.0:1788572216.375762:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.375850:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615155072 00000100:00100000:2.0:1788572216.375861:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615155072 00000100:00100000:2.0:1788572216.375940:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10953 00000100:00100000:2.0:1788572216.375952:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+606:2382:x1875449615155072:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.375974:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367101, current: 214748367101, replaying 00000100:00100000:2.0:1788572216.376000:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+606:2382:x1875449615155072:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 50us (251us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.376045:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10953 00000020:00080000:3.0:1788572216.376235:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.376240:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367101, next_transno: 214748367101 00010000:00080000:3.0:1788572216.376244:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367101) 00000020:00080000:3.0:1788572216.376247:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.376257:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615155072 t214748367101 from 192.168.202.13@tcp req@ffff94e6349e9500 x1875449615155072/t0(214748367101) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.376365:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e40b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376392:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e40b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376405:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e40b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376419:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376427:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376435:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376612:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e419 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x44c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376621:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e419 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376628:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e419 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.376884:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].151, 64 off17856 00010000:00010000:3.0:1788572216.376962:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e419 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376970:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e419 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376977:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e419 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376983:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.376987:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e419 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.376994:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e419 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.377040:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x44c:0x0].0x0 (ffff94e613194200) 00010000:00010000:3.0:1788572216.377043:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.377048:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e419 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.377057:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e419 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x44c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.377075:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e40b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.377081:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e40b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.377086:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e40b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.377091:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.377094:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e40b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.377100:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e40b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.377107:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194f00) 00010000:00010000:3.0:1788572216.377109:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.377112:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e40b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.377117:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e40b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.377129:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091bb029c reply state 00000000461b4b3f transno 214748367101 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.377140:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.377147:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd6028a99 (ffff94e613194d00) 00010000:00010000:3.0:1788572216.377149:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.377152:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.377235:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.377253:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.377256:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367102 00000020:00080000:3.0:1788572216.377260:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.377262:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367102 00000100:00100000:1.0:1788572216.381461:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.381565:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615155456 00000100:00100000:0.0:1788572216.381575:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615155456 00000100:00100000:0.0:1788572216.381635:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10954 00000100:00100000:0.0:1788572216.381645:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+608:2382:x1875449615155456:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.381676:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367102, current: 214748367102, replaying 00000100:00100000:0.0:1788572216.381699:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+608:2382:x1875449615155456:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 57us (253us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.381707:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10954 00000020:00080000:2.0:1788572216.381754:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.381758:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367102, next_transno: 214748367102 00010000:00080000:2.0:1788572216.381763:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367102) 00000020:00080000:2.0:1788572216.381766:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.381776:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615155456 t214748367102 from 192.168.202.13@tcp req@ffff94e61e57ca80 x1875449615155456/t0(214748367102) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.381869:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e420 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.381884:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e420 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.381907:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e420 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.381925:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd485e452 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.381932:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd485e452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.381939:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd485e452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382137:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e42e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x44d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382146:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e42e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382153:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e42e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.382339:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].151, 64 off17856 00010000:00010000:2.0:1788572216.382388:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e42e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382395:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e42e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x44d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382402:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e42e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382407:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.382411:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e42e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382417:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e42e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x44d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382429:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x44d:0x0].0x0 (ffff94e502297900) 00010000:00010000:2.0:1788572216.382432:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.382437:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e42e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x44d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382447:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e42e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x44d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382467:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e420 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382473:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e420 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382479:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e420 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382484:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.382487:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e420 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382493:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e420 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382506:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297f00) 00010000:00010000:2.0:1788572216.382508:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.382511:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e420 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382516:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e420 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.382529:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fc2e742 reply state 00000000a8ff3f3c transno 214748367102 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd485e452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382539:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd485e452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.382545:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd485e452 (ffff94e502297000) 00010000:00010000:2.0:1788572216.382547:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.382550:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.382651:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.382676:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.382679:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367103 00000020:00080000:2.0:1788572216.382683:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.382685:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367103 00000100:00100000:2.0:1788572216.385181:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.385338:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615155840 00000100:00100000:3.0:1788572216.385349:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615155840 00000100:00100000:3.0:1788572216.385414:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10955 00000100:00100000:3.0:1788572216.385424:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+610:2382:x1875449615155840:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.385450:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367103, current: 214748367103, replaying 00000100:00100000:3.0:1788572216.385468:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+610:2382:x1875449615155840:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (298us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.385475:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10955 00000020:00080000:2.0:1788572216.385563:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.385566:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367103, next_transno: 214748367103 00010000:00080000:2.0:1788572216.385570:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367103) 00000020:00080000:2.0:1788572216.385573:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.385582:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615155840 t214748367103 from 192.168.202.13@tcp req@ffff94e641355500 x1875449615155840/t0(214748367103) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.385689:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e435 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.385704:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e435 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.385715:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e435 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.385726:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.385732:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.385738:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.385908:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e443 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x44e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.385915:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e443 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.385922:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e443 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.386178:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].152, 64 off17920 00010000:00010000:2.0:1788572216.386229:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e443 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386237:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e443 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x44e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386243:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e443 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386248:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.386252:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e443 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386258:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e443 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x44e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386269:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x44e:0x0].0x0 (ffff94e63a94e000) 00010000:00010000:2.0:1788572216.386271:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.386275:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e443 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x44e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386282:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e443 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x44e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386299:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e435 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386304:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e435 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386309:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e435 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386314:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.386316:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e435 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386321:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e435 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386326:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297800) 00010000:00010000:2.0:1788572216.386328:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.386330:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e435 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386335:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e435 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.386343:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5da77cc reply state 00000000d269454c transno 214748367103 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386357:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.386363:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f5b580a (ffff94e502297c00) 00010000:00010000:2.0:1788572216.386365:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.386367:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.386557:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.386573:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.386576:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367104 00000020:00080000:2.0:1788572216.386580:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.386582:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367104 00000100:00100000:1.0:1788572216.390401:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.390470:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615156224 00000100:00100000:2.0:1788572216.390480:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615156224 00000100:00100000:2.0:1788572216.390536:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10956 00000100:00100000:2.0:1788572216.390545:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+612:2382:x1875449615156224:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.390566:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367104, current: 214748367104, replaying 00000100:00100000:2.0:1788572216.390586:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+612:2382:x1875449615156224:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (202us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.390593:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10956 00000020:00080000:3.0:1788572216.390708:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.390712:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367104, next_transno: 214748367104 00010000:00080000:3.0:1788572216.390716:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367104) 00000020:00080000:3.0:1788572216.390719:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.390728:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615156224 t214748367104 from 192.168.202.13@tcp req@ffff94e61e57d500 x1875449615156224/t0(214748367104) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.390814:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e44a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.390828:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e44a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.390839:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e44a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.390850:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.390856:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.390862:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.391061:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e458 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x44f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.391069:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e458 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.391075:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e458 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.391432:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].152, 64 off17920 00010000:00010000:2.0:1788572216.391488:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e458 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x44f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391500:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e458 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x44f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391507:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e458 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391516:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.391520:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e458 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x44f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391527:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e458 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x44f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391539:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x44f:0x0].0x0 (ffff94e613194400) 00010000:00010000:2.0:1788572216.391542:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.391546:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e458 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x44f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391552:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e458 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x44f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391581:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e44a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391586:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e44a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391591:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e44a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391596:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.391598:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e44a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391605:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e44a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391616:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194f00) 00010000:00010000:2.0:1788572216.391618:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.391621:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e44a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391627:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e44a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.391638:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004651ad07 reply state 00000000efc3558d transno 214748367104 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391649:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.391659:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x63bcc83 (ffff94e613194200) 00010000:00010000:2.0:1788572216.391662:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.391673:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.391748:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.391765:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.391771:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367105 00000020:00080000:2.0:1788572216.391775:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.391777:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367105 00000100:00100000:1.0:1788572216.395196:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.395289:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615156608 00000100:00100000:0.0:1788572216.395302:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615156608 00000100:00100000:0.0:1788572216.395358:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10957 00000100:00100000:0.0:1788572216.395366:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+614:2382:x1875449615156608:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.395391:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367105, current: 214748367105, replaying 00000100:00100000:0.0:1788572216.395405:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+614:2382:x1875449615156608:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (220us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.395412:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10957 00000020:00080000:2.0:1788572216.395458:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.395463:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367105, next_transno: 214748367105 00010000:00080000:2.0:1788572216.395467:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367105) 00000020:00080000:2.0:1788572216.395470:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.395480:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615156608 t214748367105 from 192.168.202.13@tcp req@ffff94e61e57fb80 x1875449615156608/t0(214748367105) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.395582:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e45f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.395598:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e45f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.395610:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e45f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.395622:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2969b984 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.395630:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2969b984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.395636:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2969b984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.395819:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e46d lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x450:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.395827:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e46d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x450:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.395833:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e46d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x450:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.396090:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].153, 64 off17984 00010000:00010000:2.0:1788572216.396146:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e46d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x450:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396153:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e46d lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x450:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396160:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e46d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x450:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396165:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.396169:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e46d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x450:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396175:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e46d lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x450:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396186:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x450:0x0].0x0 (ffff94e64217c600) 00010000:00010000:2.0:1788572216.396189:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.396193:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e46d lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x450:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396198:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e46d lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x450:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396215:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e45f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396220:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e45f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396226:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e45f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396230:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.396233:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e45f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396242:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e45f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396247:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297f00) 00010000:00010000:2.0:1788572216.396249:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.396251:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e45f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396256:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e45f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.396265:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1179137 reply state 00000000165ce0a1 transno 214748367105 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2969b984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396273:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2969b984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.396278:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2969b984 (ffff94e502297900) 00010000:00010000:2.0:1788572216.396280:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.396282:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.396360:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.396375:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.396378:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367106 00000020:00080000:2.0:1788572216.396382:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.396384:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367106 00000100:00100000:3.0:1788572216.399885:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.400052:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615156992 00000100:00100000:2.0:1788572216.400062:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615156992 00000100:00100000:2.0:1788572216.400130:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10958 00000100:00100000:2.0:1788572216.400142:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+616:2382:x1875449615156992:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.400167:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367106, current: 214748367106, replaying 00000100:00100000:2.0:1788572216.400183:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+616:2382:x1875449615156992:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (311us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.400190:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10958 00000020:00080000:3.0:1788572216.400305:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.400310:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367106, next_transno: 214748367106 00010000:00080000:3.0:1788572216.400315:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367106) 00000020:00080000:3.0:1788572216.400317:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.400328:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615156992 t214748367106 from 192.168.202.13@tcp req@ffff94e6349eb480 x1875449615156992/t0(214748367106) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.400426:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e474 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.400442:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e474 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.400455:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e474 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.400469:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.400477:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.400484:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.400656:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e482 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x451:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.400676:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e482 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x451:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.400684:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e482 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x451:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.401289:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].153, 64 off17984 00010000:00010000:3.0:1788572216.401345:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e482 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x451:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401352:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e482 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x451:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401359:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e482 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x451:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401365:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.401369:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e482 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x451:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401376:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e482 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x451:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401449:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x451:0x0].0x0 (ffff94e613194900) 00010000:00010000:3.0:1788572216.401453:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.401458:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e482 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x451:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401464:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e482 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x451:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401486:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e474 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401492:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e474 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401501:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e474 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401507:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.401510:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e474 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401515:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e474 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401526:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194100) 00010000:00010000:3.0:1788572216.401530:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.401533:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e474 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401539:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e474 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.401549:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a41d3e7 reply state 00000000df5a0474 transno 214748367106 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401559:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.401565:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdd2e0dfd (ffff94e613194c00) 00010000:00010000:3.0:1788572216.401567:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.401569:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.401707:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.401834:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.401838:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367107 00000020:00080000:3.0:1788572216.401842:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.401845:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367107 00000100:00100000:1.0:1788572216.405481:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.405783:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615157376 00000100:00100000:2.0:1788572216.405793:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615157376 00000100:00100000:2.0:1788572216.405890:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10959 00000100:00100000:2.0:1788572216.405918:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+618:2382:x1875449615157376:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.405940:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367107, current: 214748367107, replaying 00000100:00100000:2.0:1788572216.405960:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+618:2382:x1875449615157376:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 51us (491us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.405967:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10959 00000020:00080000:3.0:1788572216.406036:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.406040:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367107, next_transno: 214748367107 00010000:00080000:3.0:1788572216.406044:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367107) 00000020:00080000:3.0:1788572216.406048:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.406057:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615157376 t214748367107 from 192.168.202.13@tcp req@ffff94e61e57e680 x1875449615157376/t0(214748367107) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.406149:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e489 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406163:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e489 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406175:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e489 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406187:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406194:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406201:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406378:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e497 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x452:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406397:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e497 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x452:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406404:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e497 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x452:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.406653:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].154, 64 off18048 00010000:00010000:3.0:1788572216.406715:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e497 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x452:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406724:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e497 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x452:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406732:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e497 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x452:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406737:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.406740:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e497 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x452:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406748:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e497 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x452:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406760:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x452:0x0].0x0 (ffff94e613194600) 00010000:00010000:3.0:1788572216.406763:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.406767:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e497 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x452:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406773:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e497 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x452:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406793:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e489 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406800:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e489 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406806:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e489 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406811:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.406814:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e489 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406824:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e489 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406831:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194e00) 00010000:00010000:3.0:1788572216.406834:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.406836:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e489 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406843:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e489 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.406854:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f126fab reply state 0000000023f89c6f transno 214748367107 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406864:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.406870:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaaa946a6 (ffff94e613194300) 00010000:00010000:3.0:1788572216.406872:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.406876:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.406961:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.406980:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.406983:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367108 00000020:00080000:3.0:1788572216.406986:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.406989:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367108 00000100:00100000:1.0:1788572216.410660:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.410764:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615157760 00000100:00100000:0.0:1788572216.410775:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615157760 00000100:00100000:0.0:1788572216.410837:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10960 00000100:00100000:0.0:1788572216.410847:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+620:2382:x1875449615157760:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.410870:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367108, current: 214748367108, replaying 00000100:00100000:0.0:1788572216.410901:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+620:2382:x1875449615157760:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 50us (246us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.410915:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10960 00000020:00080000:2.0:1788572216.411181:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.411186:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367108, next_transno: 214748367108 00010000:00080000:2.0:1788572216.411191:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367108) 00000020:00080000:2.0:1788572216.411194:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.411203:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615157760 t214748367108 from 192.168.202.13@tcp req@ffff94e62d2f0e00 x1875449615157760/t0(214748367108) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.411300:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e49e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411316:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e49e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411328:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e49e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411345:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3d03405f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411352:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3d03405f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411359:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3d03405f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411530:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4ac lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x453:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411539:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4ac lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x453:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411545:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4ac lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x453:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.411781:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].154, 64 off18048 00010000:00010000:2.0:1788572216.411839:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4ac lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x453:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411848:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4ac lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x453:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411854:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4ac lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x453:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411859:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.411863:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4ac lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x453:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411874:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4ac lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x453:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411886:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x453:0x0].0x0 (ffff94e64217cc00) 00010000:00010000:2.0:1788572216.411889:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.411903:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4ac lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x453:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411916:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4ac lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x453:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411937:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e49e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411943:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e49e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411949:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e49e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411955:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.411957:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e49e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411963:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e49e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411971:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e64217c600) 00010000:00010000:2.0:1788572216.411973:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.411976:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e49e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.411985:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e49e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.411998:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000013998cb reply state 00000000e89b5912 transno 214748367108 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3d03405f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.412052:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d03405f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.412058:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d03405f (ffff94e64217c800) 00010000:00010000:2.0:1788572216.412061:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.412063:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.412627:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.412651:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.412655:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367109 00000020:00080000:2.0:1788572216.412659:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.412661:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367109 00000100:00100000:0.0:1788572216.416790:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.416869:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615158144 00000100:00100000:2.0:1788572216.416880:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615158144 00000100:00100000:2.0:1788572216.416954:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10961 00000100:00100000:2.0:1788572216.416965:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+622:2382:x1875449615158144:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.416985:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367109, current: 214748367109, replaying 00000100:00100000:2.0:1788572216.417039:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+622:2382:x1875449615158144:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 76us (259us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.417046:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10961 00000020:00080000:3.0:1788572216.417121:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.417126:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367109, next_transno: 214748367109 00010000:00080000:3.0:1788572216.417130:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367109) 00000020:00080000:3.0:1788572216.417133:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.417145:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615158144 t214748367109 from 192.168.202.13@tcp req@ffff94e60fc3fb80 x1875449615158144/t0(214748367109) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.417262:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417277:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417289:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417301:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417308:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417314:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417511:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4c1 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x454:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417519:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4c1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x454:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417526:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4c1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x454:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.417767:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].155, 64 off18112 00010000:00010000:3.0:1788572216.417828:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4c1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x454:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417840:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4c1 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x454:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417848:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4c1 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x454:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417854:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.417859:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4c1 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x454:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417867:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4c1 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x454:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417879:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x454:0x0].0x0 (ffff94e613194100) 00010000:00010000:3.0:1788572216.417882:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.417887:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4c1 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x454:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417893:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4c1 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x454:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417912:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417918:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4b3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417924:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417929:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.417932:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417939:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4b3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417947:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194e00) 00010000:00010000:3.0:1788572216.417950:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.417952:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4b3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417958:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4b3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.417969:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000138fcf0a reply state 000000000f164169 transno 214748367109 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417980:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.417986:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5aa6ad60 (ffff94e613194600) 00010000:00010000:3.0:1788572216.417989:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.417991:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.418116:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.418137:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.418139:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367110 00000020:00080000:3.0:1788572216.418144:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.418146:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367110 00000100:00100000:1.0:1788572216.420929:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.421050:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615158528 00000100:00100000:0.0:1788572216.421062:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615158528 00000100:00100000:0.0:1788572216.421123:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10962 00000100:00100000:0.0:1788572216.421134:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+624:2382:x1875449615158528:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.421156:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367110, current: 214748367110, replaying 00000100:00100000:0.0:1788572216.421170:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+624:2382:x1875449615158528:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 38us (262us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.421178:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10962 00000020:00080000:3.0:1788572216.421308:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.421313:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367110, next_transno: 214748367110 00010000:00080000:3.0:1788572216.421317:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367110) 00000020:00080000:3.0:1788572216.421321:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.421331:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615158528 t214748367110 from 192.168.202.13@tcp req@ffff94e62d2f1c00 x1875449615158528/t0(214748367110) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.421494:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e4c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.421511:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e4c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.421529:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e4c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.421545:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.421552:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.421558:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.421751:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e4d6 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x455:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.421760:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e4d6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x455:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.421767:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e4d6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x455:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.422001:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].155, 64 off18112 00010000:00010000:3.0:1788572216.422089:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e4d6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x455:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422098:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e4d6 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x455:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422105:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e4d6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x455:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422111:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.422116:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e4d6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x455:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422125:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e4d6 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x455:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422138:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x455:0x0].0x0 (ffff94e613194400) 00010000:00010000:3.0:1788572216.422141:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.422147:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e4d6 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x455:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422154:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e4d6 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x455:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422173:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e4c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422179:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e4c8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422185:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e4c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422496:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.422501:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e4c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422512:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e4c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422521:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194900) 00010000:00010000:3.0:1788572216.422523:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.422529:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e4c8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422535:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e4c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.422551:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f596915 reply state 000000003dc000eb transno 214748367110 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422562:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.422571:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9bb01d9 (ffff94e613194f00) 00010000:00010000:3.0:1788572216.422573:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.422576:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.423181:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.423208:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.423212:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367111 00000020:00080000:2.0:1788572216.423216:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.423218:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367111 00000100:00100000:2.0:1788572216.427107:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.427226:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615158912 00000100:00100000:0.0:1788572216.427237:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615158912 00000100:00100000:0.0:1788572216.427396:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10963 00000100:00100000:0.0:1788572216.427407:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+626:2382:x1875449615158912:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.427427:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367111, current: 214748367111, replaying 00000100:00100000:0.0:1788572216.427444:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+626:2382:x1875449615158912:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (350us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.427451:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10963 00000020:00080000:2.0:1788572216.427493:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.427498:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367111, next_transno: 214748367111 00010000:00080000:2.0:1788572216.427503:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367111) 00000020:00080000:2.0:1788572216.427506:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.427515:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615158912 t214748367111 from 192.168.202.13@tcp req@ffff94e50552f480 x1875449615158912/t0(214748367111) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.427647:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e4dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.427674:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e4dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.427688:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e4dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.427703:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x458adb52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.427710:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x458adb52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.427716:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x458adb52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.427918:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e4eb lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x456:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.427931:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e4eb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x456:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.427938:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e4eb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x456:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.428180:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].156, 64 off18176 00010000:00010000:2.0:1788572216.428236:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e4eb lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x456:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428244:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e4eb lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x456:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428252:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e4eb lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x456:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428258:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.428263:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e4eb lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x456:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428270:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e4eb lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x456:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428295:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x456:0x0].0x0 (ffff94e502297f00) 00010000:00010000:2.0:1788572216.428299:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.428306:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e4eb lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x456:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428313:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e4eb lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x456:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428336:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e4dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428342:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e4dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428346:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e4dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428351:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.428354:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e4dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428360:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e4dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428368:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e64217c600) 00010000:00010000:2.0:1788572216.428371:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.428374:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e4dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428379:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e4dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.428390:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006544f5e1 reply state 00000000b0f00933 transno 214748367111 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x458adb52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428399:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x458adb52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.428405:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x458adb52 (ffff94e64217cc00) 00010000:00010000:2.0:1788572216.428408:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.428411:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.428496:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.428519:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.428522:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367112 00000020:00080000:2.0:1788572216.428526:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.428528:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367112 00000100:00100000:3.0:1788572216.431765:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.431873:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615159296 00000100:00100000:2.0:1788572216.431885:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615159296 00000100:00100000:2.0:1788572216.431968:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10964 00000100:00100000:2.0:1788572216.431979:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+628:2382:x1875449615159296:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.432001:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367112, current: 214748367112, replaying 00000100:00100000:2.0:1788572216.432045:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+628:2382:x1875449615159296:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 69us (290us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.432052:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10964 00000020:00080000:3.0:1788572216.432152:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.432156:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367112, next_transno: 214748367112 00010000:00080000:3.0:1788572216.432160:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367112) 00000020:00080000:3.0:1788572216.432162:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.432172:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615159296 t214748367112 from 192.168.202.13@tcp req@ffff94e6349e9180 x1875449615159296/t0(214748367112) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.432263:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432281:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432302:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432314:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xade4d50b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432320:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xade4d50b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432327:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xade4d50b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432528:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e500 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x457:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432538:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e500 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x457:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432544:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e500 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x457:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.432792:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].156, 64 off18176 00010000:00010000:3.0:1788572216.432846:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e500 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x457:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432854:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e500 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x457:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432861:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e500 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x457:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432867:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.432872:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e500 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x457:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432880:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e500 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x457:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432892:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x457:0x0].0x0 (ffff94e613194700) 00010000:00010000:3.0:1788572216.432895:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.432899:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e500 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x457:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432907:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e500 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x457:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432939:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432945:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432952:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432957:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.432960:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432966:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432978:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194e00) 00010000:00010000:3.0:1788572216.432980:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.432983:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.432988:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e4f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.432999:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cefd971a reply state 00000000863e13dd transno 214748367112 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xade4d50b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.433043:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade4d50b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.433049:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xade4d50b (ffff94e613194100) 00010000:00010000:3.0:1788572216.433051:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.433054:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.433129:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.433143:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.433146:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367113 00000020:00080000:3.0:1788572216.433150:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.433152:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367113 00000100:00100000:1.0:1788572216.436428:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.436556:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615159680 00000100:00100000:2.0:1788572216.436566:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615159680 00000100:00100000:2.0:1788572216.436637:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10965 00000100:00100000:2.0:1788572216.436647:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+630:2382:x1875449615159680:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.436676:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367113, current: 214748367113, replaying 00000100:00100000:2.0:1788572216.436693:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+630:2382:x1875449615159680:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 49us (278us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.436700:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10965 00000020:00080000:3.0:1788572216.436804:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.436809:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367113, next_transno: 214748367113 00010000:00080000:3.0:1788572216.436812:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367113) 00000020:00080000:3.0:1788572216.436815:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.436824:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615159680 t214748367113 from 192.168.202.13@tcp req@ffff94e6412b2d80 x1875449615159680/t0(214748367113) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.436934:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e507 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.436951:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e507 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.436963:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e507 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.436977:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.436983:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.436989:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437184:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e515 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x458:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437193:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e515 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x458:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437200:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e515 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x458:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.437715:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].157, 64 off18240 00010000:00010000:3.0:1788572216.437784:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e515 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x458:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437792:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e515 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x458:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437798:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e515 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x458:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437804:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.437808:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e515 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x458:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437817:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e515 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x458:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437829:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x458:0x0].0x0 (ffff94e6029e1200) 00010000:00010000:3.0:1788572216.437833:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.437838:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e515 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x458:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437844:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e515 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x458:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437869:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e507 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437874:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e507 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437880:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e507 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437884:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.437886:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e507 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437909:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e507 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437916:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194500) 00010000:00010000:3.0:1788572216.437919:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.437922:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e507 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437927:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e507 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.437940:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e736ff3b reply state 00000000cc162c2a transno 214748367113 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437952:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.437959:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc7d44518 (ffff94e618898000) 00010000:00010000:3.0:1788572216.437961:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.437964:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.438595:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.438621:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.438625:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367114 00000020:00080000:3.0:1788572216.438629:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.438631:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367114 00000100:00100000:1.0:1788572216.445170:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.445308:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615160064 00000100:00100000:3.0:1788572216.445318:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615160064 00000100:00100000:3.0:1788572216.445459:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10966 00000100:00100000:3.0:1788572216.445473:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+632:2382:x1875449615160064:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.445497:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367114, current: 214748367114, replaying 00000100:00100000:3.0:1788572216.445557:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+632:2382:x1875449615160064:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 89us (398us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.445563:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10966 00000020:00080000:1.0:1788572216.445796:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.445801:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367114, next_transno: 214748367114 00010000:00080000:1.0:1788572216.445805:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367114) 00000020:00080000:1.0:1788572216.445809:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.445817:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615160064 t214748367114 from 192.168.202.13@tcp req@ffff94e6412b1500 x1875449615160064/t0(214748367114) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.446222:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e51c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.446240:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e51c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.446253:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e51c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.446268:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.446274:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.446337:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.446588:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e52a lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x459:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.446597:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e52a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x459:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.446604:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e52a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x459:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.446835:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].157, 64 off18240 00010000:00010000:2.0:1788572216.447129:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e52a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x459:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.447138:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e52a lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x459:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.447145:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e52a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x459:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.447151:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.447156:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e52a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x459:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.447164:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e52a lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x459:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.447177:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x459:0x0].0x0 (ffff94e6118ebd00) 00010000:00010000:2.0:1788572216.447180:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.447185:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e52a lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x459:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.447192:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e52a lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x459:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.447216:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e51c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.452110:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e51c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.452121:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e51c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.452127:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.452132:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e51c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.452141:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e51c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.452159:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297800) 00010000:00010000:2.0:1788572216.452162:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.452169:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e51c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.452176:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e51c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.452206:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b293ca9 reply state 0000000093ca2805 transno 214748367114 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.452219:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.452226:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7e6ea93d (ffff94e63a94e000) 00010000:00010000:2.0:1788572216.452229:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.452232:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.452752:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.452773:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.452777:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367115 00000020:00080000:2.0:1788572216.452781:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.452783:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367115 00000100:00100000:1.0:1788572216.455677:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.455766:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615160448 00000100:00100000:3.0:1788572216.455778:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615160448 00000100:00100000:3.0:1788572216.455845:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10967 00000100:00100000:3.0:1788572216.455856:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+634:2382:x1875449615160448:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.455878:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367115, current: 214748367115, replaying 00000100:00100000:3.0:1788572216.456188:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+634:2382:x1875449615160448:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 332us (530us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.456194:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10967 00000020:00080000:0.0:1788572216.456737:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.456743:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367115, next_transno: 214748367115 00010000:00080000:0.0:1788572216.456749:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367115) 00000020:00080000:0.0:1788572216.456753:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.456763:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615160448 t214748367115 from 192.168.202.13@tcp req@ffff94e6412b2680 x1875449615160448/t0(214748367115) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.456875:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e531 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.456891:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e531 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457142:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e531 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457158:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x40600692 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457171:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x40600692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457177:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x40600692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457482:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e53f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x45a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457492:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e53f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457499:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e53f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.457752:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].158, 64 off18304 00010000:00010000:0.0:1788572216.457810:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e53f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457819:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e53f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x45a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457825:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e53f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457831:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.457835:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e53f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457842:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e53f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x45a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457857:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x45a:0x0].0x0 (ffff94e619d6fc00) 00010000:00010000:0.0:1788572216.457860:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.457865:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e53f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x45a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457871:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e53f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x45a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.457890:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e531 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.458145:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e531 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.458151:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e531 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.458156:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.458159:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e531 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.458166:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e531 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.458175:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6414be200) 00010000:00010000:0.0:1788572216.458177:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.458180:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e531 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.458185:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e531 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.458201:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000752ad141 reply state 0000000012f65f52 transno 214748367115 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x40600692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.458210:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40600692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.458217:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x40600692 (ffff94e6414bee00) 00010000:00010000:0.0:1788572216.458219:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.458222:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.458467:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.458486:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.458489:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367116 00000020:00080000:0.0:1788572216.458493:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.458495:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367116 00000100:00100000:2.0:1788572216.461466:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.461556:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615160832 00000100:00100000:1.0:1788572216.461567:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615160832 00000100:00100000:1.0:1788572216.461656:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10968 00000100:00100000:1.0:1788572216.461676:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+636:2382:x1875449615160832:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.461697:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367116, current: 214748367116, replaying 00000100:00100000:1.0:1788572216.461717:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+636:2382:x1875449615160832:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 53us (262us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.461724:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10968 00000020:00080000:2.0:1788572216.461760:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.461764:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367116, next_transno: 214748367116 00010000:00080000:2.0:1788572216.461768:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367116) 00000020:00080000:2.0:1788572216.461771:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.461781:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615160832 t214748367116 from 192.168.202.13@tcp req@ffff94e50552d880 x1875449615160832/t0(214748367116) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.461875:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e546 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.461895:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e546 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.461906:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e546 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.461928:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.461935:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.461941:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462157:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e554 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x45b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462166:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e554 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462173:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e554 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.462613:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].158, 64 off18304 00010000:00010000:2.0:1788572216.462683:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e554 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462691:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e554 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x45b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462699:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e554 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462706:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.462711:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e554 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462719:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e554 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x45b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462731:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x45b:0x0].0x0 (ffff94e6158d6d00) 00010000:00010000:2.0:1788572216.462735:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.462739:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e554 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x45b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462746:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e554 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x45b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462765:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e546 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462772:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e546 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462778:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e546 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462783:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.462786:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e546 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462792:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e546 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462803:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e64217c600) 00010000:00010000:2.0:1788572216.462805:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.462808:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e546 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462815:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e546 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.462825:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029018d97 reply state 00000000d96ab651 transno 214748367116 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462837:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.462843:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94d0eb5f (ffff94e502297f00) 00010000:00010000:2.0:1788572216.462846:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.462848:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.462962:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.462980:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.462983:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367117 00000020:00080000:2.0:1788572216.462988:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.462990:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367117 00000100:00100000:0.0:1788572216.466494:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.466593:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615161216 00000100:00100000:3.0:1788572216.466603:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615161216 00000100:00100000:3.0:1788572216.466721:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10969 00000100:00100000:3.0:1788572216.466733:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+638:2382:x1875449615161216:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.466754:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367117, current: 214748367117, replaying 00000100:00100000:3.0:1788572216.466772:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+638:2382:x1875449615161216:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (289us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.466778:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10969 00000020:00080000:2.0:1788572216.466815:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.466820:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367117, next_transno: 214748367117 00010000:00080000:2.0:1788572216.466824:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367117) 00000020:00080000:2.0:1788572216.466827:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.466836:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615161216 t214748367117 from 192.168.202.13@tcp req@ffff94e60fc3d180 x1875449615161216/t0(214748367117) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.466950:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e55b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.466965:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e55b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.466976:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e55b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.466988:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x652233b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.466994:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x652233b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467000:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x652233b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467214:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e569 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x45c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467222:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e569 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467229:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e569 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.467595:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].159, 64 off18368 00010000:00010000:2.0:1788572216.467649:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e569 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467656:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e569 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x45c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467673:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e569 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467680:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.467685:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e569 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467693:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e569 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x45c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467705:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x45c:0x0].0x0 (ffff94e60fa15f00) 00010000:00010000:2.0:1788572216.467709:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.467714:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e569 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x45c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467721:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e569 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x45c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467743:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e55b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467749:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e55b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467754:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e55b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467759:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.467762:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e55b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467771:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e55b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467779:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297800) 00010000:00010000:2.0:1788572216.467781:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.467784:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e55b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467789:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e55b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.467801:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe0fd7bf reply state 00000000c2bf74d3 transno 214748367117 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x652233b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467811:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x652233b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.467818:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x652233b4 (ffff94e6118ebd00) 00010000:00010000:2.0:1788572216.467820:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.467822:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.467902:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.469520:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.469529:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367118 00000020:00080000:2.0:1788572216.469535:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.469537:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367118 00000100:00100000:2.0:1788572216.470780:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.470870:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615161600 00000100:00100000:0.0:1788572216.470883:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615161600 00000100:00100000:0.0:1788572216.471136:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10970 00000100:00100000:0.0:1788572216.471147:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+640:2382:x1875449615161600:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.471172:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367118, current: 214748367118, replaying 00000100:00100000:0.0:1788572216.471230:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+640:2382:x1875449615161600:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 84us (458us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.471237:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10970 00000020:00080000:3.0:1788572216.471340:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.471345:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367118, next_transno: 214748367118 00010000:00080000:3.0:1788572216.471350:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367118) 00000020:00080000:3.0:1788572216.471353:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.471365:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615161600 t214748367118 from 192.168.202.13@tcp req@ffff94e50552d180 x1875449615161600/t0(214748367118) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.471533:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e570 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.471553:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e570 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.471564:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e570 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.471576:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.471583:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.471589:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.471772:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e57e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x45d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.471782:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e57e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.471788:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e57e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.472479:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].159, 64 off18368 00010000:00010000:2.0:1788572216.472536:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e57e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472550:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e57e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x45d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472557:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e57e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472562:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.472567:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e57e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472574:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e57e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x45d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472587:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x45d:0x0].0x0 (ffff94e613194e00) 00010000:00010000:2.0:1788572216.472590:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.472595:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e57e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x45d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472601:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e57e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x45d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472624:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e570 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472630:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e570 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472636:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e570 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472642:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.472646:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e570 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472652:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e570 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472660:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6029e1200) 00010000:00010000:2.0:1788572216.472672:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.472676:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e570 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472682:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e570 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.472696:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004006dec6 reply state 00000000a254b439 transno 214748367118 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472707:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.472714:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x907b9d19 (ffff94e613194500) 00010000:00010000:2.0:1788572216.472717:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.472719:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.472843:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.472861:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.472864:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367119 00000020:00080000:2.0:1788572216.472868:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.472870:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367119 00000100:00100000:2.0:1788572216.476210:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.476363:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615161984 00000100:00100000:0.0:1788572216.476376:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615161984 00000100:00100000:0.0:1788572216.476545:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10971 00000100:00100000:0.0:1788572216.476556:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+642:2382:x1875449615161984:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.476577:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367119, current: 214748367119, replaying 00000100:00100000:0.0:1788572216.476596:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+642:2382:x1875449615161984:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (402us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.476603:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10971 00000020:00080000:2.0:1788572216.476640:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.476644:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367119, next_transno: 214748367119 00010000:00080000:2.0:1788572216.476650:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367119) 00000020:00080000:2.0:1788572216.476653:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.476673:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615161984 t214748367119 from 192.168.202.13@tcp req@ffff94e50552ea00 x1875449615161984/t0(214748367119) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.476773:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e585 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.476793:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e585 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.476807:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e585 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.476822:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.476830:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.476837:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477065:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e593 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x45e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477075:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e593 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477083:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e593 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.477317:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].160, 64 off18432 00010000:00010000:2.0:1788572216.477374:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e593 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477393:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e593 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x45e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477402:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e593 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477408:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.477413:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e593 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477421:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e593 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x45e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477433:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x45e:0x0].0x0 (ffff94e60fa15800) 00010000:00010000:2.0:1788572216.477436:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.477441:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e593 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x45e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477448:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e593 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x45e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477470:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e585 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477477:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e585 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477483:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e585 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477493:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.477496:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e585 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477502:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e585 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477509:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15500) 00010000:00010000:2.0:1788572216.477512:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.477515:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e585 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477520:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e585 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.477534:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e8ba336 reply state 00000000c85424b8 transno 214748367119 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477546:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.477552:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x439cfa6e (ffff94e60fa15900) 00010000:00010000:2.0:1788572216.477554:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.477557:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.477642:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.477660:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.477673:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367120 00000020:00080000:2.0:1788572216.477677:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.477679:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367120 00000100:00100000:2.0:1788572216.480297:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.480863:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615162880 00000100:00100000:1.0:1788572216.480878:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615162880 00000100:00100000:1.0:1788572216.480960:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10972 00000100:00100000:1.0:1788572216.480974:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+644:2382:x1875449615162880:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.480995:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367120, current: 214748367120, replaying 00000100:00100000:1.0:1788572216.481033:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+644:2382:x1875449615162880:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 63us (759us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.481040:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10972 00000020:00080000:2.0:1788572216.481260:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.481265:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367120, next_transno: 214748367120 00010000:00080000:2.0:1788572216.481270:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367120) 00000020:00080000:2.0:1788572216.481273:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.481346:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615162880 t214748367120 from 192.168.202.13@tcp req@ffff94e50552c380 x1875449615162880/t0(214748367120) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.481501:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e59a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.481520:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e59a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.481533:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e59a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.481546:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.481552:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.481559:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.481741:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e5a8 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x45f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.481750:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e5a8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.481757:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e5a8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.482119:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].160, 64 off18432 00010000:00010000:2.0:1788572216.482168:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e5a8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x45f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482177:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e5a8 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x45f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482183:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e5a8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482189:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.482193:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e5a8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x45f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482201:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e5a8 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x45f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482212:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x45f:0x0].0x0 (ffff94e60fa15b00) 00010000:00010000:2.0:1788572216.482215:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.482219:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e5a8 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x45f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482226:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e5a8 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x45f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482244:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e59a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482249:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e59a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482260:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e59a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482265:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.482268:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e59a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482273:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e59a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482279:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15f00) 00010000:00010000:2.0:1788572216.482557:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.482562:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e59a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482567:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e59a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.482580:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0388345 reply state 000000006a76f6a1 transno 214748367120 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482591:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.482598:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55ddf3b (ffff94e60fa15000) 00010000:00010000:2.0:1788572216.482601:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.482604:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.482700:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:2.0:1788572216.482717:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.482720:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367121 00000020:00080000:2.0:1788572216.482725:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.482727:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367121 00000100:00100000:0.0:1788572216.485682:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.485746:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615163264 00000100:00100000:1.0:1788572216.485755:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615163264 00000100:00100000:1.0:1788572216.485808:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10973 00000100:00100000:1.0:1788572216.485817:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+646:2382:x1875449615163264:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.485840:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367121, current: 214748367121, replaying 00000100:00100000:1.0:1788572216.485859:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+646:2382:x1875449615163264:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 43us (196us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.485865:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10973 00000020:00080000:3.0:1788572216.485922:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.485927:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367121, next_transno: 214748367121 00010000:00080000:3.0:1788572216.485931:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367121) 00000020:00080000:3.0:1788572216.485935:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.485944:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615163264 t214748367121 from 192.168.202.13@tcp req@ffff94e60fc3f800 x1875449615163264/t0(214748367121) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.486186:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e5af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486203:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e5af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486216:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e5af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486228:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486235:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486242:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486486:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e5bd lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x460:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486495:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e5bd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x460:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486502:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e5bd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x460:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.486749:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].161, 64 off18496 00010000:00010000:1.0:1788572216.486811:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e5bd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x460:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486820:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e5bd lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x460:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486827:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e5bd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x460:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486833:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.486838:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e5bd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x460:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486846:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e5bd lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x460:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486860:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x460:0x0].0x0 (ffff94e602c23300) 00010000:00010000:1.0:1788572216.486863:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.486867:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e5bd lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x460:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486873:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e5bd lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x460:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486895:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e5af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486902:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e5af lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486972:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e5af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486980:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.486983:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e5af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486989:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e5af lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.486998:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7900) 00010000:00010000:1.0:1788572216.487000:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.487031:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e5af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.487038:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e5af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.487051:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091c07d0a reply state 00000000a4efec2b transno 214748367121 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.487062:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.487068:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24b7cda0 (ffff94e612b14800) 00010000:00010000:1.0:1788572216.487071:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.487074:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.487174:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.487195:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.487198:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367122 00000020:00080000:1.0:1788572216.487202:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.487204:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367122 00000100:00100000:0.0:1788572216.490262:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.490373:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615163648 00000100:00100000:1.0:1788572216.490502:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615163648 00000100:00100000:1.0:1788572216.490564:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10974 00000100:00100000:1.0:1788572216.490572:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+648:2382:x1875449615163648:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.490589:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367122, current: 214748367122, replaying 00000100:00100000:1.0:1788572216.490599:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+648:2382:x1875449615163648:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 29us (350us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.490603:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10974 00000020:00080000:1.0:1788572216.490617:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.490620:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367122, next_transno: 214748367122 00010000:00080000:1.0:1788572216.490623:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367122) 00000020:00080000:1.0:1788572216.490626:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.490634:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615163648 t214748367122 from 192.168.202.13@tcp req@ffff94e506553800 x1875449615163648/t0(214748367122) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.490769:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e5c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.490786:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.490798:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.490825:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x537231c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.490833:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x537231c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.490840:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x537231c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491062:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e5d2 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x461:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491069:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e5d2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x461:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491074:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e5d2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x461:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.491268:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].161, 64 off18496 00010000:00010000:1.0:1788572216.491485:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e5d2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x461:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491493:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e5d2 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x461:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491500:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e5d2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x461:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491507:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.491511:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e5d2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x461:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491519:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e5d2 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x461:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491532:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x461:0x0].0x0 (ffff94e61e543f00) 00010000:00010000:1.0:1788572216.491535:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.491541:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e5d2 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x461:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491547:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e5d2 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x461:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491568:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491575:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e5c4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491585:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491590:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.491593:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491599:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e5c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491606:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23200) 00010000:00010000:1.0:1788572216.491608:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.491611:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e5c4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491616:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e5c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.491628:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000599ce9a7 reply state 000000006172c15d transno 214748367122 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x537231c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491639:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x537231c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.491646:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x537231c5 (ffff94e61e543900) 00010000:00010000:1.0:1788572216.491648:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.491651:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.491770:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.491787:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.491789:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367123 00000020:00080000:1.0:1788572216.491793:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.491795:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367123 00000100:00100000:2.0:1788572216.494057:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.494100:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615164032 00000100:00100000:0.0:1788572216.494111:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615164032 00000100:00100000:0.0:1788572216.494157:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10975 00000100:00100000:0.0:1788572216.494164:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+650:2382:x1875449615164032:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.494180:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367123, current: 214748367123, replaying 00000100:00100000:0.0:1788572216.494194:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+650:2382:x1875449615164032:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 31us (148us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.494201:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10975 00000020:00080000:2.0:1788572216.494223:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.494228:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367123, next_transno: 214748367123 00010000:00080000:2.0:1788572216.494232:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367123) 00000020:00080000:2.0:1788572216.494235:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.494245:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615164032 t214748367123 from 192.168.202.13@tcp req@ffff94e50552dc00 x1875449615164032/t0(214748367123) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.494329:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e5d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.494345:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e5d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.494354:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e5d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.494363:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x262153c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.494367:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x262153c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.494371:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x262153c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.494968:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e5e7 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x462:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.494985:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e5e7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x462:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.494992:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e5e7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x462:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.495301:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].162, 64 off18560 00010000:00010000:2.0:1788572216.495362:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e5e7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x462:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495369:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e5e7 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x462:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495374:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e5e7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x462:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495378:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.495381:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e5e7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x462:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495390:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e5e7 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x462:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495404:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x462:0x0].0x0 (ffff94e60fa15200) 00010000:00010000:2.0:1788572216.495407:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.495411:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e5e7 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x462:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495467:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e5e7 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x462:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495491:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e5d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495539:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e5d9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495543:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e5d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495546:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.495548:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e5d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495551:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e5d9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495557:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15500) 00010000:00010000:2.0:1788572216.495558:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.495560:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e5d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495563:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e5d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.495572:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aeb23c0f reply state 00000000fcf6cc66 transno 214748367123 ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x262153c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495580:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x262153c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.495584:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x262153c8 (ffff94e60fa15800) 00010000:00010000:2.0:1788572216.495586:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.495588:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.495736:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.495824:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.495828:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367124 00000020:00080000:2.0:1788572216.495833:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.495836:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367124 00000100:00100000:0.0:1788572216.498745:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.498794:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615164416 00000100:00100000:2.0:1788572216.498804:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615164416 00000100:00100000:2.0:1788572216.498861:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10976 00000100:00100000:2.0:1788572216.498871:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+652:2382:x1875449615164416:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.498891:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367124, current: 214748367124, replaying 00000100:00100000:2.0:1788572216.498978:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+652:2382:x1875449615164416:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 108us (240us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.498985:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10976 00000020:00080000:1.0:1788572216.499060:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.499064:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367124, next_transno: 214748367124 00010000:00080000:1.0:1788572216.499068:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367124) 00000020:00080000:1.0:1788572216.499071:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.499082:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615164416 t214748367124 from 192.168.202.13@tcp req@ffff94e506550a80 x1875449615164416/t0(214748367124) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.499176:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e5ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499190:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e5ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499199:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e5ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499207:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499221:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499225:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499404:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e5fc lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x463:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499412:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e5fc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499431:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e5fc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.499633:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].162, 64 off18560 00010000:00010000:1.0:1788572216.499703:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e5fc lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499711:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e5fc lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499718:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e5fc lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499724:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.499728:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e5fc lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499737:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e5fc lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499751:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x463:0x0].0x0 (ffff94e61e543700) 00010000:00010000:1.0:1788572216.499754:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.499760:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e5fc lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499766:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e5fc lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x463:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499793:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e5ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499802:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e5ee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499808:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e5ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499813:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.499816:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e5ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499821:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e5ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499829:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543a00) 00010000:00010000:1.0:1788572216.499831:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.499833:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e5ee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499839:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e5ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.499851:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032b3bd0c reply state 0000000079b529fa transno 214748367124 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499862:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.499868:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x19d4ad81 (ffff94e61e543300) 00010000:00010000:1.0:1788572216.499871:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.499873:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.500221:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.500250:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.500253:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367125 00000020:00080000:1.0:1788572216.500257:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.500259:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367125 00000100:00100000:0.0:1788572216.503720:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.503818:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615164800 00000100:00100000:2.0:1788572216.503828:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615164800 00000100:00100000:2.0:1788572216.503905:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10977 00000100:00100000:2.0:1788572216.503917:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+654:2382:x1875449615164800:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.503940:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367125, current: 214748367125, replaying 00000100:00100000:2.0:1788572216.503961:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+654:2382:x1875449615164800:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (252us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.503968:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10977 00000020:00080000:1.0:1788572216.504127:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.504132:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367125, next_transno: 214748367125 00010000:00080000:1.0:1788572216.504136:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367125) 00000020:00080000:1.0:1788572216.504139:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.504150:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615164800 t214748367125 from 192.168.202.13@tcp req@ffff94e506552300 x1875449615164800/t0(214748367125) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.504244:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e603 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504261:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e603 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504273:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e603 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504284:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504291:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504298:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504489:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e611 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x464:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504499:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e611 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504506:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e611 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.504743:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].163, 64 off18624 00010000:00010000:1.0:1788572216.504799:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e611 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504808:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e611 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504816:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e611 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504823:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.504827:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e611 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504834:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e611 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504846:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x464:0x0].0x0 (ffff94e61e543800) 00010000:00010000:1.0:1788572216.504850:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.504855:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e611 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504861:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e611 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x464:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.504887:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e603 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.510682:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e603 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.510709:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e603 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.510716:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.510722:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e603 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.510734:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e603 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.510756:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543f00) 00010000:00010000:1.0:1788572216.510760:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.510766:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e603 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.510773:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e603 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.510810:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059bb7030 reply state 0000000004da8e82 transno 214748367125 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.510825:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.510833:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9b4c1a82 (ffff94e61e543600) 00010000:00010000:1.0:1788572216.510836:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.510840:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.511204:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.511227:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.511231:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367126 00000020:00080000:1.0:1788572216.511236:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.511238:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367126 00000100:00100000:2.0:1788572216.515154:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.515264:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615165184 00000100:00100000:0.0:1788572216.515275:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615165184 00000100:00100000:0.0:1788572216.515374:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10978 00000100:00100000:0.0:1788572216.515396:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+656:2382:x1875449615165184:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.515419:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367126, current: 214748367126, replaying 00000100:00100000:0.0:1788572216.515448:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+656:2382:x1875449615165184:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 65us (566us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.515454:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10978 00000020:00080000:2.0:1788572216.515494:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.515498:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367126, next_transno: 214748367126 00010000:00080000:2.0:1788572216.515504:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367126) 00000020:00080000:2.0:1788572216.515508:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.515517:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615165184 t214748367126 from 192.168.202.13@tcp req@ffff94e50552df80 x1875449615165184/t0(214748367126) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.515612:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e618 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.515629:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e618 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.515640:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e618 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.515652:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf2930efb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.515659:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2930efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.515676:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2930efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.515855:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e626 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x465:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.515865:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e626 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x465:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.515872:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e626 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x465:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.516162:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].163, 64 off18624 00010000:00010000:2.0:1788572216.516223:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e626 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x465:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516231:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e626 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x465:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516238:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e626 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x465:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516244:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a0a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.516249:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e626 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x465:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516257:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e626 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x465:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516269:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x465:0x0].0x0 (ffff94e60fa15100) 00010000:00010000:2.0:1788572216.516272:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.516277:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e626 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x465:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516284:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e626 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x465:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516309:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e618 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516315:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e618 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516321:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e618 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516330:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.516333:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e618 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516340:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e618 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516348:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15f00) 00010000:00010000:2.0:1788572216.516350:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.516353:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e618 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516358:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e618 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.516372:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8b4db07 reply state 000000004b8e7f86 transno 214748367126 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf2930efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516385:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf2930efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.516391:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf2930efb (ffff94e60fa15b00) 00010000:00010000:2.0:1788572216.516393:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.516396:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.516492:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.516510:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.516513:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367127 00000020:00080000:2.0:1788572216.516517:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.516519:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367127 00000100:00100000:3.0:1788572216.522397:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.522566:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615165568 00000100:00100000:1.0:1788572216.522584:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615165568 00000100:00100000:1.0:1788572216.522638:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10979 00000100:00100000:1.0:1788572216.522647:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+658:2382:x1875449615165568:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.522676:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367127, current: 214748367127, replaying 00000100:00100000:1.0:1788572216.522698:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+658:2382:x1875449615165568:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 52us (323us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.522706:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10979 00000020:00080000:3.0:1788572216.522827:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.522832:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367127, next_transno: 214748367127 00010000:00080000:3.0:1788572216.522837:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367127) 00000020:00080000:3.0:1788572216.522840:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.522851:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615165568 t214748367127 from 192.168.202.13@tcp req@ffff94e6349e8a80 x1875449615165568/t0(214748367127) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.522958:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e62d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.522976:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e62d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.522988:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e62d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.522999:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.523032:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.523040:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.523236:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e63b lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x466:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.523249:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e63b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.523256:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e63b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.523766:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].164, 64 off18688 00010000:00010000:2.0:1788572216.523826:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e63b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523834:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e63b lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523841:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e63b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523848:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.523852:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e63b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523860:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e63b lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523873:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x466:0x0].0x0 (ffff94e613194400) 00010000:00010000:2.0:1788572216.523877:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.523882:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e63b lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523888:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e63b lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x466:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523921:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e62d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523927:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e62d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523933:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e62d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523942:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.523945:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e62d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523950:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e62d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523959:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194700) 00010000:00010000:2.0:1788572216.523961:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.523964:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e62d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523970:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e62d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.523983:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d9cb0b9 reply state 000000000d415893 transno 214748367127 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.523995:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.524033:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc00e47a4 (ffff94e613194900) 00010000:00010000:2.0:1788572216.524036:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.524039:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.524104:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.524120:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.524123:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367128 00000020:00080000:2.0:1788572216.524127:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.524129:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367128 00000100:00100000:3.0:1788572216.526562:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.526785:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615165952 00000100:00100000:2.0:1788572216.526798:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615165952 00000100:00100000:2.0:1788572216.526848:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10980 00000100:00100000:2.0:1788572216.526858:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+660:2382:x1875449615165952:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.526878:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367128, current: 214748367128, replaying 00000100:00100000:2.0:1788572216.527094:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+660:2382:x1875449615165952:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 238us (543us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.527100:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10980 00000020:00080000:3.0:1788572216.527499:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.527504:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367128, next_transno: 214748367128 00010000:00080000:3.0:1788572216.527508:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367128) 00000020:00080000:3.0:1788572216.527511:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.527520:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615165952 t214748367128 from 192.168.202.13@tcp req@ffff94e6349ea680 x1875449615165952/t0(214748367128) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.527607:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e642 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.527619:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e642 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.527627:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e642 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.527653:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x366eb11d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.527658:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x366eb11d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.527675:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x366eb11d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.527836:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e650 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x467:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.527845:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e650 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x467:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.527853:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e650 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x467:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.528073:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].164, 64 off18688 00010000:00010000:3.0:1788572216.528127:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e650 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x467:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528132:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e650 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x467:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528137:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e650 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x467:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528141:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.528143:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e650 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x467:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528148:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e650 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x467:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528156:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x467:0x0].0x0 (ffff94e641297f00) 00010000:00010000:3.0:1788572216.528158:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.528161:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e650 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x467:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528169:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e650 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x467:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528184:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e642 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528188:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e642 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528191:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e642 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528194:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.528196:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e642 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528199:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e642 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528202:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194e00) 00010000:00010000:3.0:1788572216.528204:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.528205:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e642 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528208:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e642 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.528215:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000708db3a7 reply state 000000001dd5da06 transno 214748367128 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x366eb11d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528222:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x366eb11d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.528227:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x366eb11d (ffff94e641297900) 00010000:00010000:3.0:1788572216.528228:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.528230:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.528309:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.528325:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.528328:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367129 00000020:00080000:3.0:1788572216.528331:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.528333:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367129 00000100:00100000:3.0:1788572216.531161:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.531252:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615166336 00000100:00100000:1.0:1788572216.531262:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615166336 00000100:00100000:1.0:1788572216.531321:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10981 00000100:00100000:1.0:1788572216.531332:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+662:2382:x1875449615166336:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.531352:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367129, current: 214748367129, replaying 00000100:00100000:1.0:1788572216.531365:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+662:2382:x1875449615166336:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 38us (219us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.531371:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10981 00000020:00080000:3.0:1788572216.531535:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.531540:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367129, next_transno: 214748367129 00010000:00080000:3.0:1788572216.531545:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367129) 00000020:00080000:3.0:1788572216.531548:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.531558:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615166336 t214748367129 from 192.168.202.13@tcp req@ffff94e6349e8380 x1875449615166336/t0(214748367129) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.531670:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e657 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.531686:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e657 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.531699:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e657 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.531713:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdea4891e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.531720:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdea4891e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.531726:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdea4891e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.531893:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e665 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x468:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.531899:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e665 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x468:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.531904:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e665 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x468:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.532131:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].165, 64 off18752 00010000:00010000:3.0:1788572216.532176:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e665 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x468:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532181:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e665 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x468:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532186:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e665 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x468:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532190:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.532193:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e665 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x468:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532198:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e665 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x468:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532207:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x468:0x0].0x0 (ffff94e641297700) 00010000:00010000:3.0:1788572216.532209:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.532214:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e665 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x468:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532218:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e665 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x468:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532235:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e657 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532238:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e657 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532242:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e657 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532296:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.532299:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e657 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532305:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e657 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532312:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297a00) 00010000:00010000:3.0:1788572216.532315:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.532318:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e657 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532324:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e657 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.532337:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000580d9273 reply state 000000000c634a2f transno 214748367129 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdea4891e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532349:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdea4891e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.532353:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdea4891e (ffff94e641297300) 00010000:00010000:3.0:1788572216.532355:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.532357:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.532523:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.532542:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.532545:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367130 00000020:00080000:3.0:1788572216.532549:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.532552:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367130 00000100:00100000:0.0:1788572216.535410:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.535615:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615166720 00000100:00100000:1.0:1788572216.535627:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615166720 00000100:00100000:1.0:1788572216.535695:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10982 00000100:00100000:1.0:1788572216.535706:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+664:2382:x1875449615166720:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.535729:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367130, current: 214748367130, replaying 00000100:00100000:1.0:1788572216.535744:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+664:2382:x1875449615166720:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 41us (347us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.535751:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10982 00000020:00080000:3.0:1788572216.535775:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.535779:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367130, next_transno: 214748367130 00010000:00080000:3.0:1788572216.535784:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367130) 00000020:00080000:3.0:1788572216.535787:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.535923:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615166720 t214748367130 from 192.168.202.13@tcp req@ffff94e506551180 x1875449615166720/t0(214748367130) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.536146:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e66c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.536164:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e66c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.536176:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e66c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.536189:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x232002d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.536200:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x232002d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.536206:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x232002d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.536447:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e67a lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x469:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.536455:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e67a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x469:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.536461:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e67a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x469:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.536778:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].165, 64 off18752 00010000:00010000:2.0:1788572216.537577:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e67a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x469:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537587:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e67a lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x469:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537592:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e67a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x469:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537596:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.537599:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e67a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x469:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537605:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e67a lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x469:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537615:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x469:0x0].0x0 (ffff94e641297800) 00010000:00010000:2.0:1788572216.537617:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.537621:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e67a lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x469:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537624:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e67a lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x469:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537648:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e66c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537652:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e66c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537656:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e66c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537659:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.537672:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e66c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537678:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e66c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537684:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297f00) 00010000:00010000:2.0:1788572216.537687:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.537690:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e66c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537695:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e66c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.537708:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c250a918 reply state 0000000081d9ecdc transno 214748367130 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x232002d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537720:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x232002d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.537725:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x232002d7 (ffff94e641297600) 00010000:00010000:2.0:1788572216.537727:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.537729:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.537822:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.537842:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.537846:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367131 00000020:00080000:2.0:1788572216.537850:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.537852:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367131 00000100:00100000:1.0:1788572216.540555:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.540778:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615167104 00000100:00100000:0.0:1788572216.540790:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615167104 00000100:00100000:0.0:1788572216.540866:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10983 00000100:00100000:0.0:1788572216.540877:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+666:2382:x1875449615167104:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.540900:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367131, current: 214748367131, replaying 00000100:00100000:0.0:1788572216.540929:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+666:2382:x1875449615167104:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 55us (387us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.540937:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10983 00000020:00080000:3.0:1788572216.541092:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.541097:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367131, next_transno: 214748367131 00010000:00080000:3.0:1788572216.541101:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367131) 00000020:00080000:3.0:1788572216.541105:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.541115:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615167104 t214748367131 from 192.168.202.13@tcp req@ffff94e6412b1f80 x1875449615167104/t0(214748367131) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.541220:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e681 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541240:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e681 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541253:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e681 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541268:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541276:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541282:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541482:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e68f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x46a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541492:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e68f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541514:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e68f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.541779:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].166, 64 off18816 00010000:00010000:3.0:1788572216.541850:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e68f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541858:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e68f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x46a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541866:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e68f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541872:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.541877:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e68f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541889:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e68f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x46a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541904:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x46a:0x0].0x0 (ffff94e641297400) 00010000:00010000:3.0:1788572216.541915:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.541921:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e68f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x46a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541927:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e68f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x46a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541955:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e681 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541961:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e681 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541967:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e681 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541971:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.541974:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e681 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541980:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e681 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.541987:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297b00) 00010000:00010000:3.0:1788572216.541990:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.541992:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e681 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.542044:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e681 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.542060:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3b6c103 reply state 00000000b13988cb transno 214748367131 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.542072:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.542079:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44fa5c50 (ffff94e641297000) 00010000:00010000:3.0:1788572216.542081:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.542084:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.542167:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.542185:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.542189:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367132 00000020:00080000:3.0:1788572216.542193:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.542195:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367132 00000100:00100000:3.0:1788572216.546450:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.546524:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615167488 00000100:00100000:1.0:1788572216.546535:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615167488 00000100:00100000:1.0:1788572216.546599:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10984 00000100:00100000:1.0:1788572216.546609:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+668:2382:x1875449615167488:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.546630:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367132, current: 214748367132, replaying 00000100:00100000:1.0:1788572216.546647:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+668:2382:x1875449615167488:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (209us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.546655:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10984 00000020:00080000:3.0:1788572216.547159:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.547165:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367132, next_transno: 214748367132 00010000:00080000:3.0:1788572216.547170:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367132) 00000020:00080000:3.0:1788572216.547173:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.547184:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615167488 t214748367132 from 192.168.202.13@tcp req@ffff94e6349eaa00 x1875449615167488/t0(214748367132) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.547273:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e696 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.547299:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e696 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.547313:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e696 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.547328:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.547335:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.547341:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.547609:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6a4 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x46b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.547618:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6a4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.547626:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6a4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.548644:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].166, 64 off18816 00010000:00010000:3.0:1788572216.548900:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6a4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.548989:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6a4 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x46b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.548996:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6a4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549024:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.549029:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6a4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549038:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6a4 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x46b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549052:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x46b:0x0].0x0 (ffff94e641297100) 00010000:00010000:3.0:1788572216.549056:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.549061:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6a4 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x46b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549067:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6a4 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x46b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549098:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e696 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549104:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e696 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549110:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e696 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549115:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.549119:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e696 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549125:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e696 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549133:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297a00) 00010000:00010000:3.0:1788572216.549135:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.549138:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e696 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549143:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e696 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.549157:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088f7235f reply state 000000005783c29e transno 214748367132 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549168:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.549175:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6d7db609 (ffff94e641297700) 00010000:00010000:3.0:1788572216.549178:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.549181:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.549443:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.549464:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.549467:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367133 00000020:00080000:2.0:1788572216.549470:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.549472:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367133 00000100:00100000:0.0:1788572216.553484:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.553921:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615167872 00000100:00100000:1.0:1788572216.553935:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615167872 00000100:00100000:1.0:1788572216.554060:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10985 00000100:00100000:1.0:1788572216.554072:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+670:2382:x1875449615167872:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.554096:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367133, current: 214748367133, replaying 00000100:00100000:1.0:1788572216.554116:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+670:2382:x1875449615167872:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (884us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.554123:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10985 00000020:00080000:3.0:1788572216.554345:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.554350:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367133, next_transno: 214748367133 00010000:00080000:3.0:1788572216.554355:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367133) 00000020:00080000:3.0:1788572216.554357:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.554368:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615167872 t214748367133 from 192.168.202.13@tcp req@ffff94e506553b80 x1875449615167872/t0(214748367133) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.554472:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6ab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.554488:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.554512:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.554526:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.554533:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.554540:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.554739:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6b9 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x46c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.555464:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6b9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.555478:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6b9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.555924:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].167, 64 off18880 00010000:00010000:2.0:1788572216.555988:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6b9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.555996:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6b9 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x46c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.556029:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6b9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.556035:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.556040:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6b9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.556048:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6b9 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x46c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.556061:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x46c:0x0].0x0 (ffff94e641297c00) 00010000:00010000:2.0:1788572216.556065:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.556070:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6b9 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x46c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.556076:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6b9 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x46c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.556102:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.556108:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6ab lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.558118:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.558138:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.558145:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.558154:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6ab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.558171:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297b00) 00010000:00010000:2.0:1788572216.558174:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.558179:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6ab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.558186:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6ab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.558213:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7690550 reply state 000000008dfeaf3c transno 214748367133 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.558240:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.558247:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2a2c142b (ffff94e641297400) 00010000:00010000:2.0:1788572216.558249:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.558252:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.558365:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.558386:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.558389:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367134 00000020:00080000:2.0:1788572216.558393:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.558396:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367134 00000100:00100000:1.0:1788572216.564407:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.564831:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615168256 00000100:00100000:0.0:1788572216.564844:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615168256 00000100:00100000:0.0:1788572216.564962:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10986 00000100:00100000:0.0:1788572216.564974:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+672:2382:x1875449615168256:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.564997:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367134, current: 214748367134, replaying 00000100:00100000:0.0:1788572216.565045:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+672:2382:x1875449615168256:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 74us (649us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.565053:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10986 00000020:00080000:3.0:1788572216.565109:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.565113:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367134, next_transno: 214748367134 00010000:00080000:3.0:1788572216.565118:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367134) 00000020:00080000:3.0:1788572216.565121:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.565130:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615168256 t214748367134 from 192.168.202.13@tcp req@ffff94e6412b0000 x1875449615168256/t0(214748367134) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.565241:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e6c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565260:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e6c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565274:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e6c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565301:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565307:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565314:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565491:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e6ce lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x46d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565513:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e6ce lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565521:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e6ce lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.565766:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].167, 64 off18880 00010000:00010000:3.0:1788572216.565828:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e6ce lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565835:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e6ce lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x46d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565841:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e6ce lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565847:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.565851:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e6ce lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565862:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e6ce lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x46d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565876:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x46d:0x0].0x0 (ffff94e641297200) 00010000:00010000:3.0:1788572216.565879:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.565884:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e6ce lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x46d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565889:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e6ce lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x46d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565912:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e6c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565918:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e6c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565923:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e6c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565928:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.565930:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e6c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565936:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e6c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565943:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297a00) 00010000:00010000:3.0:1788572216.565946:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.565948:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e6c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565959:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e6c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.565974:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e0472e5 reply state 000000006ff720a5 transno 214748367134 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565985:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.565991:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf34068a4 (ffff94e641297100) 00010000:00010000:3.0:1788572216.565994:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.565996:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.566128:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.566148:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.566152:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367135 00000020:00080000:3.0:1788572216.566155:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.566157:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367135 00000100:00100000:3.0:1788572216.572929:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.573604:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615168640 00000100:00100000:2.0:1788572216.573615:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615168640 00000100:00100000:2.0:1788572216.573698:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10987 00000100:00100000:2.0:1788572216.573710:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+674:2382:x1875449615168640:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.573734:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367135, current: 214748367135, replaying 00000020:00080000:3.0:1788572216.573832:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.573837:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367135, next_transno: 214748367135 00010000:00080000:3.0:1788572216.573842:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367135) 00000020:00080000:3.0:1788572216.573845:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.573857:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615168640 t214748367135 from 192.168.202.13@tcp req@ffff94e6349eb100 x1875449615168640/t0(214748367135) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 2 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.573968:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e6d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.573987:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e6d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574000:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e6d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574033:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574041:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574048:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574239:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e6e3 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x46e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574248:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e6e3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574255:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e6e3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.574510:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].168, 64 off18944 00010000:00010000:3.0:1788572216.574573:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e6e3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574581:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e6e3 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x46e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574587:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e6e3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574593:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.574597:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e6e3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574605:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e6e3 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x46e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574618:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x46e:0x0].0x0 (ffff94e641297d00) 00010000:00010000:3.0:1788572216.574621:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.574626:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e6e3 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x46e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574633:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e6e3 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x46e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574656:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e6d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574675:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e6d5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574681:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e6d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574686:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.574689:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e6d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574695:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e6d5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574703:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297e00) 00010000:00010000:3.0:1788572216.574706:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.574709:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e6d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574715:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e6d5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.574728:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c25c523f reply state 00000000308803b3 transno 214748367135 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574739:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.574745:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55e675a5 (ffff94e641297500) 00010000:00010000:3.0:1788572216.574971:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.574977:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.575089:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.575101:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.575104:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367136 00000020:00080000:3.0:1788572216.575108:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.575110:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367136 00000100:00100000:2.0:1788572216.576459:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+674:2382:x1875449615168640:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (839us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.576483:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10987 00000100:00100000:1.0:1788572216.579187:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.579405:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615169024 00000100:00100000:2.0:1788572216.579417:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615169024 00000100:00100000:2.0:1788572216.579515:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10988 00000100:00100000:2.0:1788572216.579526:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+676:2382:x1875449615169024:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.579548:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367136, current: 214748367136, replaying 00000100:00100000:2.0:1788572216.579568:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+676:2382:x1875449615169024:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (392us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.579575:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10988 00000020:00080000:3.0:1788572216.579608:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.579613:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367136, next_transno: 214748367136 00010000:00080000:3.0:1788572216.579617:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367136) 00000020:00080000:3.0:1788572216.579620:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.579631:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615169024 t214748367136 from 192.168.202.13@tcp req@ffff94e6412b3800 x1875449615169024/t0(214748367136) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.579732:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e6ea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.579758:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e6ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.579770:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e6ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.579783:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.579790:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.579796:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580173:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e6f8 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x46f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580183:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e6f8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580191:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e6f8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.580575:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].168, 64 off18944 00010000:00010000:3.0:1788572216.580636:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e6f8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x46f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580645:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e6f8 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x46f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580652:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e6f8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580659:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.580674:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e6f8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x46f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580682:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e6f8 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x46f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580695:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x46f:0x0].0x0 (ffff94e641297f00) 00010000:00010000:3.0:1788572216.580699:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.580704:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e6f8 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x46f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580711:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e6f8 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x46f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580735:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e6ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580741:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e6ea lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580857:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e6ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580864:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.580867:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e6ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580874:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e6ea lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580883:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297b00) 00010000:00010000:3.0:1788572216.580885:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.580889:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e6ea lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580895:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e6ea lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.580974:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013f3fcab reply state 0000000066fa2b52 transno 214748367136 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580988:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.580995:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9aaca1e (ffff94e641297c00) 00010000:00010000:3.0:1788572216.580997:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.581000:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.581127:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.581146:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.581150:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367137 00000020:00080000:3.0:1788572216.581154:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.581156:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367137 00000100:00100000:0.0:1788572216.585144:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.585353:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615169408 00000100:00100000:3.0:1788572216.585366:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615169408 00000100:00100000:3.0:1788572216.585472:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10989 00000100:00100000:3.0:1788572216.585485:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+678:2382:x1875449615169408:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.585509:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367137, current: 214748367137, replaying 00000100:00100000:3.0:1788572216.585539:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+678:2382:x1875449615169408:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 57us (406us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.585545:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10989 00000020:00080000:1.0:1788572216.585598:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.585603:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367137, next_transno: 214748367137 00010000:00080000:1.0:1788572216.585608:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367137) 00000020:00080000:1.0:1788572216.585610:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.585620:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615169408 t214748367137 from 192.168.202.13@tcp req@ffff94e506552d80 x1875449615169408/t0(214748367137) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.585741:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e6ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.585758:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e6ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.585772:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e6ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.585787:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.585795:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.585801:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.585998:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e70d lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x470:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586028:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e70d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x470:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586036:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e70d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x470:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.586294:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].169, 64 off19008 00010000:00010000:1.0:1788572216.586361:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e70d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x470:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586369:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e70d lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x470:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586376:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e70d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x470:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586382:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.586387:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e70d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x470:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586395:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e70d lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x470:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586407:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x470:0x0].0x0 (ffff94e61e543a00) 00010000:00010000:1.0:1788572216.586410:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.586415:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e70d lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x470:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586422:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e70d lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x470:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586442:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e6ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586448:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e6ff lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586454:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e6ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586463:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.586466:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e6ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586472:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e6ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586480:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543f00) 00010000:00010000:1.0:1788572216.586483:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.586486:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e6ff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586491:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e6ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.586504:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef14639c reply state 0000000085d89f60 transno 214748367137 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586514:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.586520:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x316f82c7 (ffff94e61e543800) 00010000:00010000:1.0:1788572216.586522:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.586525:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.586615:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.586632:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.586635:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367138 00000020:00080000:1.0:1788572216.586639:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.586641:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367138 00000100:00100000:1.0:1788572216.593556:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.593650:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615169792 00000100:00100000:2.0:1788572216.593672:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615169792 00000100:00100000:2.0:1788572216.593740:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10990 00000100:00100000:2.0:1788572216.593752:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+680:2382:x1875449615169792:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.593773:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367138, current: 214748367138, replaying 00000100:00100000:2.0:1788572216.593796:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+680:2382:x1875449615169792:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 48us (252us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.593803:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10990 00000020:00080000:3.0:1788572216.593892:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.593897:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367138, next_transno: 214748367138 00010000:00080000:3.0:1788572216.593903:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367138) 00000020:00080000:3.0:1788572216.593906:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.593924:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615169792 t214748367138 from 192.168.202.13@tcp req@ffff94e6412b1180 x1875449615169792/t0(214748367138) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.594085:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e714 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594107:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e714 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594122:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e714 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594133:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594140:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594146:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594341:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e722 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x471:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594350:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e722 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x471:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594356:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e722 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x471:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.594586:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].169, 64 off19008 00010000:00010000:3.0:1788572216.594648:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e722 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x471:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594656:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e722 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x471:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594674:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e722 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x471:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594680:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.594684:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e722 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x471:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594692:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e722 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x471:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594706:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x471:0x0].0x0 (ffff94e641297e00) 00010000:00010000:3.0:1788572216.594709:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.594714:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e722 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x471:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594721:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e722 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x471:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594741:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e714 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594747:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e714 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594756:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e714 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594761:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.594763:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e714 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594768:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e714 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594775:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297b00) 00010000:00010000:3.0:1788572216.594777:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.594780:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e714 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594785:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e714 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.594795:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003fb8622e reply state 0000000099efb49e transno 214748367138 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594806:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.594813:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x59f2dc80 (ffff94e641297f00) 00010000:00010000:3.0:1788572216.594815:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.594817:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.594896:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.594915:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.594918:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367139 00000020:00080000:3.0:1788572216.594922:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.594924:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367139 00000100:00100000:2.0:1788572216.613823:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.614331:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615170176 00000100:00100000:0.0:1788572216.614346:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615170176 00000100:00100000:0.0:1788572216.614421:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10991 00000100:00100000:0.0:1788572216.614432:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+682:2382:x1875449615170176:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.614452:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367139, current: 214748367139, replaying 00000100:00100000:0.0:1788572216.614470:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+682:2382:x1875449615170176:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (658us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.614480:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10991 00000020:00080000:3.0:1788572216.614589:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.614595:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367139, next_transno: 214748367139 00010000:00080000:3.0:1788572216.614599:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367139) 00000020:00080000:3.0:1788572216.614602:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.614611:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615170176 t214748367139 from 192.168.202.13@tcp req@ffff94e50552ed80 x1875449615170176/t0(214748367139) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.614713:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e729 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.614729:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e729 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.614741:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e729 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.614754:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc718e981 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.614761:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc718e981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.614767:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc718e981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.614968:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e737 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x472:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.614977:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e737 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x472:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.614985:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e737 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x472:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.615448:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].170, 64 off19072 00010000:00010000:3.0:1788572216.615509:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e737 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x472:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615518:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e737 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x472:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615524:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e737 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x472:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615530:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.615535:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e737 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x472:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615543:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e737 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x472:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615555:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x472:0x0].0x0 (ffff94e641297d00) 00010000:00010000:3.0:1788572216.615558:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.615562:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e737 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x472:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615569:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e737 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x472:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615589:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e729 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615600:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e729 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615606:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e729 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615610:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.615613:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e729 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615619:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e729 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615625:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297b00) 00010000:00010000:3.0:1788572216.615627:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.615630:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e729 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615635:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e729 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.615645:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1d0340f reply state 000000007b7d37c8 transno 214748367139 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc718e981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615656:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc718e981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.615674:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc718e981 (ffff94e641297e00) 00010000:00010000:3.0:1788572216.615676:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.615679:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.615776:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.615795:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.615799:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367140 00000020:00080000:3.0:1788572216.615803:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.615805:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367140 00000100:00100000:0.0:1788572216.623448:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.623589:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615170560 00000100:00100000:2.0:1788572216.623600:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615170560 00000100:00100000:2.0:1788572216.623676:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10992 00000100:00100000:2.0:1788572216.623688:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+684:2382:x1875449615170560:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.623712:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367140, current: 214748367140, replaying 00000100:00100000:2.0:1788572216.623737:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+684:2382:x1875449615170560:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 52us (301us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.623745:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10992 00000020:00080000:1.0:1788572216.624869:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.624877:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367140, next_transno: 214748367140 00010000:00080000:1.0:1788572216.624883:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367140) 00000020:00080000:1.0:1788572216.624886:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.624899:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615170560 t214748367140 from 192.168.202.13@tcp req@ffff94e506550700 x1875449615170560/t0(214748367140) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.625070:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e73e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.625087:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e73e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.625099:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e73e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.625114:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x80813dfa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.625121:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80813dfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.625128:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80813dfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626143:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e74c lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x473:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626159:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e74c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x473:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626167:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e74c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x473:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.626432:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].170, 64 off19072 00010000:00010000:0.0:1788572216.626511:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e74c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x473:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626518:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e74c lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x473:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626525:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e74c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x473:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626531:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.626536:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e74c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x473:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626544:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e74c lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x473:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626559:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x473:0x0].0x0 (ffff94e619d6fc00) 00010000:00010000:0.0:1788572216.626563:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.626568:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e74c lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x473:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626575:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e74c lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x473:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626598:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e73e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626604:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e73e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626609:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e73e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626613:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.626616:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e73e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626621:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e73e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626628:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543f00) 00010000:00010000:0.0:1788572216.626630:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.626633:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e73e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626638:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e73e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.626654:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af29434f reply state 00000000629227f2 transno 214748367140 ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80813dfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626680:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80813dfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.626686:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x80813dfa (ffff94e61e543a00) 00010000:00010000:0.0:1788572216.626688:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.626691:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.626795:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.626818:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.626822:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367141 00000020:00080000:0.0:1788572216.626827:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.626829:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367141 00000100:00100000:1.0:1788572216.631809:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.631940:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615170944 00000100:00100000:0.0:1788572216.631951:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615170944 00000100:00100000:0.0:1788572216.632030:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10993 00000100:00100000:0.0:1788572216.632041:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+686:2382:x1875449615170944:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.632061:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367141, current: 214748367141, replaying 00000100:00100000:0.0:1788572216.632073:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+686:2382:x1875449615170944:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 35us (277us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.632079:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10993 00000020:00080000:3.0:1788572216.632141:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.632146:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367141, next_transno: 214748367141 00010000:00080000:3.0:1788572216.632151:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367141) 00000020:00080000:3.0:1788572216.632154:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.632164:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615170944 t214748367141 from 192.168.202.13@tcp req@ffff94e6412b3480 x1875449615170944/t0(214748367141) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.632265:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e753 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632292:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e753 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632305:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e753 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632318:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1e661773 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632324:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e661773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632330:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e661773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632505:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e761 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x474:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632514:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e761 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632522:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e761 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.632755:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].171, 64 off19136 00010000:00010000:3.0:1788572216.632815:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e761 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632824:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e761 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632831:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e761 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632837:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.632842:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e761 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632850:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e761 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632862:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x474:0x0].0x0 (ffff94e641297a00) 00010000:00010000:3.0:1788572216.632866:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.632871:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e761 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632878:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e761 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x474:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632903:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e753 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632910:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e753 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632916:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e753 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632921:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.632924:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e753 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632929:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e753 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632937:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297b00) 00010000:00010000:3.0:1788572216.632939:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.632942:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e753 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632948:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e753 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.632960:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021f9dc2a reply state 00000000e3cc7813 transno 214748367141 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e661773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632972:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e661773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.632978:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e661773 (ffff94e641297d00) 00010000:00010000:3.0:1788572216.632981:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.632984:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.633124:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.633141:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.633143:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367142 00000020:00080000:3.0:1788572216.633147:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.633149:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367142 00000100:00100000:2.0:1788572216.650753:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.650876:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615171328 00000100:00100000:0.0:1788572216.650886:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615171328 00000100:00100000:0.0:1788572216.650956:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10994 00000100:00100000:0.0:1788572216.650966:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+688:2382:x1875449615171328:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.650982:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367142, current: 214748367142, replaying 00000100:00100000:0.0:1788572216.651024:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+688:2382:x1875449615171328:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 39us (259us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.651030:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10994 00000020:00080000:3.0:1788572216.651214:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.651219:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367142, next_transno: 214748367142 00010000:00080000:3.0:1788572216.651223:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367142) 00000020:00080000:3.0:1788572216.651226:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.651237:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615171328 t214748367142 from 192.168.202.13@tcp req@ffff94e50552ce00 x1875449615171328/t0(214748367142) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.651345:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e768 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651361:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e768 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651373:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e768 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651385:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651392:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651398:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651579:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e776 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x475:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651586:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e776 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x475:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651590:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e776 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x475:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.651829:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].171, 64 off19136 00010000:00010000:3.0:1788572216.651895:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e776 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x475:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651903:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e776 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x475:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651911:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e776 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x475:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651917:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.651922:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e776 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x475:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651930:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e776 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x475:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651943:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x475:0x0].0x0 (ffff94e641297200) 00010000:00010000:3.0:1788572216.651947:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.651952:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e776 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x475:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651963:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e776 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x475:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651989:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e768 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.651995:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e768 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.652001:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e768 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.652270:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.652324:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e768 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.652333:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e768 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.652344:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297b00) 00010000:00010000:3.0:1788572216.652346:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.652350:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e768 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.652356:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e768 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.652370:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a98d4372 reply state 00000000318b1ff9 transno 214748367142 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.652380:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.652388:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc8e9712c (ffff94e641297a00) 00010000:00010000:3.0:1788572216.652390:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.652393:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.652486:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.652504:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.652507:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367143 00000020:00080000:3.0:1788572216.652511:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.652513:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367143 00000100:00100000:0.0:1788572216.654840:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.655110:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615171712 00000100:00100000:2.0:1788572216.655122:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615171712 00000100:00100000:2.0:1788572216.655224:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10995 00000100:00100000:2.0:1788572216.655236:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+690:2382:x1875449615171712:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.655256:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367143, current: 214748367143, replaying 00000100:00100000:2.0:1788572216.655285:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+690:2382:x1875449615171712:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 52us (454us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.655292:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10995 00000020:00080000:0.0:1788572216.655337:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.655341:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367143, next_transno: 214748367143 00010000:00080000:0.0:1788572216.655345:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367143) 00000020:00080000:0.0:1788572216.655348:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.655359:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615171712 t214748367143 from 192.168.202.13@tcp req@ffff94e506552680 x1875449615171712/t0(214748367143) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.655492:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e77d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.655506:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e77d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.655516:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e77d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.655530:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.655537:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.655543:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.655750:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e78b lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x476:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.655759:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e78b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x476:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.655767:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e78b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x476:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.656030:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].172, 64 off19200 00010000:00010000:0.0:1788572216.656090:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e78b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x476:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656098:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e78b lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x476:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656104:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e78b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x476:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656110:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.656115:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e78b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x476:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656123:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e78b lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x476:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656138:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x476:0x0].0x0 (ffff94e60ff78600) 00010000:00010000:0.0:1788572216.656141:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.656147:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e78b lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x476:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656154:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e78b lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x476:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656176:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e77d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656183:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e77d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656194:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e77d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656199:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.656202:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e77d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656209:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e77d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656216:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e619d6fc00) 00010000:00010000:0.0:1788572216.656218:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.656221:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e77d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656227:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e77d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.656239:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019708cc4 reply state 00000000d8d73448 transno 214748367143 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656249:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.656255:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c691ef0 (ffff94e6414be200) 00010000:00010000:0.0:1788572216.656257:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.656260:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.656346:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.656364:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.656368:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367144 00000020:00080000:0.0:1788572216.656372:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.656375:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367144 00000100:00100000:1.0:1788572216.659078:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.659165:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615172096 00000100:00100000:0.0:1788572216.659175:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615172096 00000100:00100000:0.0:1788572216.659245:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10996 00000100:00100000:0.0:1788572216.659256:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+692:2382:x1875449615172096:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.659276:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367144, current: 214748367144, replaying 00000100:00100000:0.0:1788572216.659304:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+692:2382:x1875449615172096:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 51us (236us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.659310:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10996 00000020:00080000:0.0:1788572216.659329:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.659332:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367144, next_transno: 214748367144 00010000:00080000:0.0:1788572216.659337:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367144) 00000020:00080000:0.0:1788572216.659340:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.659349:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615172096 t214748367144 from 192.168.202.13@tcp req@ffff94e6412b3100 x1875449615172096/t0(214748367144) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.659440:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e792 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.659456:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e792 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.659468:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e792 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.659482:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.659493:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.659500:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.659679:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e7a0 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x477:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.659688:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e7a0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x477:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.659696:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e7a0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x477:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.660358:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].172, 64 off19200 00010000:00010000:0.0:1788572216.660423:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e7a0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x477:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660432:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e7a0 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x477:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660439:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e7a0 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x477:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660446:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637791800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.660451:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e7a0 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x477:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660459:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e7a0 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x477:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660477:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x477:0x0].0x0 (ffff94e60ff78000) 00010000:00010000:0.0:1788572216.660480:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.660485:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e7a0 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x477:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660492:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e7a0 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x477:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660515:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e792 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660522:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e792 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660529:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e792 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660534:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.660538:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e792 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660545:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e792 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660552:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78800) 00010000:00010000:0.0:1788572216.660555:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.660559:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e792 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660565:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e792 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.660581:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b05a932 reply state 000000006b9e2f29 transno 214748367144 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660592:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.660599:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x256c78a9 (ffff94e60ff78b00) 00010000:00010000:0.0:1788572216.660602:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.660604:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.660701:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.662777:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.662787:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367145 00000020:00080000:1.0:1788572216.662793:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.662794:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367145 00000100:00100000:1.0:1788572216.663590:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.663692:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615172480 00000100:00100000:0.0:1788572216.663706:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615172480 00000100:00100000:0.0:1788572216.663821:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10997 00000100:00100000:0.0:1788572216.663835:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+694:2382:x1875449615172480:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.663862:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367145, current: 214748367145, replaying 00000100:00100000:0.0:1788572216.663882:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+694:2382:x1875449615172480:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 51us (299us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.663889:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10997 00000020:00080000:1.0:1788572216.663935:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.663939:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367145, next_transno: 214748367145 00010000:00080000:1.0:1788572216.663944:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367145) 00000020:00080000:1.0:1788572216.663947:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.663960:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615172480 t214748367145 from 192.168.202.13@tcp req@ffff94e6412b2a00 x1875449615172480/t0(214748367145) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.664091:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e7a7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664108:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e7a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664121:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e7a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664134:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb21285aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664142:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb21285aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664149:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb21285aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664355:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7b5 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x478:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664364:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7b5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x478:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664375:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7b5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x478:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.664600:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].173, 64 off19264 00010000:00010000:1.0:1788572216.664670:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7b5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x478:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664679:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7b5 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x478:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664686:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7b5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x478:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664691:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.664696:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7b5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x478:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664703:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7b5 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x478:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664715:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x478:0x0].0x0 (ffff94e61e543000) 00010000:00010000:1.0:1788572216.664718:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.664723:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7b5 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x478:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664729:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7b5 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x478:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664751:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e7a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664761:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e7a7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664767:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e7a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664772:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.664775:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e7a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664781:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e7a7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664788:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543700) 00010000:00010000:1.0:1788572216.664790:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.664793:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e7a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664798:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831e7a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.664811:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad147be8 reply state 0000000067e41d37 transno 214748367145 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb21285aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664822:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb21285aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.664829:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb21285aa (ffff94e61e543b00) 00010000:00010000:1.0:1788572216.664831:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.664834:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.664914:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.665049:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.665054:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367146 00000020:00080000:1.0:1788572216.665069:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.665071:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367146 00000100:00100000:0.0:1788572216.667602:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.667706:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615172864 00000100:00100000:3.0:1788572216.667717:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615172864 00000100:00100000:3.0:1788572216.667781:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10998 00000100:00100000:3.0:1788572216.667791:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+696:2382:x1875449615172864:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.667811:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367146, current: 214748367146, replaying 00000100:00100000:3.0:1788572216.667830:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+696:2382:x1875449615172864:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 41us (238us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.667835:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10998 00000020:00080000:1.0:1788572216.667883:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.667886:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367146, next_transno: 214748367146 00010000:00080000:1.0:1788572216.667890:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367146) 00000020:00080000:1.0:1788572216.667893:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.667905:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615172864 t214748367146 from 192.168.202.13@tcp req@ffff94e506553480 x1875449615172864/t0(214748367146) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.668034:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7bc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668047:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668057:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668069:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x562ada23 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668076:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x562ada23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668082:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x562ada23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668272:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e7ca lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x479:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668281:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e7ca lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x479:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668288:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e7ca lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x479:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.668511:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].173, 64 off19264 00010000:00010000:1.0:1788572216.668560:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e7ca lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x479:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668565:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e7ca lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x479:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668570:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e7ca lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x479:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668573:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.668576:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e7ca lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x479:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668580:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e7ca lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x479:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668588:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x479:0x0].0x0 (ffff94e61e543c00) 00010000:00010000:1.0:1788572216.668591:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.668594:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e7ca lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x479:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668598:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e7ca lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x479:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668618:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7bc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668622:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7bc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668625:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668628:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.668630:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7bc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668633:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7bc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668636:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543400) 00010000:00010000:1.0:1788572216.668638:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.668639:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7bc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668642:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7bc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.668648:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2239ca7 reply state 0000000080f43566 transno 214748367146 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x562ada23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668656:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x562ada23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.668672:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x562ada23 (ffff94e61e543100) 00010000:00010000:1.0:1788572216.668675:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.668677:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.668738:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.668755:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.668757:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367147 00000020:00080000:1.0:1788572216.668760:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.668762:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367147 00000100:00100000:1.0:1788572216.670721:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.670799:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615173248 00000100:00100000:0.0:1788572216.670809:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615173248 00000100:00100000:0.0:1788572216.670871:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 10999 00000100:00100000:0.0:1788572216.670881:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+698:2382:x1875449615173248:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.670903:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367147, current: 214748367147, replaying 00000100:00100000:0.0:1788572216.670925:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+698:2382:x1875449615173248:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (216us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.670936:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 10999 00000020:00080000:2.0:1788572216.671039:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.671044:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367147, next_transno: 214748367147 00010000:00080000:2.0:1788572216.671048:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367147) 00000020:00080000:2.0:1788572216.671052:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.671070:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615173248 t214748367147 from 192.168.202.13@tcp req@ffff94e6412b3b80 x1875449615173248/t0(214748367147) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.671162:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e7d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671178:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e7d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671189:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e7d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671201:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcba612cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671220:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcba612cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671228:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcba612cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671395:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e7df lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x47a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671406:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e7df lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671413:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e7df lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.671626:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].174, 64 off19328 00010000:00010000:2.0:1788572216.671699:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e7df lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671707:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e7df lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x47a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671713:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e7df lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671719:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.671723:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e7df lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671731:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e7df lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x47a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671742:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x47a:0x0].0x0 (ffff94e60fa15500) 00010000:00010000:2.0:1788572216.671745:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.671749:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e7df lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x47a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671755:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e7df lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x47a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671782:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e7d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671789:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e7d1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671794:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e7d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671798:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.671801:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e7d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671807:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e7d1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671815:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15f00) 00010000:00010000:2.0:1788572216.671819:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.671821:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e7d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671827:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e7d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.671839:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efa3c873 reply state 0000000000659f4c transno 214748367147 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcba612cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671851:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcba612cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.671858:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcba612cc (ffff94e60fa15100) 00010000:00010000:2.0:1788572216.671860:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.671863:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.671948:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.671965:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.671968:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367148 00000020:00080000:2.0:1788572216.671971:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.671973:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367148 00000100:00100000:3.0:1788572216.675302:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.675423:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615173632 00000100:00100000:2.0:1788572216.675433:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615173632 00000100:00100000:2.0:1788572216.675487:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11000 00000100:00100000:2.0:1788572216.675497:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+700:2382:x1875449615173632:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.675519:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367148, current: 214748367148, replaying 00000100:00100000:2.0:1788572216.675536:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+700:2382:x1875449615173632:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (249us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.675543:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11000 00000020:00080000:1.0:1788572216.675704:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.675709:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367148, next_transno: 214748367148 00010000:00080000:1.0:1788572216.675713:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367148) 00000020:00080000:1.0:1788572216.675716:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.675726:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615173632 t214748367148 from 192.168.202.13@tcp req@ffff94e6349e9c00 x1875449615173632/t0(214748367148) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.675823:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.675839:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.675851:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.675862:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.675868:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.675874:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676375:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e7f4 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x47b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676388:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e7f4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676396:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e7f4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.676630:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].174, 64 off19328 00010000:00010000:1.0:1788572216.676707:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e7f4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676715:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e7f4 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x47b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676722:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e7f4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676729:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.676733:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e7f4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676743:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e7f4 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x47b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676755:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x47b:0x0].0x0 (ffff94e61e543200) 00010000:00010000:1.0:1788572216.676758:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.676763:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e7f4 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x47b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676774:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e7f4 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x47b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676797:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676802:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7e6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676807:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676811:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.676814:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676819:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676826:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543700) 00010000:00010000:1.0:1788572216.676828:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.676830:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676835:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e7e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.676845:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f40d0817 reply state 00000000e2a50282 transno 214748367148 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676854:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.676860:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2cb67c45 (ffff94e61e543000) 00010000:00010000:1.0:1788572216.676862:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.676865:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.677048:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.677078:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.677082:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367149 00000020:00080000:1.0:1788572216.677086:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.677088:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367149 00000100:00100000:0.0:1788572216.680615:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.680739:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615174016 00000100:00100000:3.0:1788572216.680751:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615174016 00000100:00100000:3.0:1788572216.680826:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11001 00000100:00100000:3.0:1788572216.680838:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+702:2382:x1875449615174016:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.680860:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367149, current: 214748367149, replaying 00000100:00100000:3.0:1788572216.680972:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+702:2382:x1875449615174016:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 136us (368us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.680979:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11001 00000020:00080000:1.0:1788572216.683592:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.683603:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367149, next_transno: 214748367149 00010000:00080000:1.0:1788572216.683609:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367149) 00000020:00080000:1.0:1788572216.683613:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.683629:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615174016 t214748367149 from 192.168.202.13@tcp req@ffff94e506550380 x1875449615174016/t0(214748367149) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.683781:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.683798:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.683810:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.683822:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf7607446 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.683829:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf7607446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.683840:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf7607446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684188:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e809 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x47c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684198:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e809 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684206:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e809 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.684733:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].175, 64 off19392 00010000:00010000:1.0:1788572216.684798:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e809 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684807:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e809 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x47c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684814:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e809 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684820:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.684825:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e809 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684833:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e809 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x47c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684847:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x47c:0x0].0x0 (ffff94e61e543e00) 00010000:00010000:1.0:1788572216.684850:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.684857:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e809 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x47c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684864:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e809 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x47c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684888:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684894:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684900:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684906:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.684909:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684915:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684922:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543400) 00010000:00010000:1.0:1788572216.684925:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.684927:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684932:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e7fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.684945:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000652b4f8c reply state 0000000019a34a67 transno 214748367149 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf7607446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684960:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf7607446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.684966:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf7607446 (ffff94e61e543c00) 00010000:00010000:1.0:1788572216.684969:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.684971:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.685417:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.685445:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.685449:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367150 00000020:00080000:1.0:1788572216.685453:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.685455:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367150 00000100:00100000:2.0:1788572216.688158:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.688575:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615174400 00000100:00100000:0.0:1788572216.688589:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615174400 00000100:00100000:0.0:1788572216.688673:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11002 00000100:00100000:0.0:1788572216.688684:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+704:2382:x1875449615174400:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.688707:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367150, current: 214748367150, replaying 00000100:00100000:0.0:1788572216.688728:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+704:2382:x1875449615174400:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (587us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.688735:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11002 00000020:00080000:2.0:1788572216.688814:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.688818:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367150, next_transno: 214748367150 00010000:00080000:2.0:1788572216.688822:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367150) 00000020:00080000:2.0:1788572216.688826:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.688835:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615174400 t214748367150 from 192.168.202.13@tcp req@ffff94e50552c700 x1875449615174400/t0(214748367150) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.688948:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e810 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.688965:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e810 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.688982:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e810 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.688995:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689035:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689043:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689373:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e81e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x47d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689383:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e81e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689390:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e81e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.689637:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].175, 64 off19392 00010000:00010000:2.0:1788572216.689712:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e81e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689721:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e81e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x47d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689728:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e81e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689735:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.689742:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e81e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689752:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e81e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x47d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689766:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x47d:0x0].0x0 (ffff94e60fa15200) 00010000:00010000:2.0:1788572216.689769:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.689775:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e81e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x47d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689782:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e81e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x47d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689805:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e810 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689812:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e810 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689817:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e810 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689822:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.689825:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e810 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689830:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e810 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689838:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15f00) 00010000:00010000:2.0:1788572216.689839:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.689843:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e810 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689848:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e810 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.689857:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057701079 reply state 0000000083b5b2ac transno 214748367150 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689868:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.689875:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ab7cdff (ffff94e60fa15500) 00010000:00010000:2.0:1788572216.689877:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.689880:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.690408:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.690429:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.690432:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367151 00000020:00080000:2.0:1788572216.690436:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.690438:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367151 00000100:00100000:3.0:1788572216.695356:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.695452:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615174784 00000100:00100000:2.0:1788572216.695463:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615174784 00000100:00100000:2.0:1788572216.695532:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11003 00000100:00100000:2.0:1788572216.695543:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+706:2382:x1875449615174784:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.695565:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367151, current: 214748367151, replaying 00000100:00100000:2.0:1788572216.695587:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+706:2382:x1875449615174784:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (245us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.695594:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11003 00000020:00080000:1.0:1788572216.695640:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.695645:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367151, next_transno: 214748367151 00010000:00080000:1.0:1788572216.695649:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367151) 00000020:00080000:1.0:1788572216.695652:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.695673:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615174784 t214748367151 from 192.168.202.13@tcp req@ffff94e61e634a80 x1875449615174784/t0(214748367151) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.695778:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e825 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.695795:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.695808:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.695819:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.695829:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.695836:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696061:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e833 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x47e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696071:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e833 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696078:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e833 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.696616:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].176, 64 off19456 00010000:00010000:1.0:1788572216.696695:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e833 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696704:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e833 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x47e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696712:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e833 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696718:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.696723:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e833 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696732:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e833 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x47e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696749:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x47e:0x0].0x0 (ffff94e61e543500) 00010000:00010000:1.0:1788572216.696753:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.696758:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e833 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x47e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696765:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e833 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x47e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696789:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696795:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e825 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696801:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e825 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696807:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.696809:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e825 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696815:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e825 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696822:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543700) 00010000:00010000:1.0:1788572216.696824:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.696827:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e825 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696833:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e825 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.696849:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dd6ae61 reply state 0000000048a4c876 transno 214748367151 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696860:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.696866:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a9ca778 (ffff94e61e543200) 00010000:00010000:1.0:1788572216.696868:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.696871:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.696954:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.696974:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.696977:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367152 00000020:00080000:1.0:1788572216.696980:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.696982:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367152 00000100:00100000:0.0:1788572216.702336:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.702615:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615175168 00000100:00100000:2.0:1788572216.702626:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615175168 00000100:00100000:2.0:1788572216.702698:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11004 00000100:00100000:2.0:1788572216.702709:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+708:2382:x1875449615175168:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.702733:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367152, current: 214748367152, replaying 00000100:00100000:2.0:1788572216.702754:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+708:2382:x1875449615175168:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 48us (430us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.702762:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11004 00000020:00080000:1.0:1788572216.702818:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.702823:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367152, next_transno: 214748367152 00010000:00080000:1.0:1788572216.702827:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367152) 00000020:00080000:1.0:1788572216.702831:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.702841:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615175168 t214748367152 from 192.168.202.13@tcp req@ffff94e506551c00 x1875449615175168/t0(214748367152) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.702937:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e83a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.702956:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e83a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.702969:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e83a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.702985:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.702992:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.702999:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703242:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e848 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x47f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703252:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e848 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703260:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e848 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.703501:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].176, 64 off19456 00010000:00010000:1.0:1788572216.703560:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e848 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x47f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703568:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e848 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x47f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703575:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e848 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703581:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.703585:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e848 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x47f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703598:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e848 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x47f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703610:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x47f:0x0].0x0 (ffff94e61e543d00) 00010000:00010000:1.0:1788572216.703613:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.703617:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e848 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x47f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703623:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e848 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x47f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703648:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e83a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703653:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e83a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703672:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e83a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703677:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.703679:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e83a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703685:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e83a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703692:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543400) 00010000:00010000:1.0:1788572216.703695:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.703697:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e83a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703706:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e83a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.703718:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f1a9318 reply state 00000000818df391 transno 214748367152 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703727:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.703733:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdafd10f1 (ffff94e61e543e00) 00010000:00010000:1.0:1788572216.703735:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.703738:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.703810:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.703827:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.703830:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367153 00000020:00080000:1.0:1788572216.703834:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.703836:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367153 00000100:00100000:2.0:1788572216.713988:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.714496:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615175552 00000100:00100000:0.0:1788572216.714508:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615175552 00000100:00100000:0.0:1788572216.714607:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11005 00000100:00100000:0.0:1788572216.714618:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+710:2382:x1875449615175552:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.714646:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367153, current: 214748367153, replaying 00000100:00100000:0.0:1788572216.714679:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+710:2382:x1875449615175552:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 63us (705us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.714687:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11005 00000020:00080000:2.0:1788572216.714736:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.714741:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367153, next_transno: 214748367153 00010000:00080000:2.0:1788572216.714746:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367153) 00000020:00080000:2.0:1788572216.714749:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.714761:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615175552 t214748367153 from 192.168.202.13@tcp req@ffff94e50552f800 x1875449615175552/t0(214748367153) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.714868:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e84f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.714884:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e84f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.714898:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e84f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.714910:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8af88eef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.714917:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8af88eef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.714927:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8af88eef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715135:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e85d lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x480:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715144:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e85d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715151:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e85d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.715405:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].177, 64 off19520 00010000:00010000:2.0:1788572216.715474:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e85d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715481:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e85d lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715488:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e85d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715494:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.715498:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e85d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715505:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e85d lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715518:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x480:0x0].0x0 (ffff94e60fa15d00) 00010000:00010000:2.0:1788572216.715521:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.715526:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e85d lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715532:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e85d lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x480:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715553:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e84f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715559:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e84f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715564:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e84f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715569:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.715571:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e84f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715577:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e84f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715584:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15f00) 00010000:00010000:2.0:1788572216.715586:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.715589:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e84f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715595:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e84f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.715605:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0f2a258 reply state 00000000ebb047aa transno 214748367153 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8af88eef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715619:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af88eef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.715625:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8af88eef (ffff94e60fa15200) 00010000:00010000:2.0:1788572216.715627:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.715629:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.715735:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.715753:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.715755:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367154 00000020:00080000:2.0:1788572216.715759:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.715762:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367154 00000100:00100000:0.0:1788572216.718983:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.719766:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615175936 00000100:00100000:2.0:1788572216.719779:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615175936 00000100:00100000:2.0:1788572216.719989:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11006 00000100:00100000:2.0:1788572216.720031:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+712:2382:x1875449615175936:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.720066:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367154, current: 214748367154, replaying 00000100:00100000:2.0:1788572216.720084:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+712:2382:x1875449615175936:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 85us (1108us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.720092:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11006 00000020:00080000:1.0:1788572216.720152:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.720157:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367154, next_transno: 214748367154 00010000:00080000:1.0:1788572216.720162:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367154) 00000020:00080000:1.0:1788572216.720165:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.720175:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615175936 t214748367154 from 192.168.202.13@tcp req@ffff94e506550e00 x1875449615175936/t0(214748367154) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.720293:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e864 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720310:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e864 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720328:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e864 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720342:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x128288a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720350:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x128288a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720357:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x128288a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720557:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e872 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x481:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720566:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e872 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x481:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720573:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e872 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x481:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.720804:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].177, 64 off19520 00010000:00010000:1.0:1788572216.720882:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e872 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x481:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720890:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e872 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x481:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720896:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e872 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x481:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720903:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.720908:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e872 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x481:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720916:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e872 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x481:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720929:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x481:0x0].0x0 (ffff94e61e543f00) 00010000:00010000:1.0:1788572216.720933:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.720938:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e872 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x481:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720945:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e872 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x481:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720967:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e864 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720974:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e864 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720979:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e864 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720983:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.720985:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e864 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720991:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e864 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.720998:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543700) 00010000:00010000:1.0:1788572216.721001:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.721057:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e864 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.721064:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e864 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.721076:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b811943 reply state 00000000113e2970 transno 214748367154 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x128288a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.721086:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x128288a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.721092:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x128288a8 (ffff94e61e543500) 00010000:00010000:1.0:1788572216.721094:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.721097:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.721187:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.721206:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.721209:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367155 00000020:00080000:1.0:1788572216.721212:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.721214:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367155 00000100:00100000:3.0:1788572216.726313:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.726442:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615176320 00000100:00100000:2.0:1788572216.726453:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615176320 00000100:00100000:2.0:1788572216.726564:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11007 00000100:00100000:2.0:1788572216.726577:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+714:2382:x1875449615176320:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.726599:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367155, current: 214748367155, replaying 00000100:00100000:2.0:1788572216.726620:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+714:2382:x1875449615176320:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (319us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.726627:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11007 00000020:00080000:1.0:1788572216.726679:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.726683:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367155, next_transno: 214748367155 00010000:00080000:1.0:1788572216.726687:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367155) 00000020:00080000:1.0:1788572216.726690:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.726700:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615176320 t214748367155 from 192.168.202.13@tcp req@ffff94e61e635c00 x1875449615176320/t0(214748367155) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.726805:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e879 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.726820:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e879 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.726834:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e879 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.726851:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.726858:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.726865:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727060:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e887 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x482:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727069:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e887 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x482:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727076:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e887 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x482:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.727304:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].178, 64 off19584 00010000:00010000:1.0:1788572216.727357:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e887 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x482:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727363:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e887 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x482:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727367:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e887 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x482:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727371:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.727375:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e887 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x482:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727381:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e887 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x482:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727393:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x482:0x0].0x0 (ffff94e61e543400) 00010000:00010000:1.0:1788572216.727396:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.727401:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e887 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x482:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727408:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e887 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x482:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727426:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e879 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727433:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e879 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727437:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e879 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727440:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.727442:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e879 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727445:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e879 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727450:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543700) 00010000:00010000:1.0:1788572216.727451:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.727454:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e879 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727457:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e879 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.727464:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041ebe670 reply state 000000002861d27e transno 214748367155 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727472:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.727476:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcda5f5a9 (ffff94e61e543f00) 00010000:00010000:1.0:1788572216.727477:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.727479:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.727537:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.727550:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.727552:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367156 00000020:00080000:1.0:1788572216.727554:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.727556:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367156 00000100:00100000:2.0:1788572216.731993:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.732470:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615176704 00000100:00100000:1.0:1788572216.732483:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615176704 00000100:00100000:1.0:1788572216.732550:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11008 00000100:00100000:1.0:1788572216.732560:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+716:2382:x1875449615176704:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.732585:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367156, current: 214748367156, replaying 00000100:00100000:1.0:1788572216.732642:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+716:2382:x1875449615176704:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 84us (660us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.732651:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11008 00000020:00080000:2.0:1788572216.732752:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.732757:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367156, next_transno: 214748367156 00010000:00080000:2.0:1788572216.732762:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367156) 00000020:00080000:2.0:1788572216.732765:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.732775:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615176704 t214748367156 from 192.168.202.13@tcp req@ffff94e50552e300 x1875449615176704/t0(214748367156) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.732886:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e88e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.732976:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e88e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.732993:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e88e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.733335:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.733347:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.733356:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.733639:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e89c lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x483:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.733649:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e89c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x483:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.733668:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e89c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x483:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.733926:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].178, 64 off19584 00010000:00010000:2.0:1788572216.733990:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e89c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x483:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.733999:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e89c lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x483:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734260:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e89c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x483:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734267:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.734272:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e89c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x483:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734347:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e89c lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x483:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734360:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x483:0x0].0x0 (ffff94e60fa15c00) 00010000:00010000:2.0:1788572216.734363:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.734368:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e89c lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x483:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734375:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e89c lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x483:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734468:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e88e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734479:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e88e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734485:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e88e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734490:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.734493:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e88e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734499:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e88e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734507:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15f00) 00010000:00010000:2.0:1788572216.734509:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.734513:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e88e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734518:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e88e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.734532:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a28e1b4 reply state 00000000a951a429 transno 214748367156 ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734544:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.734551:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2d6a4a22 (ffff94e60fa15d00) 00010000:00010000:2.0:1788572216.734553:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.734555:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.734722:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.734743:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.734747:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367157 00000020:00080000:2.0:1788572216.734751:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.734753:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367157 00000100:00100000:0.0:1788572216.738250:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.738938:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615177088 00000100:00100000:2.0:1788572216.738952:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615177088 00000100:00100000:2.0:1788572216.739109:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11009 00000100:00100000:2.0:1788572216.739122:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+718:2382:x1875449615177088:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.739144:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367157, current: 214748367157, replaying 00000100:00100000:2.0:1788572216.739168:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+718:2382:x1875449615177088:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 50us (930us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.739175:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11009 00000020:00080000:3.0:1788572216.739228:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.739233:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367157, next_transno: 214748367157 00010000:00080000:3.0:1788572216.739237:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367157) 00000020:00080000:3.0:1788572216.739240:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.739250:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615177088 t214748367157 from 192.168.202.13@tcp req@ffff94e506552a00 x1875449615177088/t0(214748367157) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.739346:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e8a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739365:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e8a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739389:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e8a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739403:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739409:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739416:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739583:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e8b1 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x484:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739591:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e8b1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739602:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e8b1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.739831:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].179, 64 off19648 00010000:00010000:3.0:1788572216.739890:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e8b1 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739898:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e8b1 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739904:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e8b1 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739910:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.739915:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e8b1 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739922:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e8b1 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739934:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x484:0x0].0x0 (ffff94e641297800) 00010000:00010000:3.0:1788572216.739937:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.739942:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e8b1 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739950:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831e8b1 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x484:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739971:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e8a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739982:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e8a3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739988:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e8a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.739994:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.739997:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e8a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.740031:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e8a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.740039:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297b00) 00010000:00010000:3.0:1788572216.740040:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.740043:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e8a3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.740046:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831e8a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.740056:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e210ee0 reply state 00000000aec49c8d transno 214748367157 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.740066:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.740073:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa2e582cb (ffff94e641297200) 00010000:00010000:3.0:1788572216.740075:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.740077:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.740147:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.740163:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.740166:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367158 00000020:00080000:3.0:1788572216.740170:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.740172:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367158 00000100:00100000:3.0:1788572216.742299:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.743323:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615177472 00000100:00100000:0.0:1788572216.743338:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615177472 00000100:00100000:0.0:1788572216.743424:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11010 00000100:00100000:0.0:1788572216.743435:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+720:2382:x1875449615177472:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.743459:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367158, current: 214748367158, replaying 00000100:00100000:0.0:1788572216.743478:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+720:2382:x1875449615177472:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (1200us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.743486:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11010 00000020:00080000:3.0:1788572216.743597:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.743603:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367158, next_transno: 214748367158 00010000:00080000:3.0:1788572216.743608:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367158) 00000020:00080000:3.0:1788572216.743611:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.743621:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615177472 t214748367158 from 192.168.202.13@tcp req@ffff94e61e636d80 x1875449615177472/t0(214748367158) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.743766:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e8b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.743784:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e8b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.743796:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e8b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.743810:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.743817:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.743823:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744129:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e8c6 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x485:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744138:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e8c6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x485:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744146:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e8c6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x485:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.744544:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].179, 64 off19648 00010000:00010000:3.0:1788572216.744612:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e8c6 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x485:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744620:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e8c6 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x485:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744627:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e8c6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x485:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744633:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.744638:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e8c6 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x485:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744646:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e8c6 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x485:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744669:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x485:0x0].0x0 (ffff94e633d6f900) 00010000:00010000:3.0:1788572216.744673:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.744679:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e8c6 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x485:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744690:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831e8c6 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x485:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744714:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e8b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744721:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e8b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744727:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e8b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744732:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.744736:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e8b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744743:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e8b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744750:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f500) 00010000:00010000:3.0:1788572216.744753:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.744756:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e8b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744761:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831e8b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.744774:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e3936cd reply state 00000000ecb4aeac transno 214748367158 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744784:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.744791:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc1cc8c44 (ffff94e633d6fd00) 00010000:00010000:3.0:1788572216.744793:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.744796:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.744895:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.744915:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.744918:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367159 00000020:00080000:3.0:1788572216.744922:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.744924:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367159 00000100:00100000:0.0:1788572216.748111:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.748220:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615177856 00000100:00100000:2.0:1788572216.748234:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615177856 00000100:00100000:2.0:1788572216.748320:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11011 00000100:00100000:2.0:1788572216.748331:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+722:2382:x1875449615177856:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.748362:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367159, current: 214748367159, replaying 00000100:00100000:2.0:1788572216.748385:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+722:2382:x1875449615177856:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 50us (278us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.748392:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11011 00000020:00080000:3.0:1788572216.748583:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.748588:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367159, next_transno: 214748367159 00010000:00080000:3.0:1788572216.748592:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367159) 00000020:00080000:3.0:1788572216.748596:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.748605:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615177856 t214748367159 from 192.168.202.13@tcp req@ffff94e506551f80 x1875449615177856/t0(214748367159) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.748708:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e8cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.748725:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e8cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.748737:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e8cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.748754:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.748761:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.748771:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749034:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e8db lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x486:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749043:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e8db lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x486:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749050:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e8db lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x486:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.749341:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].180, 64 off19712 00010000:00010000:3.0:1788572216.749472:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e8db lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x486:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749481:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e8db lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x486:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749488:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e8db lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x486:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749493:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.749498:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e8db lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x486:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749506:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e8db lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x486:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749519:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x486:0x0].0x0 (ffff94e633d6f300) 00010000:00010000:3.0:1788572216.749522:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.749527:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e8db lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x486:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749535:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e8db lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x486:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749556:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e8cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749563:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e8cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749568:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e8cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749573:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0de00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.749576:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e8cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749581:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e8cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749588:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6ff00) 00010000:00010000:3.0:1788572216.749591:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.749594:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e8cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749599:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e8cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.749609:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca4a66f6 reply state 0000000066a99805 transno 214748367159 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749623:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.749629:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94f3e445 (ffff94e633d6fa00) 00010000:00010000:3.0:1788572216.749631:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.749634:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.749779:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.749798:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.749801:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367160 00000020:00080000:3.0:1788572216.749805:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.749807:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367160 00000100:00100000:0.0:1788572216.752056:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.752298:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615178240 00000100:00100000:3.0:1788572216.752308:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615178240 00000100:00100000:3.0:1788572216.752364:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11012 00000100:00100000:3.0:1788572216.752375:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+724:2382:x1875449615178240:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.752513:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367160, current: 214748367160, replaying 00000100:00100000:3.0:1788572216.752534:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+724:2382:x1875449615178240:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 161us (533us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.752542:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11012 00000020:00080000:1.0:1788572216.752593:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.752598:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367160, next_transno: 214748367160 00010000:00080000:1.0:1788572216.752602:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367160) 00000020:00080000:1.0:1788572216.752605:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.752615:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615178240 t214748367160 from 192.168.202.13@tcp req@ffff94e506553100 x1875449615178240/t0(214748367160) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.752726:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e8e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.752742:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e8e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.752753:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e8e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.752767:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.752773:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.752779:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.752970:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e8f0 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x487:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.752981:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e8f0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x487:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.752989:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e8f0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x487:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.753265:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].180, 64 off19712 00010000:00010000:1.0:1788572216.753325:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e8f0 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x487:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753333:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e8f0 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x487:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753340:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e8f0 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x487:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753345:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.753350:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e8f0 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x487:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753358:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e8f0 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x487:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753370:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x487:0x0].0x0 (ffff94e61e543d00) 00010000:00010000:1.0:1788572216.753374:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.753504:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e8f0 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x487:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753512:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831e8f0 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x487:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753536:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e8e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753542:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e8e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753552:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e8e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753556:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.753559:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e8e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753565:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e8e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753573:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543700) 00010000:00010000:1.0:1788572216.753576:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.753579:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e8e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753584:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831e8e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.753596:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9f41379 reply state 000000005f0031e8 transno 214748367160 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753605:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.753611:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9df73dfe (ffff94e61e543400) 00010000:00010000:1.0:1788572216.753613:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.753615:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.753704:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.753722:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.753725:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367161 00000020:00080000:1.0:1788572216.753730:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.753731:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367161 00000100:00100000:0.0:1788572216.756710:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.756827:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615178624 00000100:00100000:3.0:1788572216.756840:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615178624 00000100:00100000:3.0:1788572216.757167:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11013 00000100:00100000:3.0:1788572216.757183:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+726:2382:x1875449615178624:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.757206:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367161, current: 214748367161, replaying 00000100:00100000:3.0:1788572216.757224:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+726:2382:x1875449615178624:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (529us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.757231:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11013 00000020:00080000:1.0:1788572216.757271:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.757282:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367161, next_transno: 214748367161 00010000:00080000:1.0:1788572216.757288:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367161) 00000020:00080000:1.0:1788572216.757291:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.757300:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615178624 t214748367161 from 192.168.202.13@tcp req@ffff94e641695c00 x1875449615178624/t0(214748367161) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.757404:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831e8f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.757420:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831e8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.757432:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831e8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.757447:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91d19777 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.757454:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d19777 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.757460:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d19777 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.757677:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831e905 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x488:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.757685:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831e905 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x488:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.757693:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831e905 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x488:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.757940:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].181, 64 off19776 00010000:00010000:1.0:1788572216.758026:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831e905 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x488:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758035:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831e905 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x488:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758042:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831e905 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x488:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758048:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.758053:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831e905 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x488:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758073:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831e905 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x488:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758087:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x488:0x0].0x0 (ffff94e602c23300) 00010000:00010000:1.0:1788572216.758090:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.758095:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831e905 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x488:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758101:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831e905 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x488:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758123:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831e8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758134:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831e8f7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758139:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831e8f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758144:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.758147:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831e8f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758153:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831e8f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758161:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6411e7900) 00010000:00010000:1.0:1788572216.758164:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.758167:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831e8f7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758173:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831e8f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.758186:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b434c3ab reply state 00000000bb4ffb71 transno 214748367161 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d19777 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758197:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d19777 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.758203:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d19777 (ffff94e602c23200) 00010000:00010000:1.0:1788572216.758205:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.758208:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.758291:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.758308:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.758312:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367162 00000020:00080000:1.0:1788572216.758316:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.758318:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367162 00000100:00100000:3.0:1788572216.760647:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.761192:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615179008 00000100:00100000:2.0:1788572216.761205:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615179008 00000100:00100000:2.0:1788572216.761307:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11014 00000100:00100000:2.0:1788572216.761319:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+728:2382:x1875449615179008:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.761341:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367162, current: 214748367162, replaying 00000100:00100000:2.0:1788572216.761360:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+728:2382:x1875449615179008:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (725us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.761367:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11014 00000020:00080000:3.0:1788572216.761444:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.761449:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367162, next_transno: 214748367162 00010000:00080000:3.0:1788572216.761453:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367162) 00000020:00080000:3.0:1788572216.761456:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.761466:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615179008 t214748367162 from 192.168.202.13@tcp req@ffff94e61e634e00 x1875449615179008/t0(214748367162) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.761567:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e90c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.761582:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e90c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.761593:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e90c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.761605:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.761611:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.761618:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.761806:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e91a lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x489:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.761816:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e91a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x489:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.761825:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e91a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x489:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.762082:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].181, 64 off19776 00010000:00010000:3.0:1788572216.762147:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e91a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x489:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762156:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e91a lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x489:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762162:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e91a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x489:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762169:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.762174:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e91a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x489:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762182:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e91a lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x489:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762195:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x489:0x0].0x0 (ffff94e633d6f700) 00010000:00010000:3.0:1788572216.762197:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.762202:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e91a lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x489:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762208:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e91a lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x489:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762228:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e90c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762239:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e90c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762245:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e90c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762250:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.762252:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e90c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762257:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e90c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762264:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f500) 00010000:00010000:3.0:1788572216.762266:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.762269:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e90c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762274:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e90c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.762287:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001aed4f2e reply state 0000000084e24357 transno 214748367162 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762297:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.762304:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9fe20f0 (ffff94e633d6f900) 00010000:00010000:3.0:1788572216.762307:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.762310:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.762387:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.762405:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.762408:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367163 00000020:00080000:3.0:1788572216.762411:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.762413:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367163 00000100:00100000:0.0:1788572216.767838:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.767931:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615179392 00000100:00100000:1.0:1788572216.767942:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615179392 00000100:00100000:1.0:1788572216.768097:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11015 00000100:00100000:1.0:1788572216.768109:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+730:2382:x1875449615179392:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.768130:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367163, current: 214748367163, replaying 00000100:00100000:1.0:1788572216.768154:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+730:2382:x1875449615179392:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (327us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.768161:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11015 00000020:00080000:0.0:1788572216.768203:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.768208:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367163, next_transno: 214748367163 00010000:00080000:0.0:1788572216.768212:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367163) 00000020:00080000:0.0:1788572216.768215:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.768225:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615179392 t214748367163 from 192.168.202.13@tcp req@ffff94e641696680 x1875449615179392/t0(214748367163) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.768335:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4200/0xdb7edb52b831e921 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.768353:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4200/0xdb7edb52b831e921 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.768366:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4200/0xdb7edb52b831e921 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.768390:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xacde22df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.768398:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacde22df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.768408:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacde22df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.768613:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e92f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x48a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.768621:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e92f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.768628:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e92f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.768914:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].182, 64 off19840 00010000:00010000:0.0:1788572216.768980:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e92f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.768988:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e92f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x48a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.768995:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e92f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769001:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637791800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.769039:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e92f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769048:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e92f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x48a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769061:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x48a:0x0].0x0 (ffff94e60ff78600) 00010000:00010000:0.0:1788572216.769064:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.769069:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e92f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x48a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769076:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791800/0xdb7edb52b831e92f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x48a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769098:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4200/0xdb7edb52b831e921 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769105:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4200/0xdb7edb52b831e921 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769110:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4200/0xdb7edb52b831e921 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769116:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e4200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.769118:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4200/0xdb7edb52b831e921 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769123:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4200/0xdb7edb52b831e921 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769130:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78800) 00010000:00010000:0.0:1788572216.769133:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.769135:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4200/0xdb7edb52b831e921 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769141:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4200/0xdb7edb52b831e921 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.769152:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f45e20f6 reply state 0000000098358445 transno 214748367163 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacde22df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769167:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacde22df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.769174:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xacde22df (ffff94e60ff78000) 00010000:00010000:0.0:1788572216.769177:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.769179:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.769265:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.769285:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.769289:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367164 00000020:00080000:0.0:1788572216.769292:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.769294:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367164 00000100:00100000:0.0:1788572216.772615:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.772787:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615179776 00000100:00100000:2.0:1788572216.772799:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615179776 00000100:00100000:2.0:1788572216.772911:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11016 00000100:00100000:2.0:1788572216.772924:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+732:2382:x1875449615179776:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.772951:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367164, current: 214748367164, replaying 00000100:00100000:2.0:1788572216.772976:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+732:2382:x1875449615179776:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 56us (372us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.772984:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11016 00000020:00080000:0.0:1788572216.773036:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.773041:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367164, next_transno: 214748367164 00010000:00080000:0.0:1788572216.773047:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367164) 00000020:00080000:0.0:1788572216.773050:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.773069:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615179776 t214748367164 from 192.168.202.13@tcp req@ffff94e641695180 x1875449615179776/t0(214748367164) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.773175:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e936 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773191:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e936 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773203:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e936 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773215:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773223:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773229:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773430:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e944 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x48b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773439:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e944 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773446:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e944 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.773682:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].182, 64 off19840 00010000:00010000:0.0:1788572216.773752:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e944 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773759:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e944 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x48b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773766:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e944 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773772:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.773776:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e944 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773784:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e944 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x48b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773801:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x48b:0x0].0x0 (ffff94e60ff78c00) 00010000:00010000:0.0:1788572216.773803:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.773808:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e944 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x48b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773814:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728a00/0xdb7edb52b831e944 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x48b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773835:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e936 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773841:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e936 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773846:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e936 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773851:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.773853:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e936 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773859:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e936 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773866:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78400) 00010000:00010000:0.0:1788572216.773869:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.773872:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e936 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773877:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729000/0xdb7edb52b831e936 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.773892:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f436f84 reply state 00000000d7fc2bfc transno 214748367164 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773903:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.773910:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc4cf9758 (ffff94e60ff78100) 00010000:00010000:0.0:1788572216.773913:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.773916:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.774029:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.774051:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.774053:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367165 00000020:00080000:0.0:1788572216.774057:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.774059:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367165 00000100:00100000:2.0:1788572216.777967:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.778886:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615180160 00000100:00100000:1.0:1788572216.778900:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615180160 00000100:00100000:0.0:1788572216.779934:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11017 00000100:00100000:0.0:1788572216.779950:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+734:2382:x1875449615180160:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.779972:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367165, current: 214748367165, replaying 00000100:00100000:0.0:1788572216.780099:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+734:2382:x1875449615180160:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 153us (2142us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.780107:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11017 00000020:00080000:3.0:1788572216.780414:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.780427:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367165, next_transno: 214748367165 00010000:00080000:3.0:1788572216.780433:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367165) 00000020:00080000:3.0:1788572216.780436:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.780446:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615180160 t214748367165 from 192.168.202.13@tcp req@ffff94e50552fb80 x1875449615180160/t0(214748367165) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.780561:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e94b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.780578:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e94b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.780590:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e94b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.780603:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x17e88459 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.780611:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x17e88459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.780618:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x17e88459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.780950:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e959 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x48c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.780965:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e959 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.780972:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e959 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.781572:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].183, 64 off19904 00010000:00010000:3.0:1788572216.781631:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e959 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781639:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e959 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x48c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781645:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e959 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781651:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0de00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.781655:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e959 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781675:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e959 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x48c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781688:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x48c:0x0].0x0 (ffff94e633d6ff00) 00010000:00010000:3.0:1788572216.781691:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.781697:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e959 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x48c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781703:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e959 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x48c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781731:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e94b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781737:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e94b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781742:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e94b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781814:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.781817:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e94b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781823:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e94b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781832:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f500) 00010000:00010000:3.0:1788572216.781834:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.781837:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e94b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781843:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e94b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.781857:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054d49db3 reply state 00000000ee1e7d03 transno 214748367165 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x17e88459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781867:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17e88459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.781873:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x17e88459 (ffff94e633d6f700) 00010000:00010000:3.0:1788572216.781876:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.781878:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.781969:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.781989:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.781992:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367166 00000020:00080000:3.0:1788572216.781996:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.781998:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367166 00000100:00100000:1.0:1788572216.791922:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.792172:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615180544 00000100:00100000:3.0:1788572216.792187:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615180544 00000100:00100000:3.0:1788572216.792816:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11018 00000100:00100000:3.0:1788572216.792830:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+736:2382:x1875449615180544:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.792851:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367166, current: 214748367166, replaying 00000100:00100000:3.0:1788572216.792871:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+736:2382:x1875449615180544:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (960us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.792879:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11018 00000020:00080000:0.0:1788572216.792906:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.792911:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367166, next_transno: 214748367166 00010000:00080000:0.0:1788572216.792916:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367166) 00000020:00080000:0.0:1788572216.792919:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.792931:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615180544 t214748367166 from 192.168.202.13@tcp req@ffff94e6412b1880 x1875449615180544/t0(214748367166) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.793175:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e960 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793193:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e960 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793215:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e960 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793229:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793237:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793244:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793441:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e96e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x48d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793451:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e96e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793457:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e96e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.793644:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].183, 64 off19904 00010000:00010000:0.0:1788572216.793705:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e96e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793710:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e96e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x48d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793716:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e96e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793721:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.793725:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e96e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793733:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e96e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x48d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793755:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x48d:0x0].0x0 (ffff94e60ff78800) 00010000:00010000:0.0:1788572216.793759:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.793764:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e96e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x48d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793771:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e96e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x48d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793790:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e960 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793794:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e960 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793798:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e960 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793801:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.793802:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e960 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793808:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e960 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793813:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78400) 00010000:00010000:0.0:1788572216.793815:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.793816:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e960 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793820:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e960 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.793827:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009de69e64 reply state 0000000071cee423 transno 214748367166 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793834:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.793839:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4a4bde12 (ffff94e60ff78c00) 00010000:00010000:0.0:1788572216.793840:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.793842:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.793917:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.793939:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.793942:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367167 00000020:00080000:0.0:1788572216.793946:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.793948:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367167 00000100:00100000:0.0:1788572216.798834:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.798923:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615180928 00000100:00100000:3.0:1788572216.798936:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615180928 00000100:00100000:3.0:1788572216.799046:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11019 00000100:00100000:3.0:1788572216.799069:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+738:2382:x1875449615180928:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.799093:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367167, current: 214748367167, replaying 00000100:00100000:3.0:1788572216.799117:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+738:2382:x1875449615180928:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 60us (294us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.799124:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11019 00000020:00080000:0.0:1788572216.799143:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.799149:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367167, next_transno: 214748367167 00010000:00080000:0.0:1788572216.799153:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367167) 00000020:00080000:0.0:1788572216.799156:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.799166:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615180928 t214748367167 from 192.168.202.13@tcp req@ffff94e641696a00 x1875449615180928/t0(214748367167) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.799403:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e975 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.799484:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e975 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.799499:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e975 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.799514:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.799521:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.799526:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.799709:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e983 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x48e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.799716:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e983 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.799722:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e983 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.800671:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].184, 64 off19968 00010000:00010000:0.0:1788572216.800828:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e983 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800838:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e983 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x48e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800844:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e983 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800850:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.800855:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e983 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800863:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e983 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x48e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800876:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x48e:0x0].0x0 (ffff94e60ff78e00) 00010000:00010000:0.0:1788572216.800879:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.800885:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e983 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x48e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800892:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e983 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x48e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800918:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e975 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800925:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e975 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800931:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e975 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800935:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.800938:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e975 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800943:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e975 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800950:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78600) 00010000:00010000:0.0:1788572216.800953:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.800955:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e975 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800961:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e975 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.800973:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d15467d reply state 000000008b5ed783 transno 214748367167 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800985:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.800992:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x66eb16bb (ffff94e60ff78200) 00010000:00010000:0.0:1788572216.800994:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.800997:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.801328:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.801349:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.801352:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367168 00000020:00080000:0.0:1788572216.801357:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.801359:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367168 00000100:00100000:2.0:1788572216.804979:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.805157:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615181312 00000100:00100000:0.0:1788572216.805168:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615181312 00000100:00100000:0.0:1788572216.805388:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11020 00000100:00100000:0.0:1788572216.805401:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+740:2382:x1875449615181312:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.805433:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367168, current: 214748367168, replaying 00000100:00100000:0.0:1788572216.805454:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+740:2382:x1875449615181312:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 56us (485us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.805461:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11020 00000020:00080000:3.0:1788572216.805514:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.805519:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367168, next_transno: 214748367168 00010000:00080000:3.0:1788572216.805523:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367168) 00000020:00080000:3.0:1788572216.805526:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.805535:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615181312 t214748367168 from 192.168.202.13@tcp req@ffff94e50552ca80 x1875449615181312/t0(214748367168) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.805625:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e98a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.805642:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e98a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.805655:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e98a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.805681:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.805689:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.805695:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.805881:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e998 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x48f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.805891:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e998 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.805898:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e998 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.806139:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].184, 64 off19968 00010000:00010000:3.0:1788572216.806191:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e998 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x48f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806199:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e998 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x48f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806218:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e998 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806225:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.806229:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e998 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x48f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806236:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e998 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x48f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806250:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x48f:0x0].0x0 (ffff94e633d6f300) 00010000:00010000:3.0:1788572216.806253:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.806257:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e998 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x48f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806264:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e998 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x48f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806295:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e98a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806301:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e98a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806307:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e98a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806312:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.806316:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e98a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806323:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e98a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806331:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f500) 00010000:00010000:3.0:1788572216.806333:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.806336:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e98a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806343:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e98a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.806355:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecc8939f reply state 00000000077cd24f transno 214748367168 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806365:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.806372:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb4ae2034 (ffff94e633d6ff00) 00010000:00010000:3.0:1788572216.806375:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.806378:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.806466:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.806484:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.806488:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367169 00000020:00080000:3.0:1788572216.806492:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.806494:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367169 00000100:00100000:2.0:1788572216.810926:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572216.811187:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615181696 00000100:00100000:1.0:1788572216.811198:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615181696 00000100:00100000:1.0:1788572216.811309:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11021 00000100:00100000:1.0:1788572216.811320:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+742:2382:x1875449615181696:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572216.811342:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367169, current: 214748367169, replaying 00000100:00100000:1.0:1788572216.811364:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+742:2382:x1875449615181696:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 47us (453us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572216.811372:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11021 00000020:00080000:0.0:1788572216.811426:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.811431:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367169, next_transno: 214748367169 00010000:00080000:0.0:1788572216.811437:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367169) 00000020:00080000:0.0:1788572216.811440:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.811450:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615181696 t214748367169 from 192.168.202.13@tcp req@ffff94e50552d500 x1875449615181696/t0(214748367169) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.811555:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e99f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.811572:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e99f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.811584:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e99f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.811596:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x87d57835 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.811603:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x87d57835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.811610:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x87d57835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812144:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9ad lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x490:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812155:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9ad lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x490:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812162:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9ad lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x490:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.812400:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].185, 64 off20032 00010000:00010000:0.0:1788572216.812465:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9ad lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x490:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812474:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9ad lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x490:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812481:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9ad lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x490:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812487:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.812492:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9ad lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x490:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812500:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9ad lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x490:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812512:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x490:0x0].0x0 (ffff94e60ff78400) 00010000:00010000:0.0:1788572216.812515:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.812519:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9ad lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x490:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812530:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9ad lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x490:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812550:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e99f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812556:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e99f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812562:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e99f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812567:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.812570:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e99f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812576:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e99f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812582:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78600) 00010000:00010000:0.0:1788572216.812584:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.812587:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e99f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812592:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e99f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.812601:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097338d88 reply state 0000000028a75d7c transno 214748367169 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x87d57835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812611:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x87d57835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.812618:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x87d57835 (ffff94e60ff78e00) 00010000:00010000:0.0:1788572216.812620:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.812623:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.812913:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.812935:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.812938:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367170 00000020:00080000:0.0:1788572216.812942:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.812944:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367170 00000100:00100000:1.0:1788572216.826156:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.826506:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615182080 00000100:00100000:2.0:1788572216.826516:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615182080 00000100:00100000:2.0:1788572216.826609:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11022 00000100:00100000:2.0:1788572216.826620:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+744:2382:x1875449615182080:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.826641:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367170, current: 214748367170, replaying 00000100:00100000:2.0:1788572216.826675:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+744:2382:x1875449615182080:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 57us (530us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.826681:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11022 00000020:00080000:0.0:1788572216.826758:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.826766:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367170, next_transno: 214748367170 00010000:00080000:0.0:1788572216.826771:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367170) 00000020:00080000:0.0:1788572216.826775:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.826786:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615182080 t214748367170 from 192.168.202.13@tcp req@ffff94e63aeb0700 x1875449615182080/t0(214748367170) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.826894:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e9b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.826912:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e9b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.826925:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e9b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.826937:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe839ccae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.826943:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe839ccae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.826954:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe839ccae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827183:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e9c2 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x491:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827192:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e9c2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x491:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827200:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e9c2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x491:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.827456:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].185, 64 off20032 00010000:00010000:0.0:1788572216.827513:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e9c2 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x491:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827520:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e9c2 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x491:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827527:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e9c2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x491:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827532:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.827537:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e9c2 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x491:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827545:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e9c2 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x491:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827558:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x491:0x0].0x0 (ffff94e60ff78800) 00010000:00010000:0.0:1788572216.827561:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.827568:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e9c2 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x491:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827575:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831e9c2 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x491:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827596:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e9b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827602:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e9b4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827607:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e9b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827613:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.827616:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e9b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827622:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e9b4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827629:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78600) 00010000:00010000:0.0:1788572216.827631:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.827635:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e9b4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827639:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831e9b4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.827650:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2156eb2 reply state 00000000838e2876 transno 214748367170 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe839ccae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827677:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe839ccae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.827682:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe839ccae (ffff94e60ff78400) 00010000:00010000:0.0:1788572216.827685:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.827687:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.827773:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.827791:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.827794:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367171 00000020:00080000:0.0:1788572216.827798:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.827800:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367171 00000100:00100000:2.0:1788572216.831449:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.831593:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615182464 00000100:00100000:0.0:1788572216.831603:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615182464 00000100:00100000:0.0:1788572216.831675:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11023 00000100:00100000:0.0:1788572216.831685:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+746:2382:x1875449615182464:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.831708:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367171, current: 214748367171, replaying 00000100:00100000:0.0:1788572216.831732:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+746:2382:x1875449615182464:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 49us (293us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.831739:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11023 00000020:00080000:3.0:1788572216.831865:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.831870:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367171, next_transno: 214748367171 00010000:00080000:3.0:1788572216.831874:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367171) 00000020:00080000:3.0:1788572216.831878:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.831888:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615182464 t214748367171 from 192.168.202.13@tcp req@ffff94e50552c000 x1875449615182464/t0(214748367171) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.831983:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e9c9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.831999:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e9c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.833903:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e9c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834178:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834196:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834205:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834401:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e9d7 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x492:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834410:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e9d7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x492:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834417:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e9d7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x492:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.834636:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].186, 64 off20096 00010000:00010000:2.0:1788572216.834703:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e9d7 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x492:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834712:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e9d7 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x492:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834730:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e9d7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x492:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834736:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.834741:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e9d7 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x492:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834754:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e9d7 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x492:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834772:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x492:0x0].0x0 (ffff94e60fa15c00) 00010000:00010000:2.0:1788572216.834776:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.834780:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e9d7 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x492:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834787:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561600/0xdb7edb52b831e9d7 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x492:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834807:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e9c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834813:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e9c9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834819:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e9c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834824:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.834827:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e9c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834833:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e9c9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834839:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f500) 00010000:00010000:2.0:1788572216.834841:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.834844:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e9c9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834849:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831e9c9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.834865:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087075c3f reply state 00000000c4409e47 transno 214748367171 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834876:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.834882:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x82bdab67 (ffff94e60fa15f00) 00010000:00010000:2.0:1788572216.834884:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.834887:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.834983:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.835036:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.835039:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367172 00000020:00080000:2.0:1788572216.835044:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.835046:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367172 00000100:00100000:1.0:1788572216.838176:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.838261:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615182848 00000100:00100000:3.0:1788572216.838271:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615182848 00000100:00100000:3.0:1788572216.838396:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11024 00000100:00100000:3.0:1788572216.838407:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+748:2382:x1875449615182848:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.838430:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367172, current: 214748367172, replaying 00000100:00100000:3.0:1788572216.838448:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+748:2382:x1875449615182848:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (287us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.838455:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11024 00000020:00080000:2.0:1788572216.838496:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.838501:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367172, next_transno: 214748367172 00010000:00080000:2.0:1788572216.838506:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367172) 00000020:00080000:2.0:1788572216.838509:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.838519:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615182848 t214748367172 from 192.168.202.13@tcp req@ffff94e63aeb2d80 x1875449615182848/t0(214748367172) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.838618:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e9de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.838636:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e9de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.838649:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e9de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.838673:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.838678:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.838682:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.838833:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831e9ec lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x493:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.838840:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831e9ec lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x493:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.838844:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831e9ec lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x493:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.839072:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].186, 64 off20096 00010000:00010000:2.0:1788572216.839133:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831e9ec lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x493:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839141:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831e9ec lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x493:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839148:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831e9ec lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x493:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839154:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ef000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.839159:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831e9ec lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x493:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839171:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831e9ec lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x493:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839184:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x493:0x0].0x0 (ffff94e60fa15400) 00010000:00010000:2.0:1788572216.839187:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.839192:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831e9ec lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x493:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839198:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831e9ec lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x493:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839231:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e9de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839235:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e9de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839239:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e9de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839243:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.839245:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e9de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839251:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e9de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839257:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15e00) 00010000:00010000:2.0:1788572216.839259:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.839261:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e9de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839796:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52200/0xdb7edb52b831e9de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.839812:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b908ddae reply state 00000000735daac7 transno 214748367172 ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839821:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.839825:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1a4b4e0 (ffff94e60fa15600) 00010000:00010000:2.0:1788572216.839827:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.839830:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.839908:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.839926:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.839929:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367173 00000020:00080000:2.0:1788572216.839933:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.839935:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367173 00000100:00100000:3.0:1788572216.843898:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.844140:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615183232 00000100:00100000:0.0:1788572216.844151:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615183232 00000100:00100000:2.0:1788572216.844412:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11025 00000100:00100000:2.0:1788572216.844424:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+750:2382:x1875449615183232:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.844444:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367173, current: 214748367173, replaying 00000100:00100000:2.0:1788572216.844465:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+750:2382:x1875449615183232:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (580us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.844472:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11025 00000020:00080000:3.0:1788572216.844514:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.844519:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367173, next_transno: 214748367173 00010000:00080000:3.0:1788572216.844524:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367173) 00000020:00080000:3.0:1788572216.844528:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.844541:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615183232 t214748367173 from 192.168.202.13@tcp req@ffff94e61e634700 x1875449615183232/t0(214748367173) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.844633:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e9f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.844647:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e9f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.844667:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e9f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.844680:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.844687:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.844694:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.844901:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea01 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x494:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.844911:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea01 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x494:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.844918:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea01 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x494:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.845245:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].187, 64 off20160 00010000:00010000:3.0:1788572216.845306:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea01 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x494:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845315:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea01 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x494:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845322:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea01 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x494:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845326:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.845329:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea01 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x494:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845334:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea01 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x494:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845344:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x494:0x0].0x0 (ffff94e633d6f800) 00010000:00010000:3.0:1788572216.845346:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.845349:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea01 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x494:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845353:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea01 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x494:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845366:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e9f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845369:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e9f3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845373:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e9f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845376:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.845379:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e9f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845388:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e9f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845395:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f300) 00010000:00010000:3.0:1788572216.845397:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.845400:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e9f3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845405:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831e9f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.845418:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e47cca9b reply state 00000000ba0d96ab transno 214748367173 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845428:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.845434:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d1263cd (ffff94e633d6f600) 00010000:00010000:3.0:1788572216.845436:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.845438:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.845504:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.845520:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.845523:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367174 00000020:00080000:3.0:1788572216.845527:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.845529:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367174 00000100:00100000:2.0:1788572216.847644:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.847774:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615183616 00000100:00100000:0.0:1788572216.847784:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615183616 00000100:00100000:0.0:1788572216.847845:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11026 00000100:00100000:0.0:1788572216.847855:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+752:2382:x1875449615183616:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.847877:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367174, current: 214748367174, replaying 00000100:00100000:0.0:1788572216.847899:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+752:2382:x1875449615183616:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (268us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.847915:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11026 00000020:00080000:3.0:1788572216.847975:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.847981:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367174, next_transno: 214748367174 00010000:00080000:3.0:1788572216.847985:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367174) 00000020:00080000:3.0:1788572216.847988:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.848000:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615183616 t214748367174 from 192.168.202.13@tcp req@ffff94e618432680 x1875449615183616/t0(214748367174) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.848124:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea08 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848135:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848143:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848151:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848156:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848159:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848392:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea16 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x495:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848418:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea16 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x495:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848440:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea16 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x495:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.848807:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].187, 64 off20160 00010000:00010000:3.0:1788572216.848883:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea16 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x495:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848896:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea16 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x495:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848903:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea16 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x495:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848909:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0cc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.848914:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea16 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x495:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.848921:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea16 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x495:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.849344:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x495:0x0].0x0 (ffff94e633d6f400) 00010000:00010000:3.0:1788572216.849348:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.849364:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea16 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x495:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.849372:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea16 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x495:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.849481:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea08 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.849488:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea08 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.849492:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.849504:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0dc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.849507:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea08 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.849511:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea08 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.849517:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6fb00) 00010000:00010000:3.0:1788572216.849519:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.849521:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea08 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.849525:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea08 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.849542:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c43d077f reply state 00000000079261d1 transno 214748367174 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.849550:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.849553:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f76b846 (ffff94e633d6f000) 00010000:00010000:3.0:1788572216.849555:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.849557:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.849709:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.849728:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.849746:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367175 00000020:00080000:3.0:1788572216.849751:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.849753:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367175 00000100:00100000:1.0:1788572216.852100:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.852230:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615184000 00000100:00100000:2.0:1788572216.852238:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615184000 00000100:00100000:2.0:1788572216.852307:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11027 00000100:00100000:2.0:1788572216.852319:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+754:2382:x1875449615184000:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.852341:0:95742:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367175, current: 214748367175, replaying 00000100:00100000:2.0:1788572216.852352:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+754:2382:x1875449615184000:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 36us (361us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.852358:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11027 00000020:00080000:3.0:1788572216.852361:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.852380:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367175, next_transno: 214748367175 00010000:00080000:3.0:1788572216.852385:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367175) 00000020:00080000:3.0:1788572216.852388:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.852408:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615184000 t214748367175 from 192.168.202.13@tcp req@ffff94e63aeb2a00 x1875449615184000/t0(214748367175) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.852627:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea1d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.852647:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.852666:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.852694:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.852702:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.852709:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.852912:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea2b lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x496:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.852921:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea2b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x496:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.852928:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea2b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x496:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.853774:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].188, 64 off20224 00000004:00080000:3.0:1788572216.853783:0:112013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4133874778056ns, next at 4134874775664ns, rc = 0 00010000:00010000:3.0:1788572216.853848:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea2b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x496:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853857:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea2b lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x496:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853864:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea2b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x496:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853871:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.853877:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea2b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x496:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853887:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea2b lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x496:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853901:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x496:0x0].0x0 (ffff94e633d6f200) 00010000:00010000:3.0:1788572216.853905:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.853911:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea2b lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x496:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853918:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea2b lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x496:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853951:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea1d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853957:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea1d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853963:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853971:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0da00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.853974:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea1d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853980:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea1d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853987:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f100) 00010000:00010000:3.0:1788572216.853989:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.853992:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea1d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.853998:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea1d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.854267:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050ddfabe reply state 00000000ab245e5f transno 214748367175 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.854284:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.854291:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcaee2547 (ffff94e633d6fc00) 00010000:00010000:3.0:1788572216.854293:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.854296:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.854569:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.854591:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.854594:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367176 00000020:00080000:2.0:1788572216.854598:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.854600:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367176 00000100:00100000:1.0:1788572216.857738:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.858058:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615184384 00000100:00100000:0.0:1788572216.858069:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615184384 00000100:00100000:2.0:1788572216.859790:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11028 00000100:00100000:2.0:1788572216.859813:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+756:2382:x1875449615184384:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.859835:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367176, current: 214748367176, replaying 00000100:00100000:2.0:1788572216.859892:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+756:2382:x1875449615184384:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 91us (2164us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.859897:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11028 00000020:00080000:0.0:1788572216.859953:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.859956:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367176, next_transno: 214748367176 00010000:00080000:0.0:1788572216.859960:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367176) 00000020:00080000:0.0:1788572216.859962:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.859970:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615184384 t214748367176 from 192.168.202.13@tcp req@ffff94e63aeb1180 x1875449615184384/t0(214748367176) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.860096:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831ea32 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860119:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831ea32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860129:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831ea32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860136:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x51517f00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860140:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x51517f00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860144:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x51517f00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860318:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831ea40 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x497:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860326:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831ea40 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x497:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860333:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831ea40 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x497:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.860571:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].188, 64 off20224 00000004:00080000:0.0:1788572216.860579:0:112013:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 4133881574134ns, next at 4134881571867ns, rc = 0 00010000:00010000:0.0:1788572216.860635:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831ea40 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x497:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860642:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831ea40 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x497:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860649:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831ea40 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x497:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860666:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.860671:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831ea40 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x497:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860679:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831ea40 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x497:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860692:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x497:0x0].0x0 (ffff94e60ff78500) 00010000:00010000:0.0:1788572216.860695:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.860699:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831ea40 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x497:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860706:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831ea40 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x497:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860729:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831ea32 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860733:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831ea32 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860737:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831ea32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860740:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.860741:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831ea32 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860745:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831ea32 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860753:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78600) 00010000:00010000:0.0:1788572216.860755:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.860757:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831ea32 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860763:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831ea32 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.860774:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088f3dc2b reply state 0000000022f906bd transno 214748367176 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x51517f00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860785:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51517f00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.860792:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x51517f00 (ffff94e60ff78800) 00010000:00010000:0.0:1788572216.860795:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.860798:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.860878:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.860893:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.860895:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367177 00000020:00080000:0.0:1788572216.860898:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.860899:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367177 00000100:00100000:3.0:1788572216.867381:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.868459:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615184768 00000100:00100000:0.0:1788572216.868472:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615184768 00000100:00100000:0.0:1788572216.868549:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11029 00000100:00100000:0.0:1788572216.868559:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+758:2382:x1875449615184768:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.868580:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367177, current: 214748367177, replaying 00000100:00100000:0.0:1788572216.868602:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+758:2382:x1875449615184768:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (1232us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.868611:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11029 00000020:00080000:3.0:1788572216.868704:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.868709:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367177, next_transno: 214748367177 00010000:00080000:3.0:1788572216.868713:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367177) 00000020:00080000:3.0:1788572216.868716:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.868726:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615184768 t214748367177 from 192.168.202.13@tcp req@ffff94e61e635500 x1875449615184768/t0(214748367177) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.868842:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea47 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.868859:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.868872:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.868886:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.868893:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.868900:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869127:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea55 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x498:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869137:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea55 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x498:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869145:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea55 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x498:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.869376:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].189, 64 off20288 00010000:00010000:3.0:1788572216.869436:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea55 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x498:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869443:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea55 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x498:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869451:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea55 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x498:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869456:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0dc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.869460:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea55 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x498:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869467:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea55 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x498:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869478:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x498:0x0].0x0 (ffff94e633d6fb00) 00010000:00010000:3.0:1788572216.869481:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.869487:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea55 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x498:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869493:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea55 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x498:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869513:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea47 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869519:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea47 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869524:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869528:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0da00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.869531:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea47 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869540:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea47 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869547:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f100) 00010000:00010000:3.0:1788572216.869549:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.869552:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea47 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869557:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea47 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.869569:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061c76724 reply state 0000000008aafc88 transno 214748367177 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869579:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.869585:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e4f57a9 (ffff94e633d6f200) 00010000:00010000:3.0:1788572216.869587:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.869590:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.869688:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.869705:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.869708:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367178 00000020:00080000:3.0:1788572216.869712:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.869714:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367178 00000100:00100000:2.0:1788572216.873185:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.873306:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615185152 00000100:00100000:3.0:1788572216.873316:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615185152 00000100:00100000:3.0:1788572216.873372:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11030 00000100:00100000:3.0:1788572216.873383:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+760:2382:x1875449615185152:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.873407:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367178, current: 214748367178, replaying 00000100:00100000:3.0:1788572216.873421:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+760:2382:x1875449615185152:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 41us (321us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.873428:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11030 00000020:00080000:3.0:1788572216.873448:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.873452:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367178, next_transno: 214748367178 00010000:00080000:3.0:1788572216.873456:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367178) 00000020:00080000:3.0:1788572216.873460:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.873469:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615185152 t214748367178 from 192.168.202.13@tcp req@ffff94e618430e00 x1875449615185152/t0(214748367178) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.873583:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea5c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.873600:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.873613:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.873627:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.873634:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.873640:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.873983:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea6a lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x499:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.873990:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea6a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x499:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.873995:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea6a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x499:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.874840:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].189, 64 off20288 00010000:00010000:2.0:1788572216.874926:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea6a lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x499:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.874936:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea6a lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x499:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.874944:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea6a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x499:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.874954:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.874959:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea6a lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x499:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.874967:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea6a lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x499:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.874981:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x499:0x0].0x0 (ffff94e633d6f800) 00010000:00010000:2.0:1788572216.875061:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.875066:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea6a lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x499:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.875074:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ea6a lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x499:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.875147:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.875154:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea5c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.875172:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.875178:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0cc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.875181:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.875187:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea5c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.875223:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f400) 00010000:00010000:2.0:1788572216.875225:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.875229:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea5c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.875235:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831ea5c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.875248:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a89c9e3 reply state 00000000d81fde01 transno 214748367178 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.875259:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.875267:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d5fc122 (ffff94e633d6f300) 00010000:00010000:2.0:1788572216.875269:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.875272:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.876061:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.876086:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.876090:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367179 00000020:00080000:2.0:1788572216.876094:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.876096:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367179 00000100:00100000:1.0:1788572216.885728:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.885888:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615185536 00000100:00100000:2.0:1788572216.885911:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615185536 00000100:00100000:2.0:1788572216.885983:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11031 00000100:00100000:2.0:1788572216.885995:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+762:2382:x1875449615185536:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.886039:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367179, current: 214748367179, replaying 00000100:00100000:2.0:1788572216.886120:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+762:2382:x1875449615185536:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 126us (401us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.886128:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11031 00000020:00080000:3.0:1788572216.889519:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.889529:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367179, next_transno: 214748367179 00010000:00080000:3.0:1788572216.889535:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367179) 00000020:00080000:3.0:1788572216.889539:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.889555:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615185536 t214748367179 from 192.168.202.13@tcp req@ffff94e63aeb0000 x1875449615185536/t0(214748367179) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.889756:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea71 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.889776:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.889788:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.889813:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.889820:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.889826:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890057:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831ea7f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x49a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890066:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831ea7f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890074:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831ea7f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.890338:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].190, 64 off20352 00010000:00010000:2.0:1788572216.890398:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831ea7f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890411:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831ea7f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x49a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890418:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831ea7f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890424:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ee200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.890428:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831ea7f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890436:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831ea7f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x49a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890449:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x49a:0x0].0x0 (ffff94e60fa15c00) 00010000:00010000:2.0:1788572216.890452:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.890457:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831ea7f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x49a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890464:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831ea7f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x49a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890486:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890492:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea71 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890498:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890503:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ef000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.890507:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890512:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea71 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890519:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15e00) 00010000:00010000:2.0:1788572216.890521:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.890523:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea71 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890528:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea71 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.890539:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008807d410 reply state 00000000f722fd9e transno 214748367179 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890550:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.890556:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8db1923 (ffff94e60fa15400) 00010000:00010000:2.0:1788572216.890558:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.890561:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.890666:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.890686:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.890689:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367180 00000020:00080000:2.0:1788572216.890693:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.890695:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367180 00000100:00100000:3.0:1788572216.895181:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.895536:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615185920 00000100:00100000:0.0:1788572216.895549:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615185920 00000100:00100000:0.0:1788572216.895616:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11032 00000100:00100000:0.0:1788572216.895628:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+764:2382:x1875449615185920:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.895653:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367180, current: 214748367180, replaying 00000100:00100000:0.0:1788572216.895689:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+764:2382:x1875449615185920:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 64us (519us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.895696:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11032 00000020:00080000:3.0:1788572216.895951:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.895956:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367180, next_transno: 214748367180 00010000:00080000:3.0:1788572216.895960:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367180) 00000020:00080000:3.0:1788572216.895964:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.895973:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615185920 t214748367180 from 192.168.202.13@tcp req@ffff94e61e637b80 x1875449615185920/t0(214748367180) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.896097:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831ea86 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896123:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831ea86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896135:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831ea86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896151:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896158:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896164:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896323:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea94 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x49b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896331:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea94 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896338:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea94 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.896560:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].190, 64 off20352 00010000:00010000:3.0:1788572216.896620:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea94 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896628:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea94 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x49b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896636:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea94 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896642:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0dc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.896646:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea94 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896670:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea94 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x49b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896683:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x49b:0x0].0x0 (ffff94e633d6fe00) 00010000:00010000:3.0:1788572216.896686:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.896691:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea94 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x49b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896697:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831ea94 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x49b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896718:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831ea86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896724:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831ea86 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896729:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831ea86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896734:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0ca00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.896737:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831ea86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896743:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831ea86 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896750:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f100) 00010000:00010000:3.0:1788572216.896752:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.896755:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831ea86 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.896766:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831ea86 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.896777:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f401b6ee reply state 00000000168a2019 transno 214748367180 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.897286:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.897297:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeac20d9c (ffff94e633d6fb00) 00010000:00010000:3.0:1788572216.897299:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.897302:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.897387:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.897404:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.897407:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367181 00000020:00080000:3.0:1788572216.897411:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.897414:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367181 00000100:00100000:1.0:1788572216.905744:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572216.905840:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615186304 00000100:00100000:3.0:1788572216.905852:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615186304 00000100:00100000:3.0:1788572216.905934:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11033 00000100:00100000:3.0:1788572216.905945:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+766:2382:x1875449615186304:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572216.905968:0:6551:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367181, current: 214748367181, replaying 00000100:00100000:3.0:1788572216.905993:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+766:2382:x1875449615186304:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 50us (261us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572216.906000:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11033 00000020:00080000:2.0:1788572216.906148:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.906153:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367181, next_transno: 214748367181 00010000:00080000:2.0:1788572216.906158:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367181) 00000020:00080000:2.0:1788572216.906161:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.906171:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615186304 t214748367181 from 192.168.202.13@tcp req@ffff94e63aeb1c00 x1875449615186304/t0(214748367181) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572216.906275:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea9b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906292:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906304:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906319:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906326:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906339:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906532:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee800/0xdb7edb52b831eaa9 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x49c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906541:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee800/0xdb7edb52b831eaa9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906549:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee800/0xdb7edb52b831eaa9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572216.906793:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].191, 64 off20416 00010000:00010000:2.0:1788572216.906850:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee800/0xdb7edb52b831eaa9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906858:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee800/0xdb7edb52b831eaa9 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x49c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906865:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee800/0xdb7edb52b831eaa9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906870:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ee800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.906875:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee800/0xdb7edb52b831eaa9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906882:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee800/0xdb7edb52b831eaa9 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x49c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.906894:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x49c:0x0].0x0 (ffff94e60fa15700) 00010000:00010000:2.0:1788572216.906898:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572216.907207:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee800/0xdb7edb52b831eaa9 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x49c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.907217:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee800/0xdb7edb52b831eaa9 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x49c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.907243:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.907250:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea9b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.907257:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea9b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.907263:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ef000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572216.907266:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea9b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.907272:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea9b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.907281:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15e00) 00010000:00010000:2.0:1788572216.907284:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572216.907287:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea9b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.907292:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef000/0xdb7edb52b831ea9b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572216.907306:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8a864b4 reply state 00000000de92feab transno 214748367181 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.907319:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572216.907325:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf30ec55 (ffff94e60fa15c00) 00010000:00010000:2.0:1788572216.907328:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572216.907330:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572216.907429:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572216.907452:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.907455:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367182 00000020:00080000:2.0:1788572216.907459:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572216.907461:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367182 00000100:00100000:1.0:1788572216.915814:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.915950:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615186688 00000100:00100000:0.0:1788572216.915961:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615186688 00000100:00100000:0.0:1788572216.916055:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11034 00000100:00100000:0.0:1788572216.916067:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+768:2382:x1875449615186688:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.916092:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367182, current: 214748367182, replaying 00000100:00100000:0.0:1788572216.916120:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+768:2382:x1875449615186688:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 57us (319us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.916128:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11034 00000020:00080000:3.0:1788572216.916491:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.916497:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367182, next_transno: 214748367182 00010000:00080000:3.0:1788572216.916501:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367182) 00000020:00080000:3.0:1788572216.916504:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.916528:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615186688 t214748367182 from 192.168.202.13@tcp req@ffff94e63aeb3800 x1875449615186688/t0(214748367182) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.916678:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eab0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.916697:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eab0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.916708:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eab0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.916720:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa99155ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.916726:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa99155ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.916733:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa99155ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.916935:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eabe lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x49d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.916944:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eabe lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.916952:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eabe lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.917369:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].191, 64 off20416 00010000:00010000:3.0:1788572216.917431:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eabe lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917439:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eabe lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x49d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917446:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eabe lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917453:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0dc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.917458:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eabe lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917466:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eabe lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x49d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917479:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x49d:0x0].0x0 (ffff94e633d6f400) 00010000:00010000:3.0:1788572216.917482:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.917487:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eabe lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x49d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917494:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eabe lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x49d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917512:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eab0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917518:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eab0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917524:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eab0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917534:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0cc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.917537:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eab0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917542:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eab0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917549:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f100) 00010000:00010000:3.0:1788572216.917551:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.917554:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eab0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917559:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eab0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.917569:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020977f76 reply state 000000003b6636ff transno 214748367182 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa99155ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917579:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa99155ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.917585:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa99155ce (ffff94e633d6fe00) 00010000:00010000:3.0:1788572216.917588:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.917590:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.917681:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.917700:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.917702:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367183 00000020:00080000:3.0:1788572216.917705:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.917708:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367183 00000100:00100000:3.0:1788572216.920292:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.920381:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615187072 00000100:00100000:0.0:1788572216.920390:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615187072 00000100:00100000:0.0:1788572216.920499:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11035 00000100:00100000:0.0:1788572216.920520:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+770:2382:x1875449615187072:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.920543:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367183, current: 214748367183, replaying 00000100:00100000:0.0:1788572216.920561:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+770:2382:x1875449615187072:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 53us (279us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.920568:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11035 00000020:00080000:3.0:1788572216.920604:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.920608:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367183, next_transno: 214748367183 00010000:00080000:3.0:1788572216.920613:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367183) 00000020:00080000:3.0:1788572216.920617:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.920627:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615187072 t214748367183 from 192.168.202.13@tcp req@ffff94e61e634380 x1875449615187072/t0(214748367183) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.920738:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eac5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.920753:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eac5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.920765:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eac5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.920777:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.920783:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.920801:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.920992:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ead3 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x49e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921001:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ead3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921046:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ead3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.921306:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].192, 64 off20480 00010000:00010000:3.0:1788572216.921363:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ead3 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921371:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ead3 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x49e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921378:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ead3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921385:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.921389:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ead3 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921397:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ead3 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x49e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921409:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x49e:0x0].0x0 (ffff94e641297b00) 00010000:00010000:3.0:1788572216.921412:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.921418:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ead3 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x49e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921425:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ead3 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x49e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921445:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eac5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921452:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eac5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921463:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eac5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921468:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.921471:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eac5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921477:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eac5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921485:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f800) 00010000:00010000:3.0:1788572216.921487:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.921490:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eac5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921496:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eac5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.921507:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026776a10 reply state 000000003c3deda5 transno 214748367183 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921517:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.921523:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd9fe77be (ffff94e633d6f500) 00010000:00010000:3.0:1788572216.921525:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.921528:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.921592:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.921607:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.921610:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367184 00000020:00080000:3.0:1788572216.921614:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.921616:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367184 00000100:00100000:1.0:1788572216.926469:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.929256:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615187456 00000100:00100000:2.0:1788572216.929273:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615187456 00000100:00100000:2.0:1788572216.929344:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11036 00000100:00100000:2.0:1788572216.929356:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+772:2382:x1875449615187456:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.929377:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367184, current: 214748367184, replaying 00000100:00100000:2.0:1788572216.929391:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+772:2382:x1875449615187456:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 39us (2933us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.929399:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11036 00000020:00080000:0.0:1788572216.931877:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.931889:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367184, next_transno: 214748367184 00010000:00080000:0.0:1788572216.931894:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367184) 00000020:00080000:0.0:1788572216.931898:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.931978:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615187456 t214748367184 from 192.168.202.13@tcp req@ffff94e5032b6a00 x1875449615187456/t0(214748367184) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572216.932099:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831eada lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.932115:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831eada lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.932128:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831eada lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.932147:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.932154:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.932160:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.932344:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831eae8 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x49f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.932353:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831eae8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.932360:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831eae8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572216.933767:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].192, 64 off20480 00010000:00010000:0.0:1788572216.933983:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831eae8 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x49f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.933994:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831eae8 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x49f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934018:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831eae8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934025:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.934029:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831eae8 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x49f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934041:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831eae8 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x49f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934054:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x49f:0x0].0x0 (ffff94e60ff78d00) 00010000:00010000:0.0:1788572216.934057:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572216.934061:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831eae8 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x49f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934068:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831eae8 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x49f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934091:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831eada lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934097:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831eada lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934103:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831eada lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934108:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572216.934111:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831eada lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934117:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831eada lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934125:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78600) 00010000:00010000:0.0:1788572216.934128:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572216.934131:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831eada lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934141:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376000/0xdb7edb52b831eada lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572216.934154:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082aa131c reply state 000000001a15861b transno 214748367184 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934166:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572216.934173:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1062cc37 (ffff94e60ff78500) 00010000:00010000:0.0:1788572216.934176:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572216.934179:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572216.934267:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572216.934287:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.934290:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367185 00000020:00080000:0.0:1788572216.934294:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572216.934296:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367185 00000100:00100000:1.0:1788572216.936460:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.936586:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615187840 00000100:00100000:0.0:1788572216.936597:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615187840 00000100:00100000:0.0:1788572216.936721:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11037 00000100:00100000:0.0:1788572216.936732:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+774:2382:x1875449615187840:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.936753:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367185, current: 214748367185, replaying 00000100:00100000:0.0:1788572216.936776:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+774:2382:x1875449615187840:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (326us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.936782:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11037 00000020:00080000:3.0:1788572216.936828:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.936833:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367185, next_transno: 214748367185 00010000:00080000:3.0:1788572216.936838:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367185) 00000020:00080000:3.0:1788572216.936841:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.936850:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615187840 t214748367185 from 192.168.202.13@tcp req@ffff94e5032b6300 x1875449615187840/t0(214748367185) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.936942:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eaef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.936959:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eaef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.936972:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eaef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.936985:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.936991:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.936997:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937210:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eafd lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937219:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eafd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937226:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eafd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.937457:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].193, 64 off20544 00010000:00010000:3.0:1788572216.937532:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eafd lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937541:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eafd lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937548:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eafd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937554:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.937558:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eafd lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937564:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eafd lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937576:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4a0:0x0].0x0 (ffff94e633d6f400) 00010000:00010000:3.0:1788572216.937579:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.937583:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eafd lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937589:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eafd lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4a0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937610:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eaef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937620:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eaef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937626:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eaef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937631:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0cc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.937634:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eaef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937639:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eaef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937647:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641297800) 00010000:00010000:3.0:1788572216.937649:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.937652:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eaef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937669:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eaef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.937681:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097547e4d reply state 00000000d46e10fd transno 214748367185 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937691:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.937697:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe5da3938 (ffff94e633d6f100) 00010000:00010000:3.0:1788572216.937699:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.937702:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.937774:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.937789:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.937792:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367186 00000020:00080000:3.0:1788572216.937796:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.937798:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367186 00000100:00100000:3.0:1788572216.947975:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.948191:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615188224 00000100:00100000:2.0:1788572216.948203:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615188224 00000100:00100000:2.0:1788572216.948276:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11038 00000100:00100000:2.0:1788572216.948287:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+776:2382:x1875449615188224:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.948311:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367186, current: 214748367186, replaying 00000100:00100000:2.0:1788572216.948328:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+776:2382:x1875449615188224:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 44us (366us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.948336:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11038 00000020:00080000:3.0:1788572216.948446:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.948450:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367186, next_transno: 214748367186 00010000:00080000:3.0:1788572216.948455:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367186) 00000020:00080000:3.0:1788572216.948457:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.948467:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615188224 t214748367186 from 192.168.202.13@tcp req@ffff94e61e636a00 x1875449615188224/t0(214748367186) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.948572:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.948588:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.948601:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.948615:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.948623:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.948629:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.948837:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb12 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.948845:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb12 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.948853:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb12 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.949166:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].193, 64 off20544 00010000:00010000:3.0:1788572216.949224:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb12 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949233:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb12 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949240:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb12 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949246:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.949250:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb12 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949258:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb12 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949438:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4a1:0x0].0x0 (ffff94e641642800) 00010000:00010000:3.0:1788572216.949442:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.949447:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb12 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949459:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb12 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949483:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949490:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb04 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949496:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949501:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.949504:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949510:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb04 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949517:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633d6f800) 00010000:00010000:3.0:1788572216.949519:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.949522:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb04 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949526:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb04 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.949539:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab6c02cd reply state 000000004a0dc854 transno 214748367186 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949547:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.949554:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5aee8db1 (ffff94e641297b00) 00010000:00010000:3.0:1788572216.949556:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.949559:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.949678:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.949696:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.949698:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367187 00000020:00080000:3.0:1788572216.949701:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.949703:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367187 00000100:00100000:1.0:1788572216.955467:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.955551:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615188608 00000100:00100000:0.0:1788572216.955562:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615188608 00000100:00100000:0.0:1788572216.955630:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11039 00000100:00100000:0.0:1788572216.955641:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+778:2382:x1875449615188608:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.955673:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367187, current: 214748367187, replaying 00000100:00100000:0.0:1788572216.955698:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+778:2382:x1875449615188608:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 59us (242us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.955705:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11039 00000020:00080000:1.0:1788572216.955873:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.955876:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367187, next_transno: 214748367187 00010000:00080000:1.0:1788572216.955880:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367187) 00000020:00080000:1.0:1788572216.955883:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.955891:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615188608 t214748367187 from 192.168.202.13@tcp req@ffff94e5032b6680 x1875449615188608/t0(214748367187) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.955984:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb19 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.955998:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956052:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956068:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956076:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956082:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956295:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb27 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4a2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956305:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb27 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956312:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb27 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.956529:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].194, 64 off20608 00010000:00010000:1.0:1788572216.956576:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb27 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956581:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb27 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956587:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb27 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956591:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.956594:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb27 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956599:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb27 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956609:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4a2:0x0].0x0 (ffff94e61e543700) 00010000:00010000:1.0:1788572216.956611:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.956615:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb27 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956622:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb27 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4a2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956640:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956643:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb19 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956647:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb19 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956650:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.956651:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb19 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956709:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb19 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956718:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e602c23300) 00010000:00010000:1.0:1788572216.956720:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.956723:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb19 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956729:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb19 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.956743:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094f6009f reply state 0000000020f760d3 transno 214748367187 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956754:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.956760:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb7e87b5a (ffff94e6411e7900) 00010000:00010000:1.0:1788572216.956763:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.956765:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.956845:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.956863:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.956866:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367188 00000020:00080000:1.0:1788572216.956869:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.956872:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367188 00000100:00100000:1.0:1788572216.961126:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572216.961264:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615188992 00000100:00100000:2.0:1788572216.961286:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615188992 00000100:00100000:2.0:1788572216.961394:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11040 00000100:00100000:2.0:1788572216.961405:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+780:2382:x1875449615188992:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572216.961426:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367188, current: 214748367188, replaying 00000100:00100000:2.0:1788572216.961444:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+780:2382:x1875449615188992:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 42us (329us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572216.961452:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11040 00000020:00080000:1.0:1788572216.961493:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.961498:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367188, next_transno: 214748367188 00010000:00080000:1.0:1788572216.961502:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367188) 00000020:00080000:1.0:1788572216.961504:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.961527:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615188992 t214748367188 from 192.168.202.13@tcp req@ffff94e5032b7800 x1875449615188992/t0(214748367188) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.961632:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eb2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.961644:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eb2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.961670:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eb2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.961694:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x924bd513 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.961701:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x924bd513 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.961710:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x924bd513 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.961913:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb3c lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.961921:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb3c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.961928:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb3c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.962176:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].194, 64 off20608 00010000:00010000:1.0:1788572216.962231:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb3c lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962239:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb3c lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962246:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb3c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962252:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.962257:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb3c lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962264:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb3c lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962277:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4a3:0x0].0x0 (ffff94e637739200) 00010000:00010000:1.0:1788572216.962280:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.962286:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb3c lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962292:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb3c lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962317:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eb2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962323:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eb2e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962328:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eb2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962333:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.962337:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eb2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962343:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eb2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962351:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e543d00) 00010000:00010000:1.0:1788572216.962353:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.962356:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eb2e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962363:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eb2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.962374:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000526052a4 reply state 0000000028b882ca transno 214748367188 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x924bd513 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962389:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x924bd513 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.962395:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x924bd513 (ffff94e637739c00) 00010000:00010000:1.0:1788572216.962398:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.962400:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.962494:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.962509:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.962511:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367189 00000020:00080000:1.0:1788572216.962514:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.962515:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367189 00000100:00100000:2.0:1788572216.972468:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.981970:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615189376 00000100:00100000:0.0:1788572216.981989:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615189376 00000100:00100000:0.0:1788572216.982103:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11041 00000100:00100000:0.0:1788572216.982117:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+782:2382:x1875449615189376:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.982145:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367189, current: 214748367189, replaying 00000100:00100000:0.0:1788572216.982175:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+782:2382:x1875449615189376:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 62us (9716us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.982182:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11041 00000020:00080000:3.0:1788572216.982349:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.982355:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367189, next_transno: 214748367189 00010000:00080000:3.0:1788572216.982360:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367189) 00000020:00080000:3.0:1788572216.982365:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.982375:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615189376 t214748367189 from 192.168.202.13@tcp req@ffff94e618430700 x1875449615189376/t0(214748367189) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572216.982474:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb43 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.982491:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.982504:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.982532:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.982539:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.982549:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.982778:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb51 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4a4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.982787:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb51 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.982795:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb51 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572216.983112:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].195, 64 off20672 00010000:00010000:3.0:1788572216.983173:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb51 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983181:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb51 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983187:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb51 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983192:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.983197:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb51 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983206:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb51 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983219:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4a4:0x0].0x0 (ffff94e641642000) 00010000:00010000:3.0:1788572216.983222:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572216.983227:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb51 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983233:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb51 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4a4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983257:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb43 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983263:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb43 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983270:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983275:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572216.983278:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb43 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983284:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb43 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983291:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641642800) 00010000:00010000:3.0:1788572216.983293:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572216.983296:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb43 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983302:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb43 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572216.983314:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002549b784 reply state 00000000b2e9077e transno 214748367189 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983329:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572216.983335:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x17bcad14 (ffff94e641642b00) 00010000:00010000:3.0:1788572216.983338:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572216.983340:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572216.983433:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572216.983453:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.983455:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367190 00000020:00080000:3.0:1788572216.983460:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572216.983462:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367190 00000100:00100000:2.0:1788572216.986678:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.989140:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615189760 00000100:00100000:0.0:1788572216.989160:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615189760 00000100:00100000:0.0:1788572216.989246:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11042 00000100:00100000:0.0:1788572216.989259:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+784:2382:x1875449615189760:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.989280:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367190, current: 214748367190, replaying 00000100:00100000:0.0:1788572216.989307:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+784:2382:x1875449615189760:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 52us (2642us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.989315:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11042 00000020:00080000:1.0:1788572216.991112:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.991124:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367190, next_transno: 214748367190 00010000:00080000:1.0:1788572216.991130:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367190) 00000020:00080000:1.0:1788572216.991133:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.991149:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615189760 t214748367190 from 192.168.202.13@tcp req@ffff94e618433b80 x1875449615189760/t0(214748367190) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572216.991258:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb58 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991278:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991293:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991305:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7821018d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991316:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7821018d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991322:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7821018d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991515:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb66 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991524:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb66 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991532:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb66 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572216.991780:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].195, 64 off20672 00010000:00010000:1.0:1788572216.991843:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb66 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991852:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb66 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991859:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb66 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991866:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.991871:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb66 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991880:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb66 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991897:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4a5:0x0].0x0 (ffff94e637739500) 00010000:00010000:1.0:1788572216.991900:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572216.991904:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb66 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991911:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb66 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991933:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991940:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb58 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991946:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb58 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991952:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572216.991955:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb58 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991961:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb58 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991969:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e637739200) 00010000:00010000:1.0:1788572216.991972:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572216.991975:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb58 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.991982:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb58 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572216.991999:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015f3b45c reply state 00000000744509c4 transno 214748367190 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7821018d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.992069:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7821018d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572216.992076:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7821018d (ffff94e637739e00) 00010000:00010000:1.0:1788572216.992078:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572216.992081:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572216.992176:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572216.992197:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.992199:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367191 00000020:00080000:1.0:1788572216.992203:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572216.992205:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367191 00000100:00100000:1.0:1788572216.999671:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572216.999754:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615190144 00000100:00100000:0.0:1788572216.999766:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615190144 00000100:00100000:0.0:1788572216.999839:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11043 00000100:00100000:0.0:1788572216.999851:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+786:2382:x1875449615190144:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572216.999876:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367191, current: 214748367191, replaying 00000100:00100000:0.0:1788572216.999898:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+786:2382:x1875449615190144:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 49us (250us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572216.999905:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11043 00000020:00080000:1.0:1788572217.000080:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572217.000085:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367191, next_transno: 214748367191 00010000:00080000:1.0:1788572217.000089:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367191) 00000020:00080000:1.0:1788572217.000092:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572217.000103:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615190144 t214748367191 from 192.168.202.13@tcp req@ffff94e6131cc380 x1875449615190144/t0(214748367191) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:632/0 lens 504/0 e 0 to 0 dl 1788572227 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572217.000207:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000225:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000239:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000251:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1a049006 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000258:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1a049006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000264:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1a049006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000461:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb7b lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000470:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb7b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000478:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb7b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572217.000758:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].196, 64 off20736 00010000:00010000:1.0:1788572217.000825:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb7b lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000834:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb7b lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000842:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb7b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000849:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572217.000853:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb7b lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000867:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb7b lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000881:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4a6:0x0].0x0 (ffff94e637739d00) 00010000:00010000:1.0:1788572217.000884:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572217.000890:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb7b lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000896:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb7b lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000918:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000924:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb6d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000930:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000935:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572217.000938:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000945:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb6d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000953:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e637739200) 00010000:00010000:1.0:1788572217.000955:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572217.000958:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000968:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb6d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572217.000981:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f282227 reply state 00000000faad2d47 transno 214748367191 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1a049006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000992:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a049006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.000998:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1a049006 (ffff94e637739500) 00010000:00010000:1.0:1788572217.001001:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572217.001047:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572217.001144:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572217.001162:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572217.001165:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367192 00000020:00080000:1.0:1788572217.001169:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572217.001171:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367192 00000100:00100000:2.0:1788572217.011681:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572217.011779:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615190528 00000100:00100000:0.0:1788572217.011788:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615190528 00000100:00100000:0.0:1788572217.011850:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11044 00000100:00100000:0.0:1788572217.011861:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+788:2382:x1875449615190528:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572217.011880:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367192, current: 214748367192, replaying 00000100:00100000:0.0:1788572217.011898:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+788:2382:x1875449615190528:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 40us (228us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572217.011905:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11044 00000020:00080000:3.0:1788572217.012100:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.012104:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367192, next_transno: 214748367192 00010000:00080000:3.0:1788572217.012109:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367192) 00000020:00080000:3.0:1788572217.012111:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.012121:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615190528 t214748367192 from 192.168.202.13@tcp req@ffff94e618432a00 x1875449615190528/t0(214748367192) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 504/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572217.012206:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012223:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012235:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012247:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012259:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012265:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012535:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb90 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4a7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012545:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb90 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012552:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb90 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572217.012792:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].196, 64 off20736 00010000:00010000:3.0:1788572217.012855:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb90 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012864:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb90 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012871:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb90 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012878:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.012882:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb90 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.012890:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb90 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.014239:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4a7:0x0].0x0 (ffff94e641642400) 00010000:00010000:3.0:1788572217.014248:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572217.014255:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb90 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.014265:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831eb90 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4a7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.014514:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.014523:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb82 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.014529:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.014535:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.014538:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.014545:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb82 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.014553:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641642800) 00010000:00010000:3.0:1788572217.014556:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572217.014559:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.014565:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831eb82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572217.014583:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e86f145 reply state 000000004c51dae6 transno 214748367192 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.014596:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.014603:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8137e9bf (ffff94e641642000) 00010000:00010000:3.0:1788572217.014605:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572217.014608:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572217.014794:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572217.014821:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.014825:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367193 00000020:00080000:3.0:1788572217.014829:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.014831:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367193 00000100:00100000:2.0:1788572217.024112:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572217.024307:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615190912 00000100:00100000:0.0:1788572217.024318:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615190912 00000100:00100000:0.0:1788572217.024506:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11045 00000100:00100000:0.0:1788572217.024518:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+790:2382:x1875449615190912:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572217.024539:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367193, current: 214748367193, replaying 00000100:00100000:0.0:1788572217.024564:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+790:2382:x1875449615190912:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 50us (464us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572217.024572:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11045 00000020:00080000:1.0:1788572217.024928:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572217.024933:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367193, next_transno: 214748367193 00010000:00080000:1.0:1788572217.024938:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367193) 00000020:00080000:1.0:1788572217.024941:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572217.024951:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615190912 t214748367193 from 192.168.202.13@tcp req@ffff94e618430000 x1875449615190912/t0(214748367193) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 504/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572217.025291:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb97 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.025310:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.025328:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.025342:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.025349:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.025356:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.025665:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eba5 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.025674:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eba5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.025680:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eba5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572217.025927:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].197, 64 off20800 00010000:00010000:1.0:1788572217.025990:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eba5 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.025999:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eba5 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026033:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eba5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026040:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572217.026046:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eba5 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026053:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eba5 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026599:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4a8:0x0].0x0 (ffff94e637739900) 00010000:00010000:1.0:1788572217.026603:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572217.026608:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eba5 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026615:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831eba5 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026642:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026647:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb97 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026662:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb97 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026668:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572217.026671:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb97 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026677:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb97 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026684:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e637739200) 00010000:00010000:1.0:1788572217.026686:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572217.026690:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb97 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026695:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831eb97 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572217.026708:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e2c1713 reply state 0000000041302810 transno 214748367193 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026719:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.026725:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x434f86c1 (ffff94e637739d00) 00010000:00010000:1.0:1788572217.026727:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572217.026730:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572217.026826:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572217.026848:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572217.026851:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367194 00000020:00080000:1.0:1788572217.026856:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572217.026858:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367194 00010000:00010000:3.0:1788572217.027186:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572217.040253:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572217.041055:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615191296 00000100:00100000:2.0:1788572217.041256:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615191296 00000100:00100000:2.0:1788572217.041337:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11046 00000100:00100000:2.0:1788572217.041348:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+792:2382:x1875449615191296:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572217.041371:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367194, current: 214748367194, replaying 00000100:00100000:2.0:1788572217.041638:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+792:2382:x1875449615191296:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 292us (1396us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572217.041646:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11046 00000020:00080000:1.0:1788572217.041729:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572217.041734:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367194, next_transno: 214748367194 00010000:00080000:1.0:1788572217.041740:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367194) 00000020:00080000:1.0:1788572217.041743:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572217.041754:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615191296 t214748367194 from 192.168.202.13@tcp req@ffff94e641696300 x1875449615191296/t0(214748367194) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 504/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572217.041865:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831ebac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.041885:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831ebac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.041912:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831ebac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.041930:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.041938:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.041946:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.042203:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ebba lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4a9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.042214:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ebba lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.042221:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ebba lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788572217.042791:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].197, 64 off20800 00010000:00010000:1.0:1788572217.042865:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ebba lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.042874:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ebba lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.042882:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ebba lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.042889:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572217.042895:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ebba lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043260:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ebba lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043336:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4a9:0x0].0x0 (ffff94e637739f00) 00010000:00010000:1.0:1788572217.043340:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572217.043346:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ebba lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043353:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4000/0xdb7edb52b831ebba lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4a9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043449:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831ebac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043458:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831ebac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043464:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831ebac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043469:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572217.043472:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831ebac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043481:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831ebac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043489:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e637739200) 00010000:00010000:1.0:1788572217.043492:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572217.043495:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831ebac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043501:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675c00/0xdb7edb52b831ebac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572217.043517:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007714e9f3 reply state 00000000bd3b69ce transno 214748367194 ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043528:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.043536:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79b3db3a (ffff94e637739900) 00010000:00010000:1.0:1788572217.043538:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572217.043541:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572217.044100:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572217.044126:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.044129:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367195 00000020:00080000:2.0:1788572217.044134:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.044136:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367195 00000100:00100000:2.0:1788572217.051407:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572217.051506:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615191680 00000100:00100000:1.0:1788572217.051519:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615191680 00000100:00100000:1.0:1788572217.051598:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11047 00000100:00100000:1.0:1788572217.051609:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+794:2382:x1875449615191680:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572217.051631:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367195, current: 214748367195, replaying 00000100:00100000:1.0:1788572217.051661:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+794:2382:x1875449615191680:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 46us (259us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572217.051668:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11047 00000020:00080000:3.0:1788572217.051802:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.051807:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367195, next_transno: 214748367195 00010000:00080000:3.0:1788572217.051812:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367195) 00000020:00080000:3.0:1788572217.051815:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.051827:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615191680 t214748367195 from 192.168.202.13@tcp req@ffff94e618433480 x1875449615191680/t0(214748367195) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 504/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572217.051935:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ebc1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.051954:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ebc1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.051968:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ebc1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.051985:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.051992:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.051999:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052241:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ebcf lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052250:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ebcf lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4aa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052258:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ebcf lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4aa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572217.052522:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].198, 64 off20864 00010000:00010000:3.0:1788572217.052583:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ebcf lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4aa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052592:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ebcf lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4aa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052599:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ebcf lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4aa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052605:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.052610:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ebcf lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4aa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052623:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ebcf lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4aa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052635:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4aa:0x0].0x0 (ffff94e641642100) 00010000:00010000:3.0:1788572217.052638:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572217.052643:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ebcf lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4aa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052649:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ebcf lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4aa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052683:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ebc1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052689:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ebc1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052696:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ebc1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052701:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.052704:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ebc1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052711:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ebc1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052718:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641642800) 00010000:00010000:3.0:1788572217.052721:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572217.052724:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ebc1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052735:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ebc1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572217.052749:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049cfe2ef reply state 000000006650130b transno 214748367195 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052762:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.052768:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdc59e83b (ffff94e641642400) 00010000:00010000:3.0:1788572217.052771:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572217.052774:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788572217.052868:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788572217.052899:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.052902:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367196 00000020:00080000:3.0:1788572217.052906:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.052909:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367196 00000100:00100000:1.0:1788572217.062203:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572217.062313:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615192064 00000100:00100000:0.0:1788572217.062323:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615192064 00000100:00100000:0.0:1788572217.062385:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11048 00000100:00100000:0.0:1788572217.062395:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+796:2382:x1875449615192064:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572217.062415:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367196, current: 214748367196, replaying 00000100:00100000:0.0:1788572217.062438:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+796:2382:x1875449615192064:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (246us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572217.062445:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11048 00000020:00080000:2.0:1788572217.062519:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.062523:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367196, next_transno: 214748367196 00010000:00080000:2.0:1788572217.062528:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367196) 00000020:00080000:2.0:1788572217.062530:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.062550:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615192064 t214748367196 from 192.168.202.13@tcp req@ffff94e6131cd880 x1875449615192064/t0(214748367196) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 504/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572217.062639:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ebd6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.062665:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ebd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.062678:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ebd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.062696:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x686141f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.062703:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x686141f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.062709:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x686141f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.062881:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ebe4 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.062891:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ebe4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.062909:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ebe4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572217.063184:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].198, 64 off20864 00010000:00010000:2.0:1788572217.063247:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ebe4 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063256:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ebe4 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063263:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ebe4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063269:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421eea00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572217.063274:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ebe4 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063286:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ebe4 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063299:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4ab:0x0].0x0 (ffff94e613194e00) 00010000:00010000:2.0:1788572217.063302:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572217.063307:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ebe4 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063314:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ebe4 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4ab:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063339:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ebd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063345:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ebd6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063351:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ebd6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063356:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ee600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572217.063359:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ebd6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063365:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ebd6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063373:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60fa15e00) 00010000:00010000:2.0:1788572217.063376:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572217.063378:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ebd6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063388:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ebd6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572217.063400:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fb49dea reply state 000000009111a31e transno 214748367196 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x686141f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063408:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x686141f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.063414:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x686141f4 (ffff94e60fa15700) 00010000:00010000:2.0:1788572217.063416:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572217.063419:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572217.063494:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572217.063510:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.063513:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367197 00000020:00080000:2.0:1788572217.063517:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.063519:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367197 00000100:00100000:1.0:1788572217.074572:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572217.074745:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615192448 00000100:00100000:3.0:1788572217.074759:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615192448 00000100:00100000:3.0:1788572217.074898:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11049 00000100:00100000:3.0:1788572217.074920:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+798:2382:x1875449615192448:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:3.0:1788572217.074944:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367197, current: 214748367197, replaying 00000100:00100000:3.0:1788572217.074972:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+798:2382:x1875449615192448:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 55us (413us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572217.074980:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11049 00000020:00080000:0.0:1788572217.075042:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.075047:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367197, next_transno: 214748367197 00010000:00080000:0.0:1788572217.075051:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367197) 00000020:00080000:0.0:1788572217.075066:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.075077:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615192448 t214748367197 from 192.168.202.13@tcp req@ffff94e6131cdc00 x1875449615192448/t0(214748367197) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 504/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572217.075176:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ebeb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075192:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ebeb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075205:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ebeb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075219:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075225:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075242:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075432:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ebf9 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075443:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ebf9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075450:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ebf9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572217.075687:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].199, 64 off20928 00010000:00010000:0.0:1788572217.075744:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ebf9 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075752:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ebf9 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075759:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ebf9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075766:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.075770:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ebf9 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075779:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ebf9 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075791:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4ac:0x0].0x0 (ffff94e60ff78900) 00010000:00010000:0.0:1788572217.075794:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572217.075799:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ebf9 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075805:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ebf9 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4ac:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075831:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ebeb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075837:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ebeb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075843:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ebeb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075849:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.075852:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ebeb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075858:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ebeb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075866:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78600) 00010000:00010000:0.0:1788572217.075868:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572217.075871:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ebeb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075877:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ebeb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572217.075891:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7f2d652 reply state 00000000ffe7b662 transno 214748367197 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075902:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.075908:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f440a5d (ffff94e60ff78d00) 00010000:00010000:0.0:1788572217.075910:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572217.075913:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572217.076059:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572217.076100:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.076104:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367198 00000020:00080000:0.0:1788572217.076107:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.076109:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367198 00000100:00100000:0.0:1788572217.082885:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572217.083322:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615192832 00000100:00100000:1.0:1788572217.083334:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615192832 00000100:00100000:1.0:1788572217.083395:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11050 00000100:00100000:1.0:1788572217.083406:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+800:2382:x1875449615192832:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572217.083429:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367198, current: 214748367198, replaying 00000100:00100000:1.0:1788572217.083485:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+800:2382:x1875449615192832:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 81us (614us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572217.083492:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11050 00000020:00080000:0.0:1788572217.083584:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.083588:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367198, next_transno: 214748367198 00010000:00080000:0.0:1788572217.083593:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367198) 00000020:00080000:0.0:1788572217.083596:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.083606:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615192832 t214748367198 from 192.168.202.13@tcp req@ffff94e641697b80 x1875449615192832/t0(214748367198) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 504/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572217.083711:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec00 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.083727:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.083739:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.083751:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91a76416 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.083757:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91a76416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.083763:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91a76416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.086685:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec0e lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4ad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.086714:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec0e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.086728:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec0e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572217.087493:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].199, 64 off20928 00010000:00010000:0.0:1788572217.087562:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec0e lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087572:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec0e lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087578:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec0e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087584:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.087588:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec0e lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087596:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec0e lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087610:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4ad:0x0].0x0 (ffff94e60ff78f00) 00010000:00010000:0.0:1788572217.087613:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572217.087618:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec0e lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087628:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec0e lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087664:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087671:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec00 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087677:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec00 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087683:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.087685:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec00 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087692:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec00 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087700:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78600) 00010000:00010000:0.0:1788572217.087702:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572217.087706:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec00 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087712:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec00 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572217.087724:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c5d9262 reply state 00000000dcaa3cb1 transno 214748367198 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91a76416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087735:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91a76416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.087742:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91a76416 (ffff94e60ff78900) 00010000:00010000:0.0:1788572217.087745:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572217.087748:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572217.087849:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572217.087883:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.087887:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367199 00000020:00080000:0.0:1788572217.087891:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.087893:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367199 00000100:00100000:1.0:1788572217.096347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572217.096435:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615193216 00000100:00100000:0.0:1788572217.096446:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615193216 00000100:00100000:0.0:1788572217.096508:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11051 00000100:00100000:0.0:1788572217.096519:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+802:2382:x1875449615193216:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:0.0:1788572217.096543:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367199, current: 214748367199, replaying 00000100:00100000:0.0:1788572217.096567:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+802:2382:x1875449615193216:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 51us (233us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572217.096575:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11051 00000020:00080000:2.0:1788572217.096689:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.096694:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367199, next_transno: 214748367199 00010000:00080000:2.0:1788572217.096699:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367199) 00000020:00080000:2.0:1788572217.096702:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.096712:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615193216 t214748367199 from 192.168.202.13@tcp req@ffff94e6131cd180 x1875449615193216/t0(214748367199) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 504/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572217.096809:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ec15 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.096826:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ec15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.096843:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ec15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.096857:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.096864:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.096871:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097086:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eee00/0xdb7edb52b831ec23 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097096:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eee00/0xdb7edb52b831ec23 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097102:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eee00/0xdb7edb52b831ec23 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572217.097336:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].200, 64 off20992 00010000:00010000:2.0:1788572217.097390:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eee00/0xdb7edb52b831ec23 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097398:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eee00/0xdb7edb52b831ec23 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097405:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eee00/0xdb7edb52b831ec23 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097411:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421eee00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572217.097417:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eee00/0xdb7edb52b831ec23 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097424:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eee00/0xdb7edb52b831ec23 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097437:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4ae:0x0].0x0 (ffff94e613194400) 00010000:00010000:2.0:1788572217.097441:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572217.097445:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eee00/0xdb7edb52b831ec23 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097451:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eee00/0xdb7edb52b831ec23 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097473:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ec15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097479:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ec15 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097484:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ec15 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097489:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ee600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572217.097491:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ec15 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097497:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ec15 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097504:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194e00) 00010000:00010000:2.0:1788572217.097507:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572217.097511:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ec15 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097517:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee600/0xdb7edb52b831ec15 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572217.097529:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000090df866 reply state 000000001174929d transno 214748367199 ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097539:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.097546:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c515c17 (ffff94e613194700) 00010000:00010000:2.0:1788572217.097548:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572217.097551:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572217.097626:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572217.097641:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.097644:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367200 00000020:00080000:2.0:1788572217.097648:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.097650:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367200 00000100:00100000:1.0:1788572217.100215:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572217.100325:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615193600 00000100:00100000:2.0:1788572217.100336:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615193600 00000100:00100000:2.0:1788572217.100402:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11052 00000100:00100000:2.0:1788572217.100414:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+804:2382:x1875449615193600:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572217.100437:0:6550:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367200, current: 214748367200, replaying 00000100:00100000:2.0:1788572217.100461:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+804:2382:x1875449615193600:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 51us (258us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572217.100469:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11052 00000020:00080000:0.0:1788572217.100522:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.100528:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367200, next_transno: 214748367200 00010000:00080000:0.0:1788572217.100533:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367200) 00000020:00080000:0.0:1788572217.100536:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.100548:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615193600 t214748367200 from 192.168.202.13@tcp req@ffff94e60fc11880 x1875449615193600/t0(214748367200) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 504/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572217.100641:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.100666:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.100678:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.100692:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4309b090 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.100698:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4309b090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.100704:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4309b090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.100893:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377400/0xdb7edb52b831ec38 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4af:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.100902:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377400/0xdb7edb52b831ec38 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.100910:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377400/0xdb7edb52b831ec38 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572217.101188:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].200, 64 off20992 00010000:00010000:0.0:1788572217.101260:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377400/0xdb7edb52b831ec38 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101269:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377400/0xdb7edb52b831ec38 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101277:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377400/0xdb7edb52b831ec38 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101284:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.101292:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377400/0xdb7edb52b831ec38 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101300:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377400/0xdb7edb52b831ec38 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101314:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4af:0x0].0x0 (ffff94e60ff78a00) 00010000:00010000:0.0:1788572217.101317:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572217.101323:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377400/0xdb7edb52b831ec38 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101329:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377400/0xdb7edb52b831ec38 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4af:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101350:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101355:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec2a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101361:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101366:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.101368:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101373:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec2a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101380:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78600) 00010000:00010000:0.0:1788572217.101382:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572217.101386:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec2a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101392:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377600/0xdb7edb52b831ec2a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572217.101403:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df285d40 reply state 00000000e5e85f06 transno 214748367200 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4309b090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101414:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4309b090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.101422:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4309b090 (ffff94e60ff78f00) 00010000:00010000:0.0:1788572217.101424:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572217.101427:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572217.101503:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572217.101523:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.101526:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367201 00000020:00080000:0.0:1788572217.101530:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.101532:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367201 00000100:00100000:0.0:1788572217.105987:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572217.106188:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615193984 00000100:00100000:1.0:1788572217.106199:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615193984 00000100:00100000:1.0:1788572217.106407:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11053 00000100:00100000:1.0:1788572217.106418:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+806:2382:x1875449615193984:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:1.0:1788572217.106440:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367201, current: 214748367201, replaying 00000100:00100000:1.0:1788572217.106461:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+806:2382:x1875449615193984:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 45us (487us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572217.106469:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11053 00000020:00080000:0.0:1788572217.106507:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.106511:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367201, next_transno: 214748367201 00010000:00080000:0.0:1788572217.106516:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367201) 00000020:00080000:0.0:1788572217.106518:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.106527:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615193984 t214748367201 from 192.168.202.13@tcp req@ffff94e641694700 x1875449615193984/t0(214748367201) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 504/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572217.106626:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376400/0xdb7edb52b831ec3f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.106646:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376400/0xdb7edb52b831ec3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.106668:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376400/0xdb7edb52b831ec3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.106682:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x23788f49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.106689:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x23788f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.106695:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x23788f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.106891:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377800/0xdb7edb52b831ec4d lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.106912:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377800/0xdb7edb52b831ec4d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.106922:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377800/0xdb7edb52b831ec4d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572217.107194:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xcc:0x0].201, 64 off21056 00010000:00010000:0.0:1788572217.107289:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377800/0xdb7edb52b831ec4d lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107298:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377800/0xdb7edb52b831ec4d lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107305:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377800/0xdb7edb52b831ec4d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107310:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.107316:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377800/0xdb7edb52b831ec4d lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107324:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377800/0xdb7edb52b831ec4d lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107337:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4b0:0x0].0x0 (ffff94e619d6fc00) 00010000:00010000:0.0:1788572217.107341:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572217.107345:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377800/0xdb7edb52b831ec4d lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107353:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377800/0xdb7edb52b831ec4d lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107380:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376400/0xdb7edb52b831ec3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107387:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376400/0xdb7edb52b831ec3f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107392:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376400/0xdb7edb52b831ec3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107396:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.107399:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376400/0xdb7edb52b831ec3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107405:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376400/0xdb7edb52b831ec3f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107417:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e60ff78300) 00010000:00010000:0.0:1788572217.107419:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572217.107422:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376400/0xdb7edb52b831ec3f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107427:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376400/0xdb7edb52b831ec3f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572217.107438:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fdd4fb8 reply state 0000000038271908 transno 214748367201 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x23788f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107449:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x23788f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.107455:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x23788f49 (ffff94e60ff78700) 00010000:00010000:0.0:1788572217.107457:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572217.107460:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788572217.107549:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788572217.107579:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.107582:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367202 00000020:00080000:0.0:1788572217.107587:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788572217.107589:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367202 00000100:00100000:2.0:1788572217.111105:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572217.111145:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615194368 00000100:00100000:2.0:1788572217.111153:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615194368 00000100:00100000:2.0:1788572217.111200:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11054 00000100:00100000:2.0:1788572217.111209:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+808:2382:x1875449615194368:12345-192.168.202.13@tcp:36:unlinkmany.0 00010000:00080000:2.0:1788572217.111518:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 214748367202, current: 214748367202, replaying 00000100:00100000:2.0:1788572217.111539:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+808:2382:x1875449615194368:12345-192.168.202.13@tcp:36:unlinkmany.0 Request processed in 331us (445us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572217.111547:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11054 00000020:00080000:3.0:1788572217.111594:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.111599:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 214748367202, next_transno: 214748367202 00010000:00080000:3.0:1788572217.111605:0:112013:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (214748367202) 00000020:00080000:3.0:1788572217.111609:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.111618:0:112013:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449615194368 t214748367202 from 192.168.202.13@tcp req@ffff94e618432d80 x1875449615194368/t0(214748367202) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 504/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'unlinkmany.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572217.111739:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ec54 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.111758:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ec54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.111770:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ec54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.111784:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.111792:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.111798:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.114966:0:112013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f4a00/0xdb7edb52b831ec62 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x4b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.114991:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f4a00/0xdb7edb52b831ec62 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115001:0:112013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f4a00/0xdb7edb52b831ec62 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788572217.115418:0:112013:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xce:0x0].201, 64 off21056 00010000:00010000:2.0:1788572217.115477:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f4a00/0xdb7edb52b831ec62 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x4b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115483:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f4a00/0xdb7edb52b831ec62 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x4b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115488:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f4a00/0xdb7edb52b831ec62 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115492:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f4a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572217.115495:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f4a00/0xdb7edb52b831ec62 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x4b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115504:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f4a00/0xdb7edb52b831ec62 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x4b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115514:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x4b1:0x0].0x0 (ffff94e641642c00) 00010000:00010000:2.0:1788572217.115516:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788572217.115519:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f4a00/0xdb7edb52b831ec62 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x4b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115523:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f4a00/0xdb7edb52b831ec62 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x4b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115545:0:112013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ec54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115549:0:112013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ec54 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115552:0:112013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ec54 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115555:0:112013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572217.115557:0:112013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ec54 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115560:0:112013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ec54 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115564:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641642800) 00010000:00010000:2.0:1788572217.115565:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572217.115567:0:112013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ec54 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115573:0:112013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2c00/0xdb7edb52b831ec54 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572217.115582:0:112013:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003581974c reply state 00000000cfa202c8 transno 214748367202 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115589:0:112013:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.115593:0:112013:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd888f8c2 (ffff94e641642100) 00010000:00010000:2.0:1788572217.115595:0:112013:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572217.115597:0:112013:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788572217.115688:0:112013:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788572217.115709:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.115711:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367203 00000020:00080000:2.0:1788572217.115715:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788572217.115716:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 214748367203 00000100:00100000:3.0:1788572217.139357:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572217.139768:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615202176 00000100:00100000:2.0:1788572217.139779:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615202176 00000100:00100000:2.0:1788572217.140818:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4378 00000100:00100000:2.0:1788572217.140979:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+810:2382:x1875449615202176:12345-192.168.202.13@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788572217.141036:0:9276:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff94e61e637800 x1875449615202176/t0(0) o400->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 224/0 e 0 to 0 dl 1788572228 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572217.141126:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+810:2382:x1875449615202176:12345-192.168.202.13@tcp:400:ldlm_lock_repla.0 Request processed in 156us (1779us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572217.141135:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4378 00000020:00080000:3.0:1788572217.143352:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.143363:0:112013:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 214748367203 00010000:00080000:3.0:1788572217.143367:0:112013:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788572217.143371:0:112013:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572217.143378:0:112013:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788572217.143382:0:112013:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788572217.143505:0:112013:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 51, last_transno is 219043332096 00000001:00100000:1.0:1788572217.150585:0:111978:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000001:00100000:1.0:1788572217.150597:0:111978:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1788572217.150769:0:111978:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 214748367202 is committed 00000004:00080000:1.0:1788572217.150827:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1788572217.150849:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:0.0:1788572217.150914:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19532b1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.150927:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19532b1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.150935:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19532b1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.150946:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.150950:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19532b1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.150959:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19532b1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.150977:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19532b1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.150984:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13a00/0xdb7edb52b831e076 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19532b1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151041:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151048:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151053:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151058:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151061:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151067:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151075:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151081:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729800/0xdb7edb52b831e08b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfa940fe9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151095:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151100:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151106:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151111:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151113:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151119:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151126:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151131:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12000/0xdb7edb52b831e0a0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6db56d3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151145:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x244fd163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151152:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x244fd163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151162:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x244fd163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151167:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151169:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x244fd163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151175:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x244fd163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151182:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x244fd163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151187:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13600/0xdb7edb52b831e0b5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x244fd163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151202:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151208:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151213:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151219:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151222:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151228:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151237:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151244:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717800/0xdb7edb52b831e0ca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc83f3fc8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151258:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151263:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151269:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151287:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151291:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151296:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151304:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151311:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716e00/0xdb7edb52b831e0df lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8aa5a495 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151324:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151335:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151336:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b831cb7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151341:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151344:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b831cb7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151346:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151349:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151350:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b831cb7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151355:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8c000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151356:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151359:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b831cb7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151363:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151365:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b831cb7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151369:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13c00/0xdb7edb52b831e0f4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9af7cb30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151374:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b831cb7d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151379:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b831cb7d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151380:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151386:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151391:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151396:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151397:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3b200/0xdb7edb52b831cb8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151399:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151403:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3b200/0xdb7edb52b831cb8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151406:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151409:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3b200/0xdb7edb52b831cb8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151413:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151414:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ae3b200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151417:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3b200/0xdb7edb52b831cb8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151419:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031a00/0xdb7edb52b831e109 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x88493fa9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151423:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3b200/0xdb7edb52b831cb8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151431:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58df852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151431:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3b200/0xdb7edb52b831cb8b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151437:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58df852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151437:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3b200/0xdb7edb52b831cb8b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151443:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58df852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151447:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151449:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58df852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151452:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8e00/0xdb7edb52b831cba0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x39a638ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151455:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58df852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151459:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8e00/0xdb7edb52b831cba0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x39a638ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151463:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa58df852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151465:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8e00/0xdb7edb52b831cba0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x39a638ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151468:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13200/0xdb7edb52b831e11e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa58df852 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151470:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade8e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151472:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8e00/0xdb7edb52b831cba0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x39a638ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151478:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8e00/0xdb7edb52b831cba0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x39a638ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151485:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8e00/0xdb7edb52b831cba0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x39a638ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151486:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151490:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8e00/0xdb7edb52b831cba0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x39a638ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151492:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151498:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151502:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151505:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151510:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151510:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9a00/0xdb7edb52b831cbb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe9b0519d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151516:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9a00/0xdb7edb52b831cbb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe9b0519d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151517:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151523:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9a00/0xdb7edb52b831cbb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe9b0519d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151524:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b831e133 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f1e61cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151528:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151530:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9a00/0xdb7edb52b831cbb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe9b0519d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151535:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9a00/0xdb7edb52b831cbb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe9b0519d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151536:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151542:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151543:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9a00/0xdb7edb52b831cbb5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe9b0519d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151549:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151549:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9a00/0xdb7edb52b831cbb5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe9b0519d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151559:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151562:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151563:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697800/0xdb7edb52b831cbca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8ef8745c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151569:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151570:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697800/0xdb7edb52b831cbca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8ef8745c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151576:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697800/0xdb7edb52b831cbca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8ef8745c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151577:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151583:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b831e148 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6245b9cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151586:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637697800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151589:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697800/0xdb7edb52b831cbca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8ef8745c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151593:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151594:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697800/0xdb7edb52b831cbca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8ef8745c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151599:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151601:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697800/0xdb7edb52b831cbca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8ef8745c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151605:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151608:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697800/0xdb7edb52b831cbca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8ef8745c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151610:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151613:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151618:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151621:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791a00/0xdb7edb52b831cbdf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x349f9324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151625:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151627:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791a00/0xdb7edb52b831cbdf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x349f9324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151632:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716800/0xdb7edb52b831e15d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa09fb385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151633:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791a00/0xdb7edb52b831cbdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x349f9324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151638:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637791a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151641:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791a00/0xdb7edb52b831cbdf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x349f9324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151644:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6097012e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151646:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791a00/0xdb7edb52b831cbdf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x349f9324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151649:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6097012e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151665:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791a00/0xdb7edb52b831cbdf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x349f9324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151666:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6097012e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151671:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791a00/0xdb7edb52b831cbdf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x349f9324 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151672:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151675:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6097012e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151681:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6097012e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151688:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6097012e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151688:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696a00/0xdb7edb52b831cbf4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x873ef467 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151694:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717a00/0xdb7edb52b831e172 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6097012e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151695:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696a00/0xdb7edb52b831cbf4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x873ef467 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151701:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696a00/0xdb7edb52b831cbf4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x873ef467 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151706:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637696a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151708:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151709:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696a00/0xdb7edb52b831cbf4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x873ef467 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151714:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151715:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696a00/0xdb7edb52b831cbf4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x873ef467 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151723:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696a00/0xdb7edb52b831cbf4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x873ef467 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151724:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151729:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696a00/0xdb7edb52b831cbf4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x873ef467 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151730:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.151732:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151737:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151740:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697c00/0xdb7edb52b831cc09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49208d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151744:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151745:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697c00/0xdb7edb52b831cc09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49208d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151750:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b831e187 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc05b55a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151755:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697c00/0xdb7edb52b831cc09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49208d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151760:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637697c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151762:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697c00/0xdb7edb52b831cc09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49208d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151763:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151769:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697c00/0xdb7edb52b831cc09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf49208d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151770:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151776:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151777:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697c00/0xdb7edb52b831cc09 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf49208d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151781:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151783:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697c00/0xdb7edb52b831cc09 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf49208d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151784:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151793:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791000/0xdb7edb52b831cc1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x72fc1f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151799:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791000/0xdb7edb52b831cc1e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x72fc1f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151805:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791000/0xdb7edb52b831cc1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x72fc1f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151809:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637791000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151811:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791000/0xdb7edb52b831cc1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x72fc1f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151817:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791000/0xdb7edb52b831cc1e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x72fc1f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151825:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791000/0xdb7edb52b831cc1e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x72fc1f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151831:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791000/0xdb7edb52b831cc1e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x72fc1f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151845:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790c00/0xdb7edb52b831cc33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaaeb2888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151851:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790c00/0xdb7edb52b831cc33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaaeb2888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151856:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790c00/0xdb7edb52b831cc33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaaeb2888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151860:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637790c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151863:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790c00/0xdb7edb52b831cc33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaaeb2888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151868:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790c00/0xdb7edb52b831cc33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaaeb2888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151875:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790c00/0xdb7edb52b831cc33 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xaaeb2888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151881:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790c00/0xdb7edb52b831cc33 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xaaeb2888 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151895:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790a00/0xdb7edb52b831cc48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5fc23d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151906:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790a00/0xdb7edb52b831cc48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5fc23d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151912:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790a00/0xdb7edb52b831cc48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5fc23d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151917:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637790a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151920:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790a00/0xdb7edb52b831cc48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5fc23d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151926:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790a00/0xdb7edb52b831cc48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5fc23d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151933:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790a00/0xdb7edb52b831cc48 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5fc23d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151938:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790a00/0xdb7edb52b831cc48 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5fc23d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151953:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d000/0xdb7edb52b831cc5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35eeb75d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151958:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d000/0xdb7edb52b831cc5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35eeb75d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151964:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d000/0xdb7edb52b831cc5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35eeb75d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151968:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8d000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.151971:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d000/0xdb7edb52b831cc5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35eeb75d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151978:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d000/0xdb7edb52b831cc5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35eeb75d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151986:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d000/0xdb7edb52b831cc5d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x35eeb75d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.151992:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d000/0xdb7edb52b831cc5d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x35eeb75d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.151996:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152027:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152033:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81e00/0xdb7edb52b831cc72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2012184d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152034:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716c00/0xdb7edb52b831e19c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe68c4e78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152041:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81e00/0xdb7edb52b831cc72 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2012184d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152046:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81e00/0xdb7edb52b831cc72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2012184d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152048:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d424831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152051:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.152054:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81e00/0xdb7edb52b831cc72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2012184d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152055:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d424831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152060:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81e00/0xdb7edb52b831cc72 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2012184d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152061:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d424831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152066:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152069:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d424831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152069:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81e00/0xdb7edb52b831cc72 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2012184d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152075:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d424831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152075:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81e00/0xdb7edb52b831cc72 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2012184d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152083:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9d424831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152088:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560600/0xdb7edb52b831e1b1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9d424831 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152093:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81000/0xdb7edb52b831cc87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30521507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152098:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81000/0xdb7edb52b831cc87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30521507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152100:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x58b645d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152110:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x58b645d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152110:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81000/0xdb7edb52b831cc87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30521507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152115:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152116:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x58b645d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152119:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81000/0xdb7edb52b831cc87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30521507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152121:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145be00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152124:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x58b645d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152124:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81000/0xdb7edb52b831cc87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30521507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152130:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x58b645d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152131:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81000/0xdb7edb52b831cc87 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x30521507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152137:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x58b645d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152137:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81000/0xdb7edb52b831cc87 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x30521507 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152143:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145be00/0xdb7edb52b831e1c6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x58b645d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152149:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80000/0xdb7edb52b831cc9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x299140b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152155:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe079a92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152155:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80000/0xdb7edb52b831cc9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x299140b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152162:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe079a92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152162:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80000/0xdb7edb52b831cc9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x299140b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152169:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe079a92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152172:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152173:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.152175:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80000/0xdb7edb52b831cc9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x299140b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152176:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe079a92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152181:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80000/0xdb7edb52b831cc9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x299140b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152182:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe079a92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152188:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80000/0xdb7edb52b831cc9c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x299140b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152190:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe079a92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152194:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80000/0xdb7edb52b831cc9c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x299140b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152195:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b831e1db lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe079a92a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152207:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa64af17f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152213:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa64af17f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152218:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa64af17f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152218:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80c00/0xdb7edb52b831ccb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x981d3029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152223:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.152224:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80c00/0xdb7edb52b831ccb1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x981d3029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152226:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa64af17f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.152230:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80c00/0xdb7edb52b831ccb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x981d3029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152232:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa64af17f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152240:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa64af17f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152245:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b831e1f0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa64af17f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152261:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152318:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152326:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152332:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152335:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152340:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152349:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152354:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7600/0xdb7edb52b831e205 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa8880aa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152368:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152374:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152379:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152387:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152390:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152394:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152401:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152406:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561800/0xdb7edb52b831e21a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x20d952f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152418:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46869d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152424:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46869d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152429:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46869d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152434:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152436:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46869d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152443:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46869d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152450:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x46869d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152457:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b831e22f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x46869d06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152470:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152476:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152482:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152487:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152490:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152496:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152503:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152509:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6800/0xdb7edb52b831e244 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6153fa5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152523:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152529:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152540:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152545:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152548:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152553:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152560:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.152561:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638886784:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.152566:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561200/0xdb7edb52b831e259 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xabc4fe80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152578:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152583:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152587:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152592:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152594:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152599:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152605:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152610:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561000/0xdb7edb52b831e26e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25a9ece5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152621:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x396831b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152627:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x396831b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.152631:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.152633:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x396831b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152638:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152640:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x396831b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152646:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x396831b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152665:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x396831b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152672:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831e283 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x396831b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152683:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152692:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152698:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.152698:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638887296:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.152704:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152706:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152712:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.152717:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.152720:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152726:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560400/0xdb7edb52b831e298 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8dd8730d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.152734:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638887808:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.152738:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152744:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152750:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.152752:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.152756:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.152759:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152766:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.152774:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.152775:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638888320:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.152780:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716000/0xdb7edb52b831e2ad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x143bccc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.152790:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.152811:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788572217.152817:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638886912:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.152837:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.152853:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638887424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.152871:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.152888:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638887936:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.152905:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.152920:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638888448:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.152939:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.152971:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638887040:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.152989:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd737056f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.152994:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.152997:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd737056f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153023:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd737056f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153029:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.153032:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd737056f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153032:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638887552:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.153038:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd737056f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153048:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd737056f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153052:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.153055:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717e00/0xdb7edb52b831e2c2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd737056f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153068:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638888064:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.153073:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153080:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153084:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.153086:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153091:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.153094:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153097:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638888576:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.153100:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153109:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153114:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.153115:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717600/0xdb7edb52b831e2d7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb11b6ee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153127:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153133:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153133:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788572217.153138:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638887168:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.153139:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153149:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.153152:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153155:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.153158:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153166:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153169:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638887680:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.153172:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716200/0xdb7edb52b831e2ec lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3bc566e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153184:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.153186:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153192:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153197:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638888192:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.153198:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153203:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.153206:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153212:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153212:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.153219:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.153224:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638888704:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.153226:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728e00/0xdb7edb52b831e301 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x53a9bb62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153239:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85ea890b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153246:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85ea890b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153251:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85ea890b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153256:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.153259:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85ea890b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153265:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85ea890b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572217.153548:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788572217.153557:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788572217.153718:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788572217.153722:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:0.0:1788572217.153863:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x85ea890b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153871:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b831e316 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x85ea890b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.153888:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572217.153893:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788572217.153894:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572217.153906:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788572217.154161:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154165:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80c00/0xdb7edb52b831ccb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x981d3029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154172:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80c00/0xdb7edb52b831ccb1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x981d3029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154174:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154180:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.154183:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154184:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80c00/0xdb7edb52b831ccb1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x981d3029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154191:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154191:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80c00/0xdb7edb52b831ccb1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x981d3029 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154200:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154206:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717400/0xdb7edb52b831e32b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5b2b02c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154222:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154229:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154235:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154240:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.154243:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154249:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154258:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154263:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716600/0xdb7edb52b831e340 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xacb17b95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154326:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8400/0xdb7edb52b831ccc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9a5e402e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154333:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8400/0xdb7edb52b831ccc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9a5e402e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154339:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8400/0xdb7edb52b831ccc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9a5e402e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154344:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154347:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8400/0xdb7edb52b831ccc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9a5e402e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154353:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8400/0xdb7edb52b831ccc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9a5e402e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154363:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8400/0xdb7edb52b831ccc6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9a5e402e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154369:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8400/0xdb7edb52b831ccc6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9a5e402e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154387:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81200/0xdb7edb52b831ccdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1baf4f32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154394:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81200/0xdb7edb52b831ccdb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1baf4f32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154403:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81200/0xdb7edb52b831ccdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1baf4f32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154408:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154410:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81200/0xdb7edb52b831ccdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1baf4f32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154416:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81200/0xdb7edb52b831ccdb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1baf4f32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154423:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81200/0xdb7edb52b831ccdb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1baf4f32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154429:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81200/0xdb7edb52b831ccdb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1baf4f32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154446:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80800/0xdb7edb52b831ccf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5e322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154452:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80800/0xdb7edb52b831ccf0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5e322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154458:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80800/0xdb7edb52b831ccf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5e322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154463:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154466:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80800/0xdb7edb52b831ccf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5e322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154472:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80800/0xdb7edb52b831ccf0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8aa5e322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154480:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80800/0xdb7edb52b831ccf0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8aa5e322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154485:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80800/0xdb7edb52b831ccf0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8aa5e322 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154499:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f192411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154505:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f192411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154510:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f192411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154515:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154517:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f192411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154523:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f192411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154530:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f192411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154535:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b831cd05 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f192411 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154550:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8000/0xdb7edb52b831cd1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c053801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154559:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8000/0xdb7edb52b831cd1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c053801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154564:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8000/0xdb7edb52b831cd1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c053801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154569:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade8000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154571:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8000/0xdb7edb52b831cd1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c053801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154577:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8000/0xdb7edb52b831cd1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c053801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154584:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8000/0xdb7edb52b831cd1a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2c053801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154590:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8000/0xdb7edb52b831cd1a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2c053801 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154604:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b400/0xdb7edb52b831cd2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8144a7ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154609:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b400/0xdb7edb52b831cd2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8144a7ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154615:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b400/0xdb7edb52b831cd2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8144a7ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154620:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154623:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b400/0xdb7edb52b831cd2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8144a7ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154629:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b400/0xdb7edb52b831cd2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8144a7ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154637:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b400/0xdb7edb52b831cd2f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8144a7ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154644:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b400/0xdb7edb52b831cd2f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8144a7ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154673:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696200/0xdb7edb52b831cd44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77ace46a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154680:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696200/0xdb7edb52b831cd44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77ace46a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154686:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696200/0xdb7edb52b831cd44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77ace46a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154691:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637696200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154694:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696200/0xdb7edb52b831cd44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77ace46a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154700:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696200/0xdb7edb52b831cd44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77ace46a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154708:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696200/0xdb7edb52b831cd44 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x77ace46a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154714:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696200/0xdb7edb52b831cd44 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x77ace46a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154732:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154736:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154742:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154747:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154749:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154755:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154762:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154767:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b831cd59 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae3ad178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154780:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697a00/0xdb7edb52b831cd6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d6e568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154786:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697a00/0xdb7edb52b831cd6e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d6e568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154792:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697a00/0xdb7edb52b831cd6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d6e568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154801:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637697a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154804:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697a00/0xdb7edb52b831cd6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d6e568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154810:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697a00/0xdb7edb52b831cd6e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d6e568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154817:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697a00/0xdb7edb52b831cd6e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7d6e568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154823:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697a00/0xdb7edb52b831cd6e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7d6e568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154838:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697000/0xdb7edb52b831cd83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x444ba947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154844:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697000/0xdb7edb52b831cd83 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x444ba947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154850:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697000/0xdb7edb52b831cd83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x444ba947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154855:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637697000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154858:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697000/0xdb7edb52b831cd83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x444ba947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154864:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697000/0xdb7edb52b831cd83 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x444ba947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154867:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd534d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154872:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697000/0xdb7edb52b831cd83 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x444ba947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154874:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd534d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154879:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637697000/0xdb7edb52b831cd83 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x444ba947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154881:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd534d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154885:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.154888:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd534d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154893:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc89db40c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154894:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd534d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154899:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc89db40c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154904:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc89db40c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154909:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.154912:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc89db40c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154917:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc89db40c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154924:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc89db40c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154929:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b831cd98 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc89db40c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154945:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703800/0xdb7edb52b831cdad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x468dc850 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154952:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703800/0xdb7edb52b831cdad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x468dc850 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154961:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703800/0xdb7edb52b831cdad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x468dc850 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154966:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.154969:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd534d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154969:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703800/0xdb7edb52b831cdad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x468dc850 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154976:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145bc00/0xdb7edb52b831e355 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd534d54e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154976:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703800/0xdb7edb52b831cdad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x468dc850 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154984:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703800/0xdb7edb52b831cdad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x468dc850 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.154989:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703800/0xdb7edb52b831cdad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x468dc850 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.154992:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155001:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155028:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcce55700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155036:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155037:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcce55700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155042:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.155043:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcce55700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155045:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155048:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.155050:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcce55700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155051:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155059:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155065:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec800/0xdb7edb52b831e36a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb7c88751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155071:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcce55700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155080:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x958cdbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155080:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcce55700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155087:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x958cdbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155087:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b831cdc2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcce55700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155093:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x958cdbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155097:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.155099:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x958cdbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155104:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa763f02d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155106:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x958cdbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155109:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa763f02d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155114:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x958cdbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155115:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa763f02d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155120:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2200/0xdb7edb52b831e37f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x958cdbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155121:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.155123:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa763f02d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155129:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa763f02d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155134:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x500ab473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155135:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa763f02d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155140:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x500ab473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155142:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80600/0xdb7edb52b831cdd7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa763f02d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155146:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x500ab473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155150:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.155152:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x500ab473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155155:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc250041d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155158:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x500ab473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155165:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x500ab473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155166:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc250041d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155172:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2400/0xdb7edb52b831e394 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x500ab473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155172:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc250041d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155177:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8da00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.155180:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc250041d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155185:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc250041d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155188:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155191:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc250041d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155196:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155197:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b831cdec lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc250041d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155202:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155207:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.155209:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155216:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155217:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702400/0xdb7edb52b831ce01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9621321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155223:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702400/0xdb7edb52b831ce01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9621321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155224:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.155230:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702400/0xdb7edb52b831ce01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9621321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155231:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b831e3a9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb9b1dec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155243:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155249:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155254:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155262:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.155265:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155340:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155351:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155356:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53200/0xdb7edb52b831e3be lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6520f5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155363:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.155371:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155376:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155381:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155385:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.155388:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155393:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155399:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155405:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3e00/0xdb7edb52b831e3d3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8da44fa6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155417:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x227f380f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155422:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x227f380f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155427:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x227f380f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155432:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.155434:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x227f380f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155439:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x227f380f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155441:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638886784 00010000:00010000:0.0:1788572217.155446:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x227f380f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155449:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638886784 00010000:00010000:0.0:1788572217.155451:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53c00/0xdb7edb52b831e3e8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x227f380f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155463:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155469:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155477:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155482:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.155484:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155490:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155497:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155503:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53e00/0xdb7edb52b831e3fd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa8e291c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155506:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638887296 00000100:00100000:2.0:1788572217.155508:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638887296 00010000:00010000:0.0:1788572217.155516:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155521:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638887808 00010000:00010000:0.0:1788572217.155523:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155524:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638887808 00010000:00010000:0.0:1788572217.155529:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155535:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2000 already unused, calling callback (ffffffffc17dd4f0) 00000100:00100000:2.0:1788572217.155535:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638888320 00000100:00100000:2.0:1788572217.155538:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638888320 00010000:00010000:0.0:1788572217.155539:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155545:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155546:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638886912 00000100:00100000:2.0:1788572217.155549:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638886912 00010000:00010000:0.0:1788572217.155554:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155556:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638887424 00000100:00100000:2.0:1788572217.155558:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638887424 00010000:00010000:0.0:1788572217.155560:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2000/0xdb7edb52b831e412 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd6028a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155566:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638887936 00000100:00100000:2.0:1788572217.155569:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638887936 00010000:00010000:0.0:1788572217.155575:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd485e452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155577:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638888448 00000100:00100000:2.0:1788572217.155580:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638888448 00010000:00010000:0.0:1788572217.155581:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd485e452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155588:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd485e452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155588:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638887040 00000100:00100000:2.0:1788572217.155590:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638887040 00010000:00010000:0.0:1788572217.155593:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.155595:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd485e452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155598:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638887552 00000100:00100000:2.0:1788572217.155601:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638887552 00010000:00010000:0.0:1788572217.155602:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd485e452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.155610:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd485e452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155610:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638888064 00000100:00100000:2.0:1788572217.155612:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638888064 00010000:00010000:0.0:1788572217.155616:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53a00/0xdb7edb52b831e427 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd485e452 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155620:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638888576 00000100:00100000:2.0:1788572217.155623:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638888576 00010000:00010000:0.0:1788572217.155630:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155630:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638887168 00000100:00100000:2.0:1788572217.155633:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638887168 00010000:00010000:0.0:1788572217.155640:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155640:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638887680 00000100:00100000:2.0:1788572217.155643:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638887680 00010000:00010000:0.0:1788572217.155647:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.155650:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638888192 00000100:00100000:2.0:1788572217.155664:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638888192 00000100:00100000:2.0:1788572217.155676:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638888704 00000100:00100000:2.0:1788572217.155678:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638888704 00000100:00100000:2.0:1788572217.155690:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1788572217.155699:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3652:x1875449638886784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.155738:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2050 count 1 00000100:00100000:2.0:1788572217.155852:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3652:x1875449638886784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 153us (3220us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.155859:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1788572217.155876:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:2.0:1788572217.155882:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449638887296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.155893:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2054 count 1 00000100:00100000:2.0:1788572217.155937:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449638887296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 56us (3219us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.155943:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:2.0:1788572217.155955:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1788572217.155961:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3652:x1875449638887808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.155973:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2050 count 1 00000100:00100000:2.0:1788572217.156047:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3652:x1875449638887808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 87us (3294us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.156053:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1788572217.156066:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1788572217.156073:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449638888320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.156083:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2054 count 1 00000100:00100000:2.0:1788572217.156121:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449638888320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (3329us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.156126:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1788572217.156136:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1788572217.156141:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638886912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.156150:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2051 count 1 00000100:00100000:2.0:1788572217.156181:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638886912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 41us (3344us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.156187:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1788572217.156197:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1788572217.156202:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638887424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.156210:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2055 count 1 00000100:00100000:1.0:1788572217.156356:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00010000:00010000:0.0:1788572217.156361:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.156365:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156367:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638887936:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.156373:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572217.156380:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2051 count 1 00010000:00010000:0.0:1788572217.156385:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156391:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52600/0xdb7edb52b831e43c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f5b580a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156412:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156419:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156425:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156428:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638887936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 64us (3522us total) trans 0 rc -2/-2 00010000:00010000:0.0:1788572217.156431:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.156434:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156434:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00010000:00010000:0.0:1788572217.156440:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156445:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00010000:00010000:0.0:1788572217.156449:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156450:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638888448:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.156455:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3a00/0xdb7edb52b831e451 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x63bcc83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572217.156461:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2055 count 1 00010000:00010000:0.0:1788572217.156468:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2969b984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156474:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2969b984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156480:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2969b984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156485:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.156488:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2969b984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156493:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2969b984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156496:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638888448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46us (3555us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.156501:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00010000:00010000:0.0:1788572217.156502:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2969b984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156508:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53600/0xdb7edb52b831e466 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2969b984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156512:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:1.0:1788572217.156518:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638887040:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.156526:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572217.156527:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2052 count 1 00010000:00010000:0.0:1788572217.156532:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156538:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156543:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.156545:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156551:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156559:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156564:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3400/0xdb7edb52b831e47b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdd2e0dfd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156570:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638887040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (3576us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.156576:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00010000:00010000:0.0:1788572217.156578:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156584:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156586:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00010000:00010000:0.0:1788572217.156590:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156591:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638887552:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.156599:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3c00 already unused, calling callback (ffffffffc17dd4f0) 00002000:00080000:1.0:1788572217.156601:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2056 count 1 00010000:00010000:0.0:1788572217.156603:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156608:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156616:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156622:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3c00/0xdb7edb52b831e490 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xaaa946a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156636:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d03405f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156636:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638887552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 45us (3583us total) trans 0 rc -2/-2 00010000:00010000:0.0:1788572217.156643:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d03405f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156643:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00010000:00010000:0.0:1788572217.156649:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d03405f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156665:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.156668:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d03405f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156673:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d03405f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156678:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00010000:00010000:0.0:1788572217.156681:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3d03405f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156684:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638888064:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.156689:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53800/0xdb7edb52b831e4a5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3d03405f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572217.156695:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2052 count 1 00010000:00010000:0.0:1788572217.156703:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156709:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156716:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156721:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.156724:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156731:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156732:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638888064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (3647us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.156738:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00010000:00010000:0.0:1788572217.156740:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156745:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831e4ba lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5aa6ad60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.156750:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:1.0:1788572217.156756:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638888576:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.156760:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156766:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572217.156766:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2056 count 1 00010000:00010000:0.0:1788572217.156776:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.156782:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3600 already unused, calling callback (ffffffffc17dd4f0) 00000100:00100000:1.0:1788572217.156802:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638888576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46us (3686us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.156808:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:1.0:1788572217.156829:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:1.0:1788572217.156835:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638887168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.156846:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2053 count 1 00000100:00100000:1.0:1788572217.156886:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638887168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 52us (3730us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.156892:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00100000:1.0:1788572217.156904:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1788572217.156910:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638887680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.156920:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2057 count 1 00000100:00100000:1.0:1788572217.156958:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638887680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49us (3772us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.156964:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1788572217.156978:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:1.0:1788572217.156983:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638888192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.156994:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2053 count 1 00000100:00100000:1.0:1788572217.157058:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638888192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 75us (3845us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.157067:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:1.0:1788572217.157080:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:1.0:1788572217.157086:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638888704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.157097:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2057 count 1 00000100:00100000:1.0:1788572217.157133:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638888704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 47us (1772us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.157139:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00010000:00010000:0.0:1788572217.157367:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157379:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157390:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157397:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3600/0xdb7edb52b831e4cf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9bb01d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157417:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x458adb52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157422:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x458adb52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157428:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x458adb52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157433:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.157436:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x458adb52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157443:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x458adb52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157451:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x458adb52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157457:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52e00/0xdb7edb52b831e4e4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x458adb52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157470:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade4d50b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157476:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade4d50b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157482:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade4d50b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157487:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.157488:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.157489:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade4d50b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157492:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702400/0xdb7edb52b831ce01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9621321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157495:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade4d50b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157499:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702400/0xdb7edb52b831ce01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9621321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157503:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xade4d50b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157508:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702400/0xdb7edb52b831ce01 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9621321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157509:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2e00/0xdb7edb52b831e4f9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xade4d50b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157515:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702400/0xdb7edb52b831ce01 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9621321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157522:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157532:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157535:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b831ce16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3aff8da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157538:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157542:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b831ce16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3aff8da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157543:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.157546:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157548:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b831ce16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3aff8da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157551:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157552:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.157555:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b831ce16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3aff8da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157559:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157560:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b831ce16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3aff8da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157564:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8d400/0xdb7edb52b831e50e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc7d44518 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157567:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b831ce16 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe3aff8da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157572:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b831ce16 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe3aff8da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157576:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157582:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157586:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157588:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702000/0xdb7edb52b831ce2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a3de5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157592:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.157595:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157595:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702000/0xdb7edb52b831ce2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a3de5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157601:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702000/0xdb7edb52b831ce2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a3de5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157602:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157606:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.157609:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702000/0xdb7edb52b831ce2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a3de5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157610:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157615:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702000/0xdb7edb52b831ce2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a3de5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157616:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53000/0xdb7edb52b831e523 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7e6ea93d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157622:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702000/0xdb7edb52b831ce2b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5a3de5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157627:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702000/0xdb7edb52b831ce2b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5a3de5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157629:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40600692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157634:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40600692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157639:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40600692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157639:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791c00/0xdb7edb52b831ce40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7529f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157644:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.157645:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791c00/0xdb7edb52b831ce40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7529f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157647:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40600692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157661:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791c00/0xdb7edb52b831ce40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7529f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157664:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40600692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157671:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637791c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.157672:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x40600692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157675:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791c00/0xdb7edb52b831ce40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7529f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157677:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728400/0xdb7edb52b831e538 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x40600692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157681:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791c00/0xdb7edb52b831ce40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7529f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157689:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791c00/0xdb7edb52b831ce40 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7529f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157695:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157695:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791c00/0xdb7edb52b831ce40 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7529f9d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157701:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157706:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157710:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.157712:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ae00/0xdb7edb52b831ce55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80b4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157713:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157718:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ae00/0xdb7edb52b831ce55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80b4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157719:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157724:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ae00/0xdb7edb52b831ce55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80b4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157727:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157729:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1ae00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.157732:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52000/0xdb7edb52b831e54d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94d0eb5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157732:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ae00/0xdb7edb52b831ce55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80b4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157737:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ae00/0xdb7edb52b831ce55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80b4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157743:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ae00/0xdb7edb52b831ce55 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x80b4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157744:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x652233b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157751:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x652233b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157751:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ae00/0xdb7edb52b831ce55 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x80b4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157756:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x652233b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157763:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790e00/0xdb7edb52b831ce6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda11c500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157764:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.157767:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x652233b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157769:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790e00/0xdb7edb52b831ce6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda11c500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.157773:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x652233b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157775:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790e00/0xdb7edb52b831ce6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda11c500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157780:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637790e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.157781:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x652233b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157783:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790e00/0xdb7edb52b831ce6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda11c500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157788:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790e00/0xdb7edb52b831ce6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda11c500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157795:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790e00/0xdb7edb52b831ce6a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xda11c500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157800:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790e00/0xdb7edb52b831ce6a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xda11c500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157814:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790000/0xdb7edb52b831ce7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73ec34ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157820:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790000/0xdb7edb52b831ce7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73ec34ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157830:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790000/0xdb7edb52b831ce7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73ec34ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157836:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637790000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.157839:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790000/0xdb7edb52b831ce7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73ec34ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157845:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790000/0xdb7edb52b831ce7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73ec34ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157853:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790000/0xdb7edb52b831ce7f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x73ec34ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157859:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790000/0xdb7edb52b831ce7f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x73ec34ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157873:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791400/0xdb7edb52b831ce94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb93c3af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157879:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791400/0xdb7edb52b831ce94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb93c3af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157884:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791400/0xdb7edb52b831ce94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb93c3af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157887:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637791400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.157890:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791400/0xdb7edb52b831ce94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb93c3af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157895:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791400/0xdb7edb52b831ce94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb93c3af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157902:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791400/0xdb7edb52b831ce94 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb93c3af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157908:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791400/0xdb7edb52b831ce94 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb93c3af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157925:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791e00/0xdb7edb52b831cea9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68a609dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157930:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791e00/0xdb7edb52b831cea9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68a609dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157935:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791e00/0xdb7edb52b831cea9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68a609dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157940:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637791e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.157943:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791e00/0xdb7edb52b831cea9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68a609dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157949:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791e00/0xdb7edb52b831cea9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68a609dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157957:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791e00/0xdb7edb52b831cea9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68a609dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157963:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791e00/0xdb7edb52b831cea9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68a609dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157977:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790600/0xdb7edb52b831cebe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf0f3188e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157986:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790600/0xdb7edb52b831cebe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf0f3188e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157991:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790600/0xdb7edb52b831cebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf0f3188e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.157996:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637790600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.157998:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790600/0xdb7edb52b831cebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf0f3188e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.158021:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790600/0xdb7edb52b831cebe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf0f3188e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.158029:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790600/0xdb7edb52b831cebe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf0f3188e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.158035:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790600/0xdb7edb52b831cebe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf0f3188e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.158049:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b831ced3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x18592791 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.158053:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b831ced3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x18592791 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.158166:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638887424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1962us (5292us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.158174:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00010000:00010000:0.0:1788572217.158711:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52800/0xdb7edb52b831e562 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x652233b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788572217.158726:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572217.158731:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788572217.158736:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.158742:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.158748:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.158753:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.158756:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.158762:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.158771:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.158777:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9800/0xdb7edb52b831e577 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x907b9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.158779:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2ed80, transno 0 00000004:00080000:2.0:1788572217.158787:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2ed80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.158800:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638886912:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.158811:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f480, transno 0 00000004:00080000:2.0:1788572217.158813:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2f480/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.158817:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638887424:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.158830:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2df80, transno 0 00000004:00080000:2.0:1788572217.158832:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2df80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.158841:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638887936:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.158851:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503932680, transno 0 00000004:00080000:2.0:1788572217.158853:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503932680/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.158862:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638888448:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.158873:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d500, transno 0 00000004:00080000:2.0:1788572217.158876:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d500/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.158879:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638886784:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.158888:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f800, transno 0 00000004:00080000:2.0:1788572217.158890:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2f800/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.158893:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638887296:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.158900:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d880, transno 0 00000004:00080000:2.0:1788572217.158902:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d880/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.158905:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638887808:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.158912:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931180, transno 0 00000004:00080000:2.0:1788572217.158915:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931180/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.158918:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638888320:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.158982:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.158989:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.158994:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.158999:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.159019:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159026:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159036:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159041:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52c00/0xdb7edb52b831e58c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x439cfa6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159055:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159062:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159072:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159077:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a53400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.159080:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159086:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159094:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159098:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a53400/0xdb7edb52b831e5a1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55ddf3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159112:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159118:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159124:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159129:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.159132:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159136:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159144:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159150:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716a00/0xdb7edb52b831e5b6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24b7cda0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159166:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x537231c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159172:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x537231c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159177:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x537231c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159181:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.159183:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x537231c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.159184:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 192 changes, 4 in progress, 4 in flight, 4 done 00010000:00010000:0.0:1788572217.159189:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x537231c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159195:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x537231c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159201:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717200/0xdb7edb52b831e5cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x537231c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159215:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x262153c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159224:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x262153c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159229:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x262153c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159233:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634a52a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.159236:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x262153c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159241:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x262153c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159249:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x262153c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.159256:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634a52a00/0xdb7edb52b831e5e0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x262153c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159359:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b831ced3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x18592791 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159364:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.159367:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b831ced3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x18592791 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159375:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b831ced3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x18592791 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572217.159384:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 192 changes, 5 in progress, 4 in flight, 3 done 00010000:00010000:3.0:1788572217.159385:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b831ced3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x18592791 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159391:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b831ced3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x18592791 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159410:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159416:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159421:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159426:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.159429:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159434:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159442:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159448:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80e00/0xdb7edb52b831cee8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xec1969c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159469:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b831cefd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb05356d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159475:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b831cefd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb05356d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159481:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b831cefd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb05356d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.159482:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638888960:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.159486:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.159488:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b831cefd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb05356d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159494:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b831cefd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb05356d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159501:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b831cefd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb05356d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159506:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b831cefd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb05356d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159522:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b831cf12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbaa06587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.159527:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572217.159529:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b831cf12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbaa06587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159534:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b831cf12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbaa06587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159542:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.159545:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b831cf12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbaa06587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159551:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b831cf12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbaa06587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159558:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b831cf12 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbaa06587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159563:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b831cf12 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbaa06587 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.159567:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572217.159572:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638888832:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.159577:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xafebc86b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159583:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xafebc86b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159589:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xafebc86b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.159590:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572217.159594:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.159598:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xafebc86b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159605:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xafebc86b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159613:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xafebc86b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.159618:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638888960 00010000:00010000:3.0:1788572217.159619:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b831cf27 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xafebc86b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.159623:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638888960 00010000:00010000:3.0:1788572217.159633:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1aa00/0xdb7edb52b831cf3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5e2cd870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159638:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1aa00/0xdb7edb52b831cf3c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5e2cd870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159643:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1aa00/0xdb7edb52b831cf3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5e2cd870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.159648:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1aa00 already unused, calling callback (ffffffffc17dd4f0) 00000100:00100000:1.0:1788572217.159664:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638888832 00000100:00100000:1.0:1788572217.159668:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638888832 00000100:00100000:1.0:1788572217.159686:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:1.0:1788572217.159693:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638888960:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.159711:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638889216:0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.159717:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2059 count 1 00000100:00100000:2.0:1788572217.159735:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.159753:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638889728:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.159770:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.159784:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638888960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 91us (256us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.159792:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788572217.159797:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638889088:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.159817:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.159833:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638889600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.159850:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.159874:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638889216 00000100:00100000:2.0:1788572217.159878:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638889216 00000100:00100000:2.0:1788572217.159898:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638889728 00000100:00100000:2.0:1788572217.159901:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638889728 00000100:00100000:2.0:1788572217.159916:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638889088 00000100:00100000:2.0:1788572217.159918:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638889088 00000100:00100000:2.0:1788572217.159931:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638889600 00000100:00100000:2.0:1788572217.159933:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638889600 00000100:00100000:2.0:1788572217.159948:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:2.0:1788572217.159955:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3653:x1875449638888832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.159967:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2058 count 1 00000100:00100000:2.0:1788572217.160032:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3653:x1875449638888832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 78us (441us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.160039:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00010000:00010000:3.0:1788572217.160173:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1aa00/0xdb7edb52b831cf3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5e2cd870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160183:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1aa00/0xdb7edb52b831cf3c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5e2cd870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160192:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1aa00/0xdb7edb52b831cf3c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5e2cd870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160198:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1aa00/0xdb7edb52b831cf3c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5e2cd870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160350:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b200/0xdb7edb52b831cf51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbfab486e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160357:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b200/0xdb7edb52b831cf51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbfab486e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160361:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160368:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b200/0xdb7edb52b831cf51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbfab486e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160370:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160374:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.160377:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160377:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b200/0xdb7edb52b831cf51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbfab486e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160382:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160384:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b200/0xdb7edb52b831cf51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbfab486e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160385:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160392:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160394:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b200/0xdb7edb52b831cf51 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbfab486e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160399:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b200/0xdb7edb52b831cf51 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbfab486e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160401:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160407:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5c00/0xdb7edb52b831e5f5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x19d4ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160414:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160420:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160423:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160426:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160429:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160431:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.160435:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160435:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160440:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160441:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160443:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160448:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160449:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160456:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160456:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed000/0xdb7edb52b831cf66 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7e7bccb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160461:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b831e60a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9b4c1a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160470:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x16cc758c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160475:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x16cc758c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160476:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf2930efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160480:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x16cc758c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160482:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf2930efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160486:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.160488:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf2930efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160489:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x16cc758c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160493:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a0600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160495:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x16cc758c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160496:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf2930efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160501:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf2930efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160502:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x16cc758c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160508:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec600/0xdb7edb52b831cf7b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x16cc758c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160509:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf2930efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160514:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0600/0xdb7edb52b831e61f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf2930efb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160521:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1be00/0xdb7edb52b831cf90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x839279d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160525:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160531:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160531:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1be00/0xdb7edb52b831cf90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x839279d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160538:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160538:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1be00/0xdb7edb52b831cf90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x839279d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160543:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1be00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160546:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1be00/0xdb7edb52b831cf90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x839279d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160548:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.160552:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160552:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1be00/0xdb7edb52b831cf90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x839279d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160558:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160559:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1be00/0xdb7edb52b831cf90 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x839279d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160565:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160565:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1be00/0xdb7edb52b831cf90 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x839279d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160571:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b831e634 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc00e47a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160578:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b831cfa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28f888d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160582:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b831cfa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28f888d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160584:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x366eb11d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160588:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b831cfa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28f888d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160590:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x366eb11d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160593:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1ba00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.160595:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x366eb11d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160596:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b831cfa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28f888d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160601:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160603:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b831cfa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28f888d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160604:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x366eb11d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160610:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x366eb11d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160611:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b831cfa5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28f888d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160617:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x366eb11d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160617:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b831cfa5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28f888d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160624:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8e00/0xdb7edb52b831e649 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x366eb11d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160629:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a400/0xdb7edb52b831cfba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507678e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160633:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a400/0xdb7edb52b831cfba lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507678e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160636:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdea4891e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160639:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a400/0xdb7edb52b831cfba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507678e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160642:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdea4891e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160644:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160647:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a400/0xdb7edb52b831cfba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507678e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160649:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdea4891e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160665:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160665:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a400/0xdb7edb52b831cfba lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507678e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160668:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdea4891e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160674:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdea4891e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160674:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a400/0xdb7edb52b831cfba lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x507678e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160680:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a400/0xdb7edb52b831cfba lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x507678e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160683:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdea4891e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160689:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b831e65e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdea4891e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160699:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x69da5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160701:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x232002d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160705:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x69da5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160707:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x232002d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160711:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x69da5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160716:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.160718:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x232002d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160719:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x69da5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160723:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160725:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x69da5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160726:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x232002d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160732:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x232002d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160732:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x69da5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160738:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec000/0xdb7edb52b831cfcf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x69da5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160739:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x232002d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160744:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9e00/0xdb7edb52b831e673 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x232002d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160751:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160755:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160756:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160761:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160762:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160767:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160772:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160772:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ecc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.160775:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160775:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160781:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160781:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160788:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160794:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ecc00/0xdb7edb52b831cfe4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf19c79e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160806:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160812:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160817:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160822:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160825:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160831:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160839:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160845:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed800/0xdb7edb52b831cff9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6f33506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160859:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703000/0xdb7edb52b831d00e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcd1154cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160865:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703000/0xdb7edb52b831d00e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcd1154cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160871:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703000/0xdb7edb52b831d00e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcd1154cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160876:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160879:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703000/0xdb7edb52b831d00e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcd1154cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.160883:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00010000:00010000:3.0:1788572217.160885:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703000/0xdb7edb52b831d00e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcd1154cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160892:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703000/0xdb7edb52b831d00e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcd1154cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160898:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703000/0xdb7edb52b831d00e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcd1154cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160915:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790800/0xdb7edb52b831d023 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbee01604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160919:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160921:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790800/0xdb7edb52b831d023 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbee01604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160926:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9600/0xdb7edb52b831e688 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44fa5c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160932:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790800/0xdb7edb52b831d023 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbee01604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160937:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637790800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160939:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790800/0xdb7edb52b831d023 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbee01604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160940:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160946:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790800/0xdb7edb52b831d023 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbee01604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160947:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160953:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160954:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790800/0xdb7edb52b831d023 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbee01604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160958:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160960:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790800/0xdb7edb52b831d023 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbee01604 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160961:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160967:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160973:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160974:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b831d038 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0fe35c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160980:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b831e69d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6d7db609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160981:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b831d038 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0fe35c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160987:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b831d038 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0fe35c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.160991:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.160991:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.160994:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b831d038 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0fe35c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.161001:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b831d038 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0fe35c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161002:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161028:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.161030:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b831d038 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd0fe35c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161033:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.161036:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.161037:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b831d038 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd0fe35c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161043:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161050:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.161052:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702c00/0xdb7edb52b831d04d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb5f999a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161056:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8000/0xdb7edb52b831e6b2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2a2c142b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161070:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161076:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161082:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161086:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.161088:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161094:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161102:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161107:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8400/0xdb7edb52b831e6c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf34068a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161119:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161125:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161130:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161134:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.161137:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161142:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161150:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161156:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9a00/0xdb7edb52b831e6dc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55e675a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161172:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161178:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161184:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161190:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.161193:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161199:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161207:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161213:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b831e6f1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9aaca1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161225:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161231:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161237:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.161243:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00010000:00010000:0.0:1788572217.161246:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.161249:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161255:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.161258:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638889216:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.161263:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161269:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717c00/0xdb7edb52b831e706 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x316f82c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572217.161277:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2061 count 1 00000100:00100000:2.0:1788572217.161365:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638889216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 113us (1627us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.161371:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00100000:2.0:1788572217.161384:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:2.0:1788572217.161391:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638889728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.161404:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2061 count 1 00000100:00100000:2.0:1788572217.161451:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638889728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 61us (1680us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.161457:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:2.0:1788572217.161468:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1788572217.161474:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638889088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.161485:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2060 count 1 00000100:00100000:2.0:1788572217.161522:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638889088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48us (1703us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.161528:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1788572217.161539:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1788572217.161545:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638889600:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.161555:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572217.161556:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2060 count 1 00010000:00010000:0.0:1788572217.161561:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161568:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161573:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.161576:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161583:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.161591:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638889600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 47us (1740us total) trans 0 rc -2/-2 00010000:00010000:0.0:1788572217.161592:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.161597:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00010000:00010000:0.0:1788572217.161598:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3200/0xdb7edb52b831e71b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x59f2dc80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161612:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc718e981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161618:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc718e981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161623:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc718e981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161628:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.161630:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc718e981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161635:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc718e981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161642:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc718e981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161647:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b831e730 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc718e981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.161665:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10380, transno 0 00010000:00010000:0.0:1788572217.161671:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80813dfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.161673:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10380/1, rc -2, transno 0 00010000:00010000:0.0:1788572217.161676:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80813dfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161686:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80813dfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.161687:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638889088:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.161692:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618717000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.161694:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80813dfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.161698:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637597800, transno 0 00000004:00080000:2.0:1788572217.161700:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637597800/1, rc -2, transno 0 00010000:00010000:0.0:1788572217.161701:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80813dfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.161707:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638889600:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.161709:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x80813dfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.161714:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12d80, transno 0 00010000:00010000:0.0:1788572217.161715:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618717000/0xdb7edb52b831e745 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x80813dfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.161716:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12d80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.161720:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638889216:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.161726:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637595880, transno 0 00000004:00080000:2.0:1788572217.161728:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637595880/1, rc -2, transno 0 00010000:00010000:0.0:1788572217.161729:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e661773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.161731:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638889728:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.161735:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e661773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161740:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e661773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161745:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.161747:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e661773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161753:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e661773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.161753:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638889472:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.161760:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1e661773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161765:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2a00/0xdb7edb52b831e75a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1e661773 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161779:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.161782:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.161797:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161803:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161808:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.161811:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.161815:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11c00, transno 0 00010000:00010000:0.0:1788572217.161817:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.161818:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11c00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.161822:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638888832:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.161825:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.161830:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12300, transno 0 00010000:00010000:0.0:1788572217.161831:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2600/0xdb7edb52b831e76f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc8e9712c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.161832:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12300/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.161835:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638888960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.161844:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788572217.161846:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.161849:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638889344:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.161856:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161862:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161867:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728c00 already unused, calling callback (ffffffffc17dd4f0) 00000100:00100000:2.0:1788572217.161867:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.161870:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161876:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161884:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.161890:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728c00/0xdb7edb52b831e784 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1c691ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.161890:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638889472 00000100:00100000:2.0:1788572217.161894:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638889472 00000100:00100000:2.0:1788572217.161918:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638889344 00000100:00100000:2.0:1788572217.161922:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638889344 00000100:00100000:2.0:1788572217.161936:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:2.0:1788572217.161942:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638889472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.161968:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2059 count 1 00000100:00100000:2.0:1788572217.162034:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638889472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 92us (251us total) trans 0 rc -2/-2 00010000:00010000:0.0:1788572217.162036:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.162041:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00010000:00010000:0.0:1788572217.162043:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162048:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.162052:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00010000:00010000:0.0:1788572217.162054:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.162244:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162252:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162261:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162267:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972e00/0xdb7edb52b831e799 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x256c78a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162354:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb21285aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162361:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb21285aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162366:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb21285aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162372:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.162375:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb21285aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162380:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb21285aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162389:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb21285aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162395:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8400/0xdb7edb52b831e7ae lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb21285aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162414:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x562ada23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162420:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x562ada23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162425:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x562ada23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162429:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.162432:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x562ada23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162438:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x562ada23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162446:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x562ada23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162452:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674200/0xdb7edb52b831e7c3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x562ada23 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162464:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcba612cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162469:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcba612cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162473:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcba612cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162481:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a0a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.162483:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcba612cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162488:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcba612cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162495:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcba612cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162499:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a0a00/0xdb7edb52b831e7d8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcba612cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162512:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162518:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162522:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162527:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.162529:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162535:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162542:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162547:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675e00/0xdb7edb52b831e7ed lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2cb67c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162559:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf7607446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162565:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf7607446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162570:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf7607446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162575:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.162578:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf7607446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162583:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf7607446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162590:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf7607446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162595:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674800/0xdb7edb52b831e802 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf7607446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162606:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162613:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162623:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162628:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.162630:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162636:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162643:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.162648:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1400/0xdb7edb52b831e817 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1ab7cdff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163002:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163035:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163041:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163045:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.163048:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163054:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163070:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163076:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674e00/0xdb7edb52b831e82c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3a9ca778 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163092:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163098:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163104:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163108:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.163110:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163115:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163123:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163128:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675800/0xdb7edb52b831e841 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdafd10f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163141:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af88eef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163150:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af88eef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163155:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af88eef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163161:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.163163:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af88eef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163169:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af88eef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163177:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8af88eef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163183:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b831e856 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8af88eef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163196:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x128288a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163202:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x128288a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163208:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x128288a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163213:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.163216:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x128288a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163222:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x128288a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163230:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x128288a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163236:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b831e86b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x128288a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163249:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163256:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163261:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163265:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.163269:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163417:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702c00/0xdb7edb52b831d04d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb5f999a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163423:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702c00/0xdb7edb52b831d04d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb5f999a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163428:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.163431:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702c00/0xdb7edb52b831d04d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb5f999a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163437:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702c00/0xdb7edb52b831d04d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb5f999a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163446:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702c00/0xdb7edb52b831d04d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb5f999a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163451:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702c00/0xdb7edb52b831d04d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb5f999a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163472:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831d062 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6835ad98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163481:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831d062 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6835ad98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163487:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831d062 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6835ad98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163492:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.163494:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831d062 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6835ad98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163499:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831d062 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6835ad98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163506:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831d062 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6835ad98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163511:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec400/0xdb7edb52b831d062 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6835ad98 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163526:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b831d077 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf3f7bc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163532:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b831d077 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf3f7bc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163537:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b831d077 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf3f7bc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163541:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.163544:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b831d077 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf3f7bc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163549:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b831d077 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf3f7bc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163556:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b831d077 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf3f7bc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163561:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b831d077 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf3f7bc9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163577:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790400/0xdb7edb52b831d08c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33286235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163582:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790400/0xdb7edb52b831d08c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33286235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163588:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790400/0xdb7edb52b831d08c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33286235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163592:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637790400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.163594:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790400/0xdb7edb52b831d08c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33286235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163600:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790400/0xdb7edb52b831d08c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33286235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163607:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790400/0xdb7edb52b831d08c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x33286235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163613:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790400/0xdb7edb52b831d08c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x33286235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163633:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791200/0xdb7edb52b831d0a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6a38c614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163639:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791200/0xdb7edb52b831d0a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6a38c614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163645:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791200/0xdb7edb52b831d0a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6a38c614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163650:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637791200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.163664:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791200/0xdb7edb52b831d0a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6a38c614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163669:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791200/0xdb7edb52b831d0a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6a38c614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163678:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791200/0xdb7edb52b831d0a1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6a38c614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163683:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791200/0xdb7edb52b831d0a1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6a38c614 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163701:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163708:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163714:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163723:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ec200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.163726:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163726:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163733:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163736:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163740:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163742:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674000/0xdb7edb52b831e880 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcda5f5a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163746:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ec200/0xdb7edb52b831d0b6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb92a8624 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163761:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ac00/0xdb7edb52b831d0cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8021e908 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163762:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163767:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ac00/0xdb7edb52b831d0cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8021e908 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163768:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163774:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163774:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ac00/0xdb7edb52b831d0cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8021e908 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163779:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.163779:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14ac00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.163782:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163782:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ac00/0xdb7edb52b831d0cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8021e908 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163787:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ac00/0xdb7edb52b831d0cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8021e908 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163794:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ac00/0xdb7edb52b831d0cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8021e908 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163800:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ac00/0xdb7edb52b831d0cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8021e908 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163816:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5862f90d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163822:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5862f90d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163829:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5862f90d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163834:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411edc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.163837:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5862f90d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163843:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5862f90d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163852:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163852:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5862f90d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163858:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411edc00/0xdb7edb52b831d0e0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5862f90d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163860:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163865:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13400/0xdb7edb52b831e895 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2d6a4a22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163874:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24147625 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163879:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163880:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24147625 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163886:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163891:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24147625 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163892:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163898:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.163900:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24147625 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163906:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24147625 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163914:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24147625 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163919:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a800/0xdb7edb52b831d0f5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24147625 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163934:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163940:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163947:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163952:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1ac00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.163956:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163962:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163964:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.163967:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163971:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163974:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163977:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b831d10a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x35b0d4cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163982:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.163986:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b831e8aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa2e582cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163994:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd7569629 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.163999:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd7569629 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164022:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164026:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd7569629 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164029:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164031:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.164034:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd7569629 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164035:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164040:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.164040:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd7569629 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164043:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164047:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd7569629 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164049:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164053:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81a00/0xdb7edb52b831d11f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd7569629 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164078:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703400/0xdb7edb52b831d134 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd02104d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164089:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703400/0xdb7edb52b831d134 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd02104d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164095:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703400/0xdb7edb52b831d134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd02104d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164100:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.164103:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703400/0xdb7edb52b831d134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd02104d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164108:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164109:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703400/0xdb7edb52b831d134 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd02104d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164116:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b831e8bf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc1cc8c44 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164118:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703400/0xdb7edb52b831d134 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd02104d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164124:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703400/0xdb7edb52b831d134 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd02104d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164133:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164137:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703600/0xdb7edb52b831d149 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x76b007bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164139:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164144:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703600/0xdb7edb52b831d149 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x76b007bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164146:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164150:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703600/0xdb7edb52b831d149 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x76b007bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164151:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164154:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164155:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.164157:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703600/0xdb7edb52b831d149 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x76b007bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164159:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164164:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703600/0xdb7edb52b831d149 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x76b007bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164167:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164172:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b831e8d4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94f3e445 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164172:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703600/0xdb7edb52b831d149 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x76b007bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164178:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703600/0xdb7edb52b831d149 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x76b007bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164183:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164188:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164190:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a000/0xdb7edb52b831d15e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e27ae5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164197:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a000/0xdb7edb52b831d15e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e27ae5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164198:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164203:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164206:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164212:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164214:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a000/0xdb7edb52b831d15e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e27ae5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164219:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14a000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164220:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164222:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a000/0xdb7edb52b831d15e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e27ae5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164227:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674600/0xdb7edb52b831e8e9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9df73dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.164228:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a000/0xdb7edb52b831d15e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e27ae5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164241:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d19777 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164246:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d19777 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164252:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d19777 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164257:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164259:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d19777 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164265:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d19777 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164341:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d19777 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164348:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674400/0xdb7edb52b831e8fe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d19777 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.164351:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638889344:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.164364:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164369:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164374:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164379:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164382:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572217.164384:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2058 count 1 00010000:00010000:0.0:1788572217.164388:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164394:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164399:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b831e913 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9fe20f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164412:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacde22df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164421:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacde22df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164426:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacde22df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164431:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e5c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164433:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacde22df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164438:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xacde22df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164445:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xacde22df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164450:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5c00/0xdb7edb52b831e928 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xacde22df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164462:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164466:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164472:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164476:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164478:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164484:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164490:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164495:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729c00/0xdb7edb52b831e93d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc4cf9758 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.164497:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638889344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2439us (2628us total) trans 0 rc -2/-2 00010000:00010000:0.0:1788572217.164508:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17e88459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.164508:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00010000:00010000:0.0:1788572217.164514:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17e88459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164519:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17e88459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164523:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164526:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17e88459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164531:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17e88459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164537:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x17e88459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164543:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b831e952 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x17e88459 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164559:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164564:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164568:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164572:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164575:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164580:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164586:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164591:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376e00/0xdb7edb52b831e967 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4a4bde12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164602:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164608:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164613:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164620:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164623:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164628:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.164634:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637595500, transno 0 00010000:00010000:0.0:1788572217.164635:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164640:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377000/0xdb7edb52b831e97c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x66eb16bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.164640:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637595500/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.164646:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638889344:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.164662:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.164668:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637596300, transno 0 00010000:00010000:0.0:1788572217.164669:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.164671:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637596300/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.164674:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638889472:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.164677:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164681:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0de00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164683:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164689:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164697:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164702:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b831e991 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb4ae2034 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164714:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x87d57835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164720:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x87d57835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164725:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x87d57835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164729:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164731:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x87d57835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164737:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x87d57835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164743:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x87d57835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164748:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377200/0xdb7edb52b831e9a6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x87d57835 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164759:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe839ccae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164765:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe839ccae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164774:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe839ccae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.164778:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.164781:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe839ccae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.164781:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 188 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:2.0:1788572217.164872:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638890240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.164909:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.164989:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe839ccae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165000:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe839ccae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165029:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376200/0xdb7edb52b831e9bb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe839ccae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165045:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165051:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165066:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165072:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.165075:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165081:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165090:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165095:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1200/0xdb7edb52b831e9d0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x82bdab67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165109:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165115:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165120:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165124:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.165127:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165132:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165139:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165144:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031400/0xdb7edb52b831e9e5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa1a4b4e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165156:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165165:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165171:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165175:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.165177:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165183:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165190:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165195:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b831e9fa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3d1263cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165208:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165214:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165220:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165225:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0ce00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.165227:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165233:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165241:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165247:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b831ea0f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1f76b846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165261:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165266:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165283:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165288:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.165291:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165298:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165306:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165312:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b831ea24 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcaee2547 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165331:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51517f00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165338:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51517f00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165343:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51517f00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165349:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.165352:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51517f00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165358:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x51517f00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165366:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x51517f00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165372:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377e00/0xdb7edb52b831ea39 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x51517f00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165386:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165392:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165398:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165406:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.165409:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165415:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165423:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165428:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b831ea4e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6e4f57a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165441:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165446:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788572217.165447:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165453:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638890112:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.165454:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165459:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.165461:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165467:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165474:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165479:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.165481:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d600/0xdb7edb52b831ea63 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4d5fc122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165494:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165500:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165505:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165510:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421eec00 already unused, calling callback (ffffffffc17dd4f0) 00000100:00100000:2.0:1788572217.165510:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638890240 00010000:00010000:0.0:1788572217.165513:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165516:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638890240 00010000:00010000:0.0:1788572217.165518:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165525:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165530:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eec00/0xdb7edb52b831ea78 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8db1923 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165544:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165550:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165550:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638890112 00000100:00100000:2.0:1788572217.165552:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638890112 00010000:00010000:0.0:1788572217.165560:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165566:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0da00 already unused, calling callback (ffffffffc17dd4f0) 00000100:00100000:2.0:1788572217.165567:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00010000:00010000:0.0:1788572217.165569:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165575:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165575:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638890240:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.165583:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165588:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b831ea8d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeac20d9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572217.165596:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2065 count 1 00010000:00010000:0.0:1788572217.165602:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165607:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165612:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165617:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ee200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.165619:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165625:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165632:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165638:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ee200/0xdb7edb52b831eaa2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdf30ec55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165662:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa99155ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165670:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa99155ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165671:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638890240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 96us (762us total) trans 0 rc -2/-2 00010000:00010000:0.0:1788572217.165676:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa99155ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165677:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00010000:00010000:0.0:1788572217.165681:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0ca00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.165684:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa99155ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165690:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa99155ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165697:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa99155ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165703:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ca00/0xdb7edb52b831eab7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa99155ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165705:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:2.0:1788572217.165711:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638890112:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.165718:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572217.165726:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2064 count 1 00010000:00010000:0.0:1788572217.165728:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165733:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165739:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.165741:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165748:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165755:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165761:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b831eacc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd9fe77be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165762:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638890112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 52us (282us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.165768:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00010000:00010000:0.0:1788572217.165775:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165781:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.165806:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637597100, transno 0 00000004:00080000:2.0:1788572217.165811:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637597100/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.165820:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638890112:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.165829:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637594a80, transno 0 00000004:00080000:2.0:1788572217.165831:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637594a80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.165834:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638890240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.165847:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638889984:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.165865:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165871:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377c00 already unused, calling callback (ffffffffc17dd4f0) 00000100:00100000:2.0:1788572217.165872:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.165874:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.165881:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165888:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788572217.165891:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165894:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638889856:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.165897:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377c00/0xdb7edb52b831eae1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1062cc37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.165912:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.165935:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638889984 00000100:00100000:2.0:1788572217.165939:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638889984 00000100:00100000:2.0:1788572217.165960:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638889856 00000100:00100000:2.0:1788572217.165962:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638889856 00000100:00100000:2.0:1788572217.165976:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:2.0:1788572217.165981:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638889984:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.165988:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572217.165991:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2063 count 1 00010000:00010000:0.0:1788572217.165995:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166000:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166028:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0dc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166031:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166038:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166046:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166052:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b831eaf6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe5da3938 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.166052:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638889984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 71us (180us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.166070:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00000100:00100000:2.0:1788572217.166089:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:2.0:1788572217.166096:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638889856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.166105:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2062 count 1 00000100:00100000:2.0:1788572217.166144:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638889856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49us (231us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.166150:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000004:00080000:2.0:1788572217.166196:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637597b80, transno 0 00000004:00080000:2.0:1788572217.166210:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637597b80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.166214:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638889856:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.166223:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637594e00, transno 0 00000004:00080000:2.0:1788572217.166225:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637594e00/1, rc -2, transno 0 00010000:00010000:0.0:1788572217.166228:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.166228:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638889984:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.166234:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166241:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166246:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166249:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166255:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166264:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166270:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8800/0xdb7edb52b831eb0b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5aee8db1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166287:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166293:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166299:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166307:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166310:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166316:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166324:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166330:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675a00/0xdb7edb52b831eb20 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb7e87b5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166337:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a000/0xdb7edb52b831d15e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc9e27ae5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166344:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a000/0xdb7edb52b831d15e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc9e27ae5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166345:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x924bd513 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166352:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x924bd513 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166357:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x924bd513 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166362:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166364:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x924bd513 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166370:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x924bd513 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166371:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b200/0xdb7edb52b831d173 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0fe3703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166378:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x924bd513 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166378:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b200/0xdb7edb52b831d173 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0fe3703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166384:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b200/0xdb7edb52b831d173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0fe3703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166385:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675000/0xdb7edb52b831eb35 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x924bd513 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166389:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14b200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166392:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b200/0xdb7edb52b831d173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0fe3703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166396:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b200/0xdb7edb52b831d173 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0fe3703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166399:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166403:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b200/0xdb7edb52b831d173 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc0fe3703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166405:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166410:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b200/0xdb7edb52b831d173 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc0fe3703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166411:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166417:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0cc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166419:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166423:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b000/0xdb7edb52b831d188 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13f59994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166424:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166429:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b000/0xdb7edb52b831d188 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13f59994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166431:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166436:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b000/0xdb7edb52b831d188 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13f59994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166438:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0cc00/0xdb7edb52b831eb4a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x17bcad14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166445:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14b000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166447:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b000/0xdb7edb52b831d188 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13f59994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166449:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7821018d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166454:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b000/0xdb7edb52b831d188 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13f59994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166455:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7821018d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166461:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b000/0xdb7edb52b831d188 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x13f59994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166465:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7821018d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166467:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b000/0xdb7edb52b831d188 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x13f59994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166471:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166473:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7821018d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166478:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7821018d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166480:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166485:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7821018d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166486:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166491:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675200/0xdb7edb52b831eb5f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7821018d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166492:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166497:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411eca00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166500:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166502:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a049006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166506:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166508:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a049006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166513:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166514:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a049006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166519:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166520:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eca00/0xdb7edb52b831d19d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf34c54b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166521:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a049006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166526:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a049006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166534:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1a049006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166534:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166540:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166541:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674c00/0xdb7edb52b831eb74 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1a049006 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166547:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166551:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411eda00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166553:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166554:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166559:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166560:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166565:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166568:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166571:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166574:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166574:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411eda00/0xdb7edb52b831d1b2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8d64bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166580:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166587:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166592:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b831eb89 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8137e9bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166595:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x26df8995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166600:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x26df8995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166605:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166610:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x26df8995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166615:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166616:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166618:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x26df8995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166621:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166624:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x26df8995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166626:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166629:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166631:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x26df8995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166635:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166636:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed400/0xdb7edb52b831d1c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x26df8995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166642:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166646:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675400/0xdb7edb52b831eb9e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x434f86c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166662:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a600/0xdb7edb52b831d1dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x332645ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166668:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a600/0xdb7edb52b831d1dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x332645ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166669:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166673:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a600/0xdb7edb52b831d1dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x332645ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166675:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166679:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14a600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166681:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166681:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a600/0xdb7edb52b831d1dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x332645ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166686:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637674a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166688:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a600/0xdb7edb52b831d1dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x332645ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166689:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166695:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166696:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a600/0xdb7edb52b831d1dc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x332645ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166702:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a600/0xdb7edb52b831d1dc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x332645ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166703:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166710:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637674a00/0xdb7edb52b831ebb3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79b3db3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166716:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b800/0xdb7edb52b831d1f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a9f0999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166719:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166722:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b800/0xdb7edb52b831d1f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a9f0999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166725:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166728:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b800/0xdb7edb52b831d1f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a9f0999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166731:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166733:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14b800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166736:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166736:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b800/0xdb7edb52b831d1f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a9f0999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166739:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166741:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b800/0xdb7edb52b831d1f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a9f0999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166744:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166748:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b800/0xdb7edb52b831d1f1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8a9f0999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166751:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166754:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b800/0xdb7edb52b831d1f1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8a9f0999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166756:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8a00/0xdb7edb52b831ebc8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdc59e83b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166766:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166771:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x686141f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166775:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166777:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x686141f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166782:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166784:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x686141f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166786:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ece00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166789:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166794:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166798:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ef400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.166800:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x686141f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166802:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166806:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x686141f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166808:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ece00/0xdb7edb52b831d206 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa58b1d89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166813:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x686141f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166819:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421ef400/0xdb7edb52b831ebdd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x686141f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166822:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166827:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166832:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166833:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166839:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166839:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166841:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166845:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166848:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166854:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166856:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166857:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166861:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b831d21b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc7978ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166862:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166869:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166874:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376c00/0xdb7edb52b831ebf2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1f440a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166877:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14aa00/0xdb7edb52b831d230 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf78333ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166881:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14aa00/0xdb7edb52b831d230 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf78333ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166885:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91a76416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166887:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14aa00/0xdb7edb52b831d230 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf78333ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166891:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91a76416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166892:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14aa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166895:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14aa00/0xdb7edb52b831d230 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf78333ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.166897:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91a76416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166900:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14aa00/0xdb7edb52b831d230 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf78333ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166907:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14aa00/0xdb7edb52b831d230 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf78333ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166913:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14aa00/0xdb7edb52b831d230 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf78333ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166951:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166958:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166963:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166968:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ede00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.166970:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166975:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166983:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.166988:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ede00/0xdb7edb52b831d245 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68e46f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167022:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167029:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167035:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167043:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.167046:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167051:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167058:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167064:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed600/0xdb7edb52b831d25a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x307bf9d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167079:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x97775db3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167086:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x97775db3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167091:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x97775db3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167096:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6411ed200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.167099:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x97775db3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167104:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x97775db3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167110:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x97775db3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167116:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6411ed200/0xdb7edb52b831d26f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x97775db3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167130:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x56770d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167136:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x56770d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167142:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x56770d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167146:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145b800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.167149:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x56770d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167155:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x56770d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167162:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x56770d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167166:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b800/0xdb7edb52b831d284 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x56770d6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167179:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14be00/0xdb7edb52b831d299 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x86143eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167185:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14be00/0xdb7edb52b831d299 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x86143eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167194:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14be00/0xdb7edb52b831d299 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x86143eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167199:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14be00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.167201:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14be00/0xdb7edb52b831d299 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x86143eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167206:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14be00/0xdb7edb52b831d299 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x86143eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167213:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14be00/0xdb7edb52b831d299 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x86143eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.167218:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14be00/0xdb7edb52b831d299 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x86143eb1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167507:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.167511:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91a76416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167517:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91a76416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167526:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91a76416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167532:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376a00/0xdb7edb52b831ec07 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91a76416 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167552:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167558:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167563:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167568:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421eea00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.167570:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167576:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167583:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167587:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6421eea00/0xdb7edb52b831ec1c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1c515c17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167603:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4309b090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167609:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4309b090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167618:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4309b090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167623:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.167626:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4309b090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167630:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4309b090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167638:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4309b090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167643:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641376600/0xdb7edb52b831ec31 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4309b090 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167665:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x23788f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167672:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x23788f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167677:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x23788f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167682:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.167684:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x23788f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167689:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x23788f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167697:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x23788f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167702:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641377a00/0xdb7edb52b831ec46 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x23788f49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167713:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167717:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167722:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167726:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572217.167728:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167733:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167739:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.167744:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b831ec5b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd888f8c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572217.168183:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 188 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:0.0:1788572217.168361:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638890368:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.168420:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.168468:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572217.168474:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638890496:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.168498:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.168528:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638890624:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.168553:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.168586:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638890368 00000004:00080000:0.0:1788572217.168591:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d180, transno 0 00000100:00100000:2.0:1788572217.168593:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638890368 00000004:00080000:0.0:1788572217.168597:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d180/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.168603:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638887168:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.168613:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c000, transno 0 00000004:00080000:0.0:1788572217.168615:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2c000/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.168618:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638887680:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.168627:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c380, transno 0 00000004:00080000:0.0:1788572217.168629:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2c380/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.168630:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638890496 00000100:00100000:2.0:1788572217.168632:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638890496 00000100:00100000:0.0:1788572217.168636:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638888192:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.168644:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931880, transno 0 00000100:00100000:2.0:1788572217.168646:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638890624 00000004:00080000:0.0:1788572217.168647:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931880/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.168648:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638890624 00000100:00100000:0.0:1788572217.168662:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638888704:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.168673:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2ce00, transno 0 00000004:00080000:0.0:1788572217.168676:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2ce00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.168679:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638887040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.168681:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000004:00080000:0.0:1788572217.168687:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f100, transno 0 00000004:00080000:0.0:1788572217.168689:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2f100/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.168689:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638890368:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.168692:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638887552:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.168700:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2e680, transno 0 00000004:00080000:0.0:1788572217.168703:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2e680/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.168705:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638888064:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.168712:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503933480, transno 0 00000004:00080000:0.0:1788572217.168714:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503933480/1, rc -2, transno 0 00002000:00080000:2.0:1788572217.168715:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2062 count 1 00000100:00100000:0.0:1788572217.168717:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638888576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.168728:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572217.168733:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638890752:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.168753:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.168804:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638890368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 114us (382us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.168812:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:2.0:1788572217.168843:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638890752 00000100:00100000:2.0:1788572217.168846:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638890752 00000100:00100000:2.0:1788572217.168871:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:2.0:1788572217.168876:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638890496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.168889:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2063 count 1 00000100:00100000:2.0:1788572217.168933:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638890496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 56us (434us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.168939:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:2.0:1788572217.168968:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000004:00080000:0.0:1788572217.168972:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 184 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:2.0:1788572217.168974:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638890624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.168984:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2064 count 1 00000100:00100000:2.0:1788572217.169040:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638890624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 67us (486us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.169047:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:0.0:1788572217.169048:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638891136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.169059:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:2.0:1788572217.169064:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638890752:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.169070:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1788572217.169075:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2065 count 1 00000004:00080000:0.0:1788572217.169099:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637597800, transno 0 00000004:00080000:0.0:1788572217.169103:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637597800/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.169110:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638890624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.169114:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638890752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (360us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.169119:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000004:00080000:0.0:1788572217.169121:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637595880, transno 0 00000004:00080000:0.0:1788572217.169123:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637595880/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.169127:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638890752:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.169130:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572217.169131:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638891136 00000100:00100000:2.0:1788572217.169134:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638891136 00000100:00100000:0.0:1788572217.169135:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638891264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.169155:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:0.0:1788572217.169156:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.169161:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638891136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.169171:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2068 count 1 00000100:00100000:0.0:1788572217.169179:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638891264 00000100:00100000:0.0:1788572217.169182:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638891264 00000100:00100000:0.0:1788572217.169205:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:0.0:1788572217.169211:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638891264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.169223:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2069 count 1 00000100:00100000:0.0:1788572217.169413:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638891264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 200us (254us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.169420:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000004:00080000:0.0:1788572217.169511:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b2680, transno 0 00000004:00080000:0.0:1788572217.169515:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a9b2680/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.169766:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572217.169775:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638891648:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.169816:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.169844:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638891648 00000100:00100000:1.0:1788572217.169848:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638891648 00000100:00100000:1.0:1788572217.169874:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:1.0:1788572217.169880:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638891648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.169892:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2072 count 1 00000100:00100000:1.0:1788572217.169951:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638891648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 71us (134us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.169957:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000004:00080000:1.0:1788572217.169995:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11180, transno 0 00000004:00080000:1.0:1788572217.169998:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11180/1, rc -2, transno 0 00010000:00010000:3.0:1788572217.170152:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170165:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170173:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170180:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145ba00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.170185:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170194:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.170419:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638891648:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.170499:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638891776:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.170524:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.170552:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638891776 00000100:00100000:1.0:1788572217.170556:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638891776 00000100:00100000:1.0:1788572217.170582:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:1.0:1788572217.170588:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638891776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.170602:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2073 count 1 00010000:00010000:3.0:1788572217.170606:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170613:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ba00/0xdb7edb52b831d2ae lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa3d6624d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170645:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a400/0xdb7edb52b831d2c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x10e39d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.170662:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638891776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 63us (126us total) trans 0 rc -2/-2 00010000:00010000:3.0:1788572217.170664:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a400/0xdb7edb52b831d2c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x10e39d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.170668:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00010000:00010000:3.0:1788572217.170670:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a400/0xdb7edb52b831d2c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x10e39d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170675:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14a400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.170679:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a400/0xdb7edb52b831d2c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x10e39d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170685:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a400/0xdb7edb52b831d2c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x10e39d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572217.170691:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11180, transno 0 00010000:00010000:3.0:1788572217.170693:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a400/0xdb7edb52b831d2c3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x10e39d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572217.170694:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11180/1, rc -2, transno 0 00010000:00010000:3.0:1788572217.170699:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a400/0xdb7edb52b831d2c3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x10e39d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.170701:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638891776:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.170719:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b600/0xdb7edb52b831d2d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77148156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170730:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b600/0xdb7edb52b831d2d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77148156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170736:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b600/0xdb7edb52b831d2d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77148156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170741:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14b600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.170744:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b600/0xdb7edb52b831d2d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77148156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170750:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b600/0xdb7edb52b831d2d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77148156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170758:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b600/0xdb7edb52b831d2d8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x77148156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170764:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b600/0xdb7edb52b831d2d8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x77148156 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170779:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170785:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170791:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170796:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.170799:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170804:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170813:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170819:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b831d2ed lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc6ad9d74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170838:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14bc00/0xdb7edb52b831d302 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb891890d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170845:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14bc00/0xdb7edb52b831d302 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb891890d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170851:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14bc00/0xdb7edb52b831d302 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb891890d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170856:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14bc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.170859:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14bc00/0xdb7edb52b831d302 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb891890d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170864:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14bc00/0xdb7edb52b831d302 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb891890d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170873:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14bc00/0xdb7edb52b831d302 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb891890d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.170880:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14bc00/0xdb7edb52b831d302 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb891890d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.170919:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638891264:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.171583:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791600/0xdb7edb52b831d317 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7991811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171590:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791600/0xdb7edb52b831d317 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7991811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171596:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791600/0xdb7edb52b831d317 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7991811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171601:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637791600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.171605:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791600/0xdb7edb52b831d317 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7991811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171611:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791600/0xdb7edb52b831d317 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7991811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171620:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791600/0xdb7edb52b831d317 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc7991811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171626:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637791600/0xdb7edb52b831d317 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc7991811 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171644:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b400/0xdb7edb52b831d32c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x37cfa816 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171649:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b400/0xdb7edb52b831d32c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x37cfa816 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171666:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b400/0xdb7edb52b831d32c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x37cfa816 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171674:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14b400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.171677:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b400/0xdb7edb52b831d32c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x37cfa816 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171683:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b400/0xdb7edb52b831d32c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x37cfa816 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171690:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b400/0xdb7edb52b831d32c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x37cfa816 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171696:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14b400/0xdb7edb52b831d32c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x37cfa816 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171714:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b831d341 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3553c433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171720:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b831d341 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3553c433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171727:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b831d341 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3553c433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171731:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.171734:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b831d341 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3553c433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171739:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b831d341 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3553c433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171747:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b831d341 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3553c433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171752:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b831d341 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3553c433 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171774:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703200/0xdb7edb52b831d356 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc82767e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171781:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703200/0xdb7edb52b831d356 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc82767e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171787:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703200/0xdb7edb52b831d356 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc82767e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171793:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.171796:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703200/0xdb7edb52b831d356 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc82767e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171801:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703200/0xdb7edb52b831d356 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc82767e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171809:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703200/0xdb7edb52b831d356 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc82767e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171815:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703200/0xdb7edb52b831d356 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc82767e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171829:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88c34532 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171836:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88c34532 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171846:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88c34532 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171850:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.171853:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88c34532 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171859:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88c34532 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171867:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x88c34532 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171872:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b800/0xdb7edb52b831d36b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x88c34532 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171891:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b831d380 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2dc68e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171897:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b831d380 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2dc68e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171903:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b831d380 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2dc68e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171909:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.171912:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b831d380 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2dc68e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171917:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b831d380 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2dc68e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171926:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b831d380 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb2dc68e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171932:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b831d380 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb2dc68e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171946:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b831d395 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3e324bc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171953:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b831d395 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3e324bc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171958:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b831d395 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3e324bc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171963:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.171965:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b831d395 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3e324bc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171972:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b831d395 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3e324bc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171980:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b831d395 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3e324bc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.171986:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b831d395 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3e324bc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172001:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4200/0xdb7edb52b831d3aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4268dbcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172037:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4200/0xdb7edb52b831d3aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4268dbcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172043:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4200/0xdb7edb52b831d3aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4268dbcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172047:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.172050:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4200/0xdb7edb52b831d3aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4268dbcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172061:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4200/0xdb7edb52b831d3aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4268dbcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172070:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4200/0xdb7edb52b831d3aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4268dbcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172076:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4200/0xdb7edb52b831d3aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4268dbcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172092:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172097:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172102:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172106:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.172109:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172115:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172123:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172129:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b831d3bf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xefa84bc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172142:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b831d3d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5f6923d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172147:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b831d3d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5f6923d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172153:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b831d3d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5f6923d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172157:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.172160:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b831d3d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5f6923d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172165:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b831d3d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5f6923d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172172:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b831d3d4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc5f6923d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172177:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b831d3d4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc5f6923d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.172195:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696000/0xdb7edb52b831d3e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xff30f662 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572217.172202:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 184 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:2.0:1788572217.172297:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638891136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3132us (3221us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.172307:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1788572217.172367:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638891008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.172408:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.172445:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638890880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.172445:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638891520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.172468:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.172492:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638891008 00000100:00100000:2.0:1788572217.172493:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638892032:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.172498:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638891008 00000100:00100000:2.0:1788572217.172515:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.172536:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638892544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.172555:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.172560:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638892288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.172590:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638892160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.172868:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638891520 00000100:00100000:0.0:1788572217.172873:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638891520 00000100:00100000:0.0:1788572217.172895:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638892032 00000100:00100000:0.0:1788572217.172908:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638892032 00000100:00100000:0.0:1788572217.172926:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638892544 00000100:00100000:0.0:1788572217.172929:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638892544 00000100:00100000:0.0:1788572217.172946:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:0.0:1788572217.172953:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638891008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.172982:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2067 count 1 00000100:00100000:0.0:1788572217.173101:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638891008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 148us (692us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.173107:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:0.0:1788572217.173189:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00010000:00010000:3.0:1788572217.173194:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696000/0xdb7edb52b831d3e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xff30f662 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.173195:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638891520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.173206:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2071 count 1 00010000:00010000:3.0:1788572217.173212:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696000/0xdb7edb52b831d3e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xff30f662 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173217:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637696000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173222:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696000/0xdb7edb52b831d3e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xff30f662 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173229:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696000/0xdb7edb52b831d3e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xff30f662 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.173243:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638891520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48us (774us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.173249:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00010000:00010000:3.0:1788572217.173252:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696000/0xdb7edb52b831d3e9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xff30f662 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173258:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696000/0xdb7edb52b831d3e9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xff30f662 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.173260:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:0.0:1788572217.173266:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638892032:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.173283:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702800/0xdb7edb52b831d3fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf588d3b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173290:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702800/0xdb7edb52b831d3fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf588d3b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173295:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702800/0xdb7edb52b831d3fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf588d3b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173303:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173306:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702800/0xdb7edb52b831d3fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf588d3b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173312:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702800/0xdb7edb52b831d3fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf588d3b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173320:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702800/0xdb7edb52b831d3fe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf588d3b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173326:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702800/0xdb7edb52b831d3fe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf588d3b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173343:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280200/0xdb7edb52b831d413 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x156a1dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173348:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280200/0xdb7edb52b831d413 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x156a1dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173354:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280200/0xdb7edb52b831d413 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x156a1dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173359:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173362:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280200/0xdb7edb52b831d413 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x156a1dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173368:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280200/0xdb7edb52b831d413 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x156a1dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173376:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280200/0xdb7edb52b831d413 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x156a1dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173382:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280200/0xdb7edb52b831d413 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x156a1dc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173397:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173403:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173408:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173413:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145ac00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173415:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173421:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173428:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173432:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ac00/0xdb7edb52b831d428 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdd3e0619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173450:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173455:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173465:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173469:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173471:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173476:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173483:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173488:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a200/0xdb7edb52b831d43d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc9a47f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173502:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173508:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173512:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173517:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade8600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173519:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173525:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173531:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173537:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade8600/0xdb7edb52b831d452 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f75c793 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173553:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173559:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173564:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173568:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173571:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173577:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173583:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173588:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a000/0xdb7edb52b831d467 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb3580c60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173621:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173632:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173638:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173643:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145ae00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173646:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173664:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173672:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173679:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145ae00/0xdb7edb52b831d47c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8e1f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173708:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x11d613ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173714:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x11d613ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173719:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x11d613ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173724:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173727:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x11d613ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173732:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x11d613ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173741:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x11d613ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173746:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281c00/0xdb7edb52b831d491 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x11d613ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173759:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173765:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173772:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173776:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145b000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173778:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173783:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173790:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173796:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b000/0xdb7edb52b831d4a6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5cd6ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173814:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173820:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173826:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173831:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173834:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173840:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173849:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173854:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b831d4bb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbad0c8b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173877:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73a91119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173885:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73a91119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173891:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73a91119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173898:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173902:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73a91119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173907:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73a91119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173915:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x73a91119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173920:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b831d4d0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x73a91119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173936:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173943:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173948:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173952:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145b600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.173954:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173960:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173968:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173973:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b600/0xdb7edb52b831d4e5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9d8f0ad2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173987:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173993:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.173999:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174025:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174028:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174034:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174042:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174047:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9e00/0xdb7edb52b831d4fa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x610a62d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174064:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b831d50f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x209acc4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174070:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b831d50f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x209acc4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174079:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b831d50f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x209acc4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174084:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174087:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b831d50f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x209acc4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174093:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b831d50f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x209acc4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174102:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b831d50f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x209acc4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174108:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b831d50f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x209acc4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174124:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b831d524 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b9604f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174131:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b831d524 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b9604f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174136:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b831d524 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b9604f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174141:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174144:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b831d524 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b9604f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174150:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b831d524 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b9604f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174157:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b831d524 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4b9604f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174163:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b831d524 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4b9604f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174176:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b831d539 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb7cf96e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174182:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b831d539 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb7cf96e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174188:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b831d539 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb7cf96e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174192:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174196:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b831d539 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb7cf96e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174201:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b831d539 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb7cf96e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174209:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b831d539 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfb7cf96e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174215:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b831d539 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfb7cf96e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174229:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33acf77f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174239:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33acf77f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174245:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33acf77f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174249:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174252:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33acf77f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174257:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33acf77f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174264:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x33acf77f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174271:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280e00/0xdb7edb52b831d54e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x33acf77f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174285:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b831d563 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcee160f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174291:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b831d563 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcee160f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174296:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b831d563 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcee160f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174301:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174303:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b831d563 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcee160f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174309:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b831d563 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcee160f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174318:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b831d563 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcee160f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174325:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b831d563 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcee160f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788572217.174337:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2066 count 1 00010000:00010000:3.0:1788572217.174339:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4000/0xdb7edb52b831d578 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1de3733b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174344:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4000/0xdb7edb52b831d578 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1de3733b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174349:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4000/0xdb7edb52b831d578 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1de3733b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174354:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174356:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4000/0xdb7edb52b831d578 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1de3733b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174362:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4000/0xdb7edb52b831d578 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1de3733b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174369:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4000/0xdb7edb52b831d578 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1de3733b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174374:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4000/0xdb7edb52b831d578 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1de3733b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174391:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5200/0xdb7edb52b831d58d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x31dd760 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174397:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5200/0xdb7edb52b831d58d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x31dd760 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174402:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5200/0xdb7edb52b831d58d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x31dd760 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174407:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174410:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5200/0xdb7edb52b831d58d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x31dd760 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174415:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5200/0xdb7edb52b831d58d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x31dd760 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.174417:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638892032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1150us (1899us total) trans 0 rc -2/-2 00010000:00010000:3.0:1788572217.174423:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5200/0xdb7edb52b831d58d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x31dd760 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.174425:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00010000:00010000:3.0:1788572217.174429:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5200/0xdb7edb52b831d58d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x31dd760 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174442:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790200/0xdb7edb52b831d5a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb6b34b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.174443:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00010000:00010000:3.0:1788572217.174448:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790200/0xdb7edb52b831d5a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb6b34b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.174451:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638892544:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.174454:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790200/0xdb7edb52b831d5a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb6b34b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174462:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637790200 already unused, calling callback (ffffffffc17dd4f0) 00002000:00080000:0.0:1788572217.174463:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2070 count 1 00010000:00010000:3.0:1788572217.174466:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790200/0xdb7edb52b831d5a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb6b34b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174471:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790200/0xdb7edb52b831d5a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbb6b34b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174480:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790200/0xdb7edb52b831d5a2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb6b34b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174485:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637790200/0xdb7edb52b831d5a2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbb6b34b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.174499:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638892544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50us (1943us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.174505:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00010000:00010000:3.0:1788572217.174511:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174518:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174523:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174528:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174531:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174537:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174546:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174551:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a600/0xdb7edb52b831d5b7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbbdc1982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174567:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174572:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174578:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174583:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174586:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174592:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174599:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174605:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280400/0xdb7edb52b831d5cc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x884d76d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174619:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174626:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174635:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174640:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174642:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174649:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174666:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174672:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280000/0xdb7edb52b831d5e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3b86e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174688:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe762a891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174695:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe762a891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174702:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe762a891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174707:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174709:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe762a891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174714:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe762a891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174722:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe762a891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174727:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281600/0xdb7edb52b831d5f6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe762a891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174738:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174741:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174745:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174748:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174750:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174753:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174758:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174761:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b831d60b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd8690d5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174772:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b831d620 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe0c7bc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174778:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b831d620 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe0c7bc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174781:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b831d620 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe0c7bc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174784:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174787:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b831d620 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe0c7bc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174792:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b831d620 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe0c7bc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174799:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b831d620 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe0c7bc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174804:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b831d620 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe0c7bc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174819:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b831d635 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1472f4e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174824:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b831d635 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1472f4e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174830:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b831d635 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1472f4e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174836:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174838:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b831d635 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1472f4e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174845:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b831d635 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1472f4e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174851:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b831d635 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1472f4e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174855:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b831d635 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1472f4e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174868:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x29288f59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174872:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x29288f59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174876:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x29288f59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174879:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174880:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x29288f59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174883:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x29288f59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174887:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x29288f59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174890:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7a00/0xdb7edb52b831d64a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x29288f59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174903:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262f37e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174909:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262f37e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174914:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262f37e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174918:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145b400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174921:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262f37e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174926:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262f37e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174933:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6262f37e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174939:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b400/0xdb7edb52b831d65f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6262f37e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174955:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174959:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174963:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174969:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145b200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.174970:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174974:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174979:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174982:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145b200/0xdb7edb52b831d674 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdc86f0d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174990:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174994:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.174997:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175000:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175001:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175027:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175035:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175041:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281800/0xdb7edb52b831d689 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x60143ae0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175057:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175063:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175069:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175074:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175077:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175082:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175091:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175096:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7e00/0xdb7edb52b831d69e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9a5b0335 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175109:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b831d6b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9157c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175113:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b831d6b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9157c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175119:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b831d6b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9157c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175123:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175124:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b831d6b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9157c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175128:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b831d6b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9157c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175132:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b831d6b3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9157c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175135:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b831d6b3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9157c5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175144:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b831d6c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66964af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175147:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b831d6c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66964af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175150:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b831d6c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66964af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175154:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175155:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b831d6c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66964af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175158:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b831d6c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb66964af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175163:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b831d6c8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb66964af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175167:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b831d6c8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb66964af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175176:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175179:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175182:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175185:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175187:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175190:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175194:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175197:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280800/0xdb7edb52b831d6dd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x13f7a97c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175205:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b831d6f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95197e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175211:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b831d6f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95197e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175215:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b831d6f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95197e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175217:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175219:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b831d6f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95197e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175222:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b831d6f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x95197e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175226:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b831d6f2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x95197e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175229:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b831d6f2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x95197e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175238:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7081106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175241:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7081106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175244:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7081106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175246:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175248:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7081106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175252:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7081106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175257:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb7081106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175260:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280a00/0xdb7edb52b831d707 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb7081106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175267:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175271:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175276:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175280:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175283:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175289:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175295:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175301:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b831d71c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc5549f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175320:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d731 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeee30383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175327:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d731 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeee30383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175332:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d731 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeee30383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175335:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175337:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d731 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeee30383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175340:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d731 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeee30383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175346:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d731 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeee30383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175350:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b831d731 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeee30383 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175359:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b831d746 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4eb300d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175363:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b831d746 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4eb300d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175366:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b831d746 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4eb300d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175372:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14ba00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175373:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b831d746 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4eb300d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175376:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b831d746 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4eb300d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175380:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b831d746 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4eb300d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175383:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b831d746 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4eb300d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175393:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175396:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175778:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175783:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175796:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175802:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175811:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175817:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281e00/0xdb7edb52b831d75b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x14f145a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175839:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175846:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175852:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175857:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175860:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175866:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175874:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175880:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a800/0xdb7edb52b831d770 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2fbea2fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175896:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175915:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175925:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175931:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175933:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175939:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175947:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175952:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281200/0xdb7edb52b831d785 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd34c0c5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175969:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175975:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175981:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175985:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.175988:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.175993:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176049:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176062:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7400/0xdb7edb52b831d79a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x509ff4b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176079:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x842e3981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176085:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x842e3981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176090:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x842e3981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176095:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145a400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.176098:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x842e3981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176105:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x842e3981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176113:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x842e3981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176118:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145a400/0xdb7edb52b831d7af lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x842e3981 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176148:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176157:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176162:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176167:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600030000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.176170:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176175:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176183:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.176189:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030000/0xdb7edb52b831d7c4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5b6537a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.176763:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.176849:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638892800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.176911:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.176955:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638892288 00000100:00100000:0.0:1788572217.176963:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638892288 00000100:00100000:0.0:1788572217.176999:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638892800 00000100:00100000:0.0:1788572217.177018:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638892800 00000100:00100000:0.0:1788572217.177039:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:0.0:1788572217.177047:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638892288:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.177419:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177429:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177436:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177441:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.177445:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177454:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177466:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177472:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7800/0xdb7edb52b831d7d9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa5eea10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177489:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177495:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177500:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177505:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.177508:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177513:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177521:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177526:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6200/0xdb7edb52b831d7ee lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe83d4e62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177546:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7577b287 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177552:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7577b287 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177558:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7577b287 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177563:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.177566:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7577b287 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177572:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7577b287 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177580:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7577b287 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177587:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6000/0xdb7edb52b831d803 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7577b287 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177604:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177610:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177616:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177625:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.177628:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177634:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177642:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177649:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6400/0xdb7edb52b831d818 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3c50fdc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177693:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x125754a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177700:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x125754a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177706:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x125754a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177711:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.177714:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x125754a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177721:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x125754a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177730:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x125754a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177737:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6e00/0xdb7edb52b831d82d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x125754a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177756:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24a751fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177763:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24a751fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177769:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24a751fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177774:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.177777:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24a751fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177795:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24a751fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177805:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24a751fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177810:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281a00/0xdb7edb52b831d842 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24a751fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177830:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177837:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177848:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177854:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.177856:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177862:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177871:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177877:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031c00/0xdb7edb52b831d857 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xade0bb63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177891:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177898:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177904:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177909:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.177912:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177919:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177928:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177934:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6c00/0xdb7edb52b831d86c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x73b203b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177950:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3ac00/0xdb7edb52b831d881 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1944885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177957:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3ac00/0xdb7edb52b831d881 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1944885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177963:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3ac00/0xdb7edb52b831d881 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1944885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177969:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ae3ac00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.177972:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3ac00/0xdb7edb52b831d881 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1944885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177978:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3ac00/0xdb7edb52b831d881 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc1944885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177986:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3ac00/0xdb7edb52b831d881 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc1944885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.177991:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ae3ac00/0xdb7edb52b831d881 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc1944885 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178046:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5200/0xdb7edb52b831d896 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x98c0c6aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178071:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5200/0xdb7edb52b831d896 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x98c0c6aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178077:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5200/0xdb7edb52b831d896 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x98c0c6aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178082:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e5200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.178085:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5200/0xdb7edb52b831d896 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x98c0c6aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178091:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5200/0xdb7edb52b831d896 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x98c0c6aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178101:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5200/0xdb7edb52b831d896 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x98c0c6aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178108:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5200/0xdb7edb52b831d896 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x98c0c6aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178126:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178133:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178138:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178144:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600030c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.178147:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178153:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178162:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178168:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030c00/0xdb7edb52b831d8ab lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1ec2500f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178185:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178191:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.178197:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.178415:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00000100:00100000:1.0:1788572217.178432:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638892800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.178465:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2072 count 1 00000100:00100000:1.0:1788572217.178589:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638892800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 165us (1675us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.178596:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00000004:00080000:1.0:1788572217.178644:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637597b80, transno 0 00000004:00080000:1.0:1788572217.178664:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637597b80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.178678:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638892800:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.178911:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2068 count 1 00000100:00100000:0.0:1788572217.178969:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638892288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1921us (2207us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.178976:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:0.0:1788572217.179035:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.179082:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638891392:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.179117:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.179138:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638891904:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.179158:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.179183:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638892416:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.179518:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637796a00, transno 0 00000004:00080000:1.0:1788572217.179524:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637796a00/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.179533:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638892288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.179609:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572217.179617:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638893184:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.179859:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.179916:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638890880 00000100:00100000:2.0:1788572217.179923:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638890880 00010000:00010000:3.0:1788572217.179923:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.179929:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.179938:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.179939:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638891392 00000100:00100000:2.0:1788572217.179942:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638891392 00010000:00010000:3.0:1788572217.179953:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.179961:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281000/0xdb7edb52b831d8c0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa2fd3d12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.179971:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638891904 00000100:00100000:2.0:1788572217.179973:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638891904 00000100:00100000:2.0:1788572217.179987:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638892416 00000100:00100000:2.0:1788572217.179990:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638892416 00010000:00010000:3.0:1788572217.179992:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5600/0xdb7edb52b831d8d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9063c677 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.179999:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5600/0xdb7edb52b831d8d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9063c677 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.180017:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641 00010000:00010000:3.0:1788572217.180018:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5600/0xdb7edb52b831d8d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9063c677 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180023:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e5600 already unused, calling callback (ffffffffc17dd4f0) 00000100:00100000:2.0:1788572217.180025:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638891392:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.180027:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5600/0xdb7edb52b831d8d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9063c677 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180033:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5600/0xdb7edb52b831d8d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9063c677 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180041:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5600/0xdb7edb52b831d8d5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9063c677 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572217.180045:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2070 count 1 00010000:00010000:3.0:1788572217.180046:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5600/0xdb7edb52b831d8d5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9063c677 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180065:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4a00/0xdb7edb52b831d8ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91aaa3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180071:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4a00/0xdb7edb52b831d8ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91aaa3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180076:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4a00/0xdb7edb52b831d8ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91aaa3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180085:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e4a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.180088:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4a00/0xdb7edb52b831d8ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91aaa3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180093:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4a00/0xdb7edb52b831d8ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91aaa3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180100:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4a00/0xdb7edb52b831d8ea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91aaa3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180105:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4a00/0xdb7edb52b831d8ea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91aaa3cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572217.180157:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.180188:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638893184 00000100:00100000:1.0:1788572217.180192:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638893184 00000100:00100000:1.0:1788572217.180229:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:1.0:1788572217.180236:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638891904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.180248:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2074 count 1 00000100:00100000:1.0:1788572217.180306:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638891904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 70us (1145us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.180313:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00100000:1.0:1788572217.180328:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:1.0:1788572217.180335:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638892416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.180349:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2069 count 1 00000100:00100000:1.0:1788572217.180394:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638892416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 61us (536us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.180400:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:1.0:1788572217.180410:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00100000:1.0:1788572217.180416:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638893184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.180427:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2075 count 1 00000100:00100000:1.0:1788572217.180469:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638893184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (312us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.180475:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000004:00080000:1.0:1788572217.180505:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 0 00000004:00080000:1.0:1788572217.180510:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11f80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.180519:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638893184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.180596:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638893312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.180620:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.180644:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638893312 00000100:00100000:1.0:1788572217.180647:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638893312 00000100:00100000:1.0:1788572217.180685:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:1.0:1788572217.180691:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638893312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.180704:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2076 count 1 00000100:00100000:1.0:1788572217.180750:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638893312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 59us (129us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.180755:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000004:00080000:1.0:1788572217.180774:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 0 00000004:00080000:1.0:1788572217.180778:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11f80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.180784:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638893312:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.180978:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4e00/0xdb7edb52b831d8ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc538e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180987:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4e00/0xdb7edb52b831d8ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc538e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180993:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4e00/0xdb7edb52b831d8ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc538e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.180998:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e4e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181022:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4e00/0xdb7edb52b831d8ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc538e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181030:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4e00/0xdb7edb52b831d8ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc538e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181040:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4e00/0xdb7edb52b831d8ff lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc538e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181046:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4e00/0xdb7edb52b831d8ff lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc538e899 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181065:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x880645ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181072:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x880645ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181078:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x880645ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181082:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181085:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x880645ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181091:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x880645ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181098:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x880645ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181104:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280600/0xdb7edb52b831d914 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x880645ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181122:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181128:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181275:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181282:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637696e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181285:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181292:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181302:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181308:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696e00/0xdb7edb52b831d929 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8234a13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181327:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e489268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181333:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e489268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181339:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e489268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181344:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181347:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e489268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181353:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e489268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181362:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6e489268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181368:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973a00/0xdb7edb52b831d93e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6e489268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181384:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x725dc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181391:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x725dc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181397:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x725dc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181402:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600030400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181406:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x725dc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181412:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x725dc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181420:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x725dc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181426:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030400/0xdb7edb52b831d953 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x725dc75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181443:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181454:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181460:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181466:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181469:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181478:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181486:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181491:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031000/0xdb7edb52b831d968 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x74fcda9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181505:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2719debf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181511:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2719debf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181516:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2719debf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181521:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600030600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181524:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2719debf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181530:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2719debf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181538:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2719debf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181544:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030600/0xdb7edb52b831d97d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2719debf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181559:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181564:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181570:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181575:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181578:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181584:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181592:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181598:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031600/0xdb7edb52b831d992 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa5857e01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181620:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4000/0xdb7edb52b831d9a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb15ee766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181627:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4000/0xdb7edb52b831d9a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb15ee766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181633:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4000/0xdb7edb52b831d9a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb15ee766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181638:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e4000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181641:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4000/0xdb7edb52b831d9a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb15ee766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181646:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4000/0xdb7edb52b831d9a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb15ee766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181668:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4000/0xdb7edb52b831d9a7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb15ee766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181675:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4000/0xdb7edb52b831d9a7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb15ee766 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181688:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5800/0xdb7edb52b831d9bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93ac44bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181694:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5800/0xdb7edb52b831d9bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93ac44bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181700:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5800/0xdb7edb52b831d9bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93ac44bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181708:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e5800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181710:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5800/0xdb7edb52b831d9bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93ac44bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181716:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5800/0xdb7edb52b831d9bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93ac44bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181723:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5800/0xdb7edb52b831d9bc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x93ac44bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181729:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5800/0xdb7edb52b831d9bc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x93ac44bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181744:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x556d2988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181750:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x556d2988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181756:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x556d2988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181761:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600030200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181763:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x556d2988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181770:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x556d2988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181776:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x556d2988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181782:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600030200/0xdb7edb52b831d9d1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x556d2988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181815:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x608e86dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181821:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x608e86dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181827:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x608e86dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181832:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181835:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x608e86dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181840:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x608e86dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181848:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x608e86dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181853:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b831d9e6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x608e86dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181867:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181874:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181883:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181888:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181890:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181896:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181903:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181909:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b831d9fb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6b28eb02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181922:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181928:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181933:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181938:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181940:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181945:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181952:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181957:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972600/0xdb7edb52b831da10 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x30fa3357 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181968:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4800/0xdb7edb52b831da25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0aa1d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181973:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4800/0xdb7edb52b831da25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0aa1d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181979:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4800/0xdb7edb52b831da25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0aa1d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181984:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.181986:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4800/0xdb7edb52b831da25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0aa1d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181992:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4800/0xdb7edb52b831da25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0aa1d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.181998:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4800/0xdb7edb52b831da25 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb0aa1d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182028:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4800/0xdb7edb52b831da25 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb0aa1d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182045:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4600/0xdb7edb52b831da3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3b701b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182054:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4600/0xdb7edb52b831da3a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3b701b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182060:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4600/0xdb7edb52b831da3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3b701b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182065:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e4600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.182068:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4600/0xdb7edb52b831da3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3b701b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182074:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4600/0xdb7edb52b831da3a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3b701b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182081:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4600/0xdb7edb52b831da3a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3b701b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182087:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4600/0xdb7edb52b831da3a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3b701b89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182102:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeea984ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182108:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeea984ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182114:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeea984ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182119:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.182122:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeea984ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182127:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeea984ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182134:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeea984ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182140:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972a00/0xdb7edb52b831da4f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeea984ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182153:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5e00/0xdb7edb52b831da64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7191f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182159:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5e00/0xdb7edb52b831da64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7191f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182164:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5e00/0xdb7edb52b831da64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7191f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182169:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e5e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.182172:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5e00/0xdb7edb52b831da64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7191f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182178:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5e00/0xdb7edb52b831da64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7191f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182186:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5e00/0xdb7edb52b831da64 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7191f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182192:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5e00/0xdb7edb52b831da64 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7191f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182459:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5000/0xdb7edb52b831da79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc2d80b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182466:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5000/0xdb7edb52b831da79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc2d80b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182471:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5000/0xdb7edb52b831da79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc2d80b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182475:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e5000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.182478:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5000/0xdb7edb52b831da79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc2d80b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182483:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5000/0xdb7edb52b831da79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc2d80b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182491:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5000/0xdb7edb52b831da79 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc2d80b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182496:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5000/0xdb7edb52b831da79 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc2d80b16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182509:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30a9536b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182514:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30a9536b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182518:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30a9536b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182526:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.182529:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30a9536b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182533:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30a9536b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182539:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x30a9536b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182544:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b831da8e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x30a9536b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182558:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32593d78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182563:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32593d78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182569:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32593d78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182574:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.182576:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32593d78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182581:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32593d78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182587:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x32593d78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182593:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b831daa3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x32593d78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182606:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182611:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182617:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182621:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.182624:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182629:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182636:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182641:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973200/0xdb7edb52b831dab8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe57a9acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182683:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4400/0xdb7edb52b831dacd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc614fef2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182689:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4400/0xdb7edb52b831dacd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc614fef2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182699:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4400/0xdb7edb52b831dacd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc614fef2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182704:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e4400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.182707:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4400/0xdb7edb52b831dacd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc614fef2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182713:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4400/0xdb7edb52b831dacd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc614fef2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182721:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4400/0xdb7edb52b831dacd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc614fef2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182726:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4400/0xdb7edb52b831dacd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc614fef2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182743:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182749:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182754:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182758:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.182761:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182766:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182774:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182780:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b831dae2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4ddbc747 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182861:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x98234114 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182867:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x98234114 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182873:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x98234114 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182877:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.182879:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x98234114 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182884:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x98234114 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182892:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x98234114 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182956:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973800/0xdb7edb52b831daf7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x98234114 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182973:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5a00/0xdb7edb52b831db0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9466af79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182983:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5a00/0xdb7edb52b831db0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9466af79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182988:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5a00/0xdb7edb52b831db0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9466af79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.182993:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e5a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.182995:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5a00/0xdb7edb52b831db0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9466af79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.183001:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5a00/0xdb7edb52b831db0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9466af79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.183041:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5a00/0xdb7edb52b831db0c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9466af79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.183047:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5a00/0xdb7edb52b831db0c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9466af79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.183761:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b01139e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.183771:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b01139e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184598:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b01139e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184608:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.184611:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b01139e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184619:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b01139e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184633:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4b01139e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184639:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b831db21 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4b01139e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184673:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184680:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184685:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184689:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.184692:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184697:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184704:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184709:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b831db36 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xaf9c01ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184753:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96796b54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184759:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96796b54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184766:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96796b54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184770:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.184773:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96796b54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184779:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96796b54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184837:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x96796b54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184842:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972200/0xdb7edb52b831db4b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x96796b54 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184855:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x744968a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184859:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x744968a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184863:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x744968a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184869:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.184871:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x744968a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184874:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x744968a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184878:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x744968a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184881:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b831db60 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x744968a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184891:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.184894:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185060:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185066:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185069:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185076:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185085:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185092:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973e00/0xdb7edb52b831db75 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfbd7ad76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185109:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54af8acb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185115:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54af8acb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185121:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54af8acb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185126:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185129:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54af8acb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185135:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x54af8acb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185143:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x54af8acb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185148:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b831db8a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x54af8acb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185163:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185170:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185179:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185184:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185186:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185191:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.185198:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638891392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5169us (6076us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.185210:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641 00000100:00100000:2.0:1788572217.185345:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638893056:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.185378:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b2680, transno 0 00000004:00080000:0.0:1788572217.185386:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a9b2680/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.185392:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572217.185428:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637597100, transno 0 00000004:00080000:2.0:1788572217.185431:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637597100/1, rc -2, transno 0 00010000:00010000:3.0:1788572217.185460:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185468:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031800/0xdb7edb52b831db9f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfb9deef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185498:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185504:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185510:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185514:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185516:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185522:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185531:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185536:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7200/0xdb7edb52b831dbb4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8f1d745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185551:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5400/0xdb7edb52b831dbc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9fac3112 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185556:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5400/0xdb7edb52b831dbc9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9fac3112 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185561:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5400/0xdb7edb52b831dbc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9fac3112 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185566:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e5400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185568:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5400/0xdb7edb52b831dbc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9fac3112 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185573:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5400/0xdb7edb52b831dbc9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9fac3112 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185579:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5400/0xdb7edb52b831dbc9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9fac3112 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185584:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e5400/0xdb7edb52b831dbc9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9fac3112 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185597:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185606:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185612:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185616:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185618:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185623:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185629:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185633:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6a00/0xdb7edb52b831dbde lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9b911f77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185644:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185661:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185666:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185670:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185672:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185678:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185685:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185690:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7c00/0xdb7edb52b831dbf3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6c7f839c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185702:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8095535a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185708:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8095535a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185713:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8095535a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185717:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185719:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8095535a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185724:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8095535a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185729:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8095535a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185734:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8c00/0xdb7edb52b831dc08 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8095535a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185749:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185754:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185759:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185763:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a6600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185765:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185770:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185776:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185781:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a6600/0xdb7edb52b831dc1d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd6eabd67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185802:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185807:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185811:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185819:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e600031200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185822:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185827:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185833:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185838:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e600031200/0xdb7edb52b831dc32 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcb1a85bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185849:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185854:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185859:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185864:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64145aa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185866:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185871:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185877:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185883:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64145aa00/0xdb7edb52b831dc47 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e54e9e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185895:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185906:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185911:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185916:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185919:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185924:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185930:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185934:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b831dc5c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x40a4e736 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185946:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185951:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185960:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185965:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.185968:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185974:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185982:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185985:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b831dc71 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9d932c03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.185996:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7848958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186000:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7848958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186025:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7848958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186031:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e7a7000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186033:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7848958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186037:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7848958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186043:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7848958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186047:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e7a7000/0xdb7edb52b831dc86 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7848958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186073:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186079:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186085:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186089:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186092:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186098:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186107:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186113:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9c00/0xdb7edb52b831dc9b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x90bdf2bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186128:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186139:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186145:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186149:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186152:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186158:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186166:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186171:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8200/0xdb7edb52b831dcb0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe403dbe2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186183:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe474c0af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186186:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe474c0af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186190:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe474c0af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186193:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186194:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe474c0af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186257:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe474c0af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186320:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe474c0af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186326:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9a00/0xdb7edb52b831dcc5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe474c0af bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186339:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186343:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186346:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186349:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186351:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186354:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186359:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186362:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9e00/0xdb7edb52b831dcda lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6f3130a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186375:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186378:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186382:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186384:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186386:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186389:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186393:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186396:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9200/0xdb7edb52b831dcef lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x55eb8a75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186405:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186408:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186411:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186416:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186418:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186421:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186425:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186428:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9000/0xdb7edb52b831dd04 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc3bcd2ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186435:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186438:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186441:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186444:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186445:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186448:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186452:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186456:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9800/0xdb7edb52b831dd19 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe8cdd6ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186464:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186467:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186470:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186473:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186474:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186477:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186481:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186484:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8a00/0xdb7edb52b831dd2e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab9b3444 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186491:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c897911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186494:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c897911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186500:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c897911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186503:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186504:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c897911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186507:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c897911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186511:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5c897911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186514:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8e00/0xdb7edb52b831dd43 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5c897911 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186522:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186525:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186528:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186531:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186532:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186535:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186540:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186543:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8800/0xdb7edb52b831dd58 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x96d6d666 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186551:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186554:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186557:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186560:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186562:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186565:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186568:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186571:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973400/0xdb7edb52b831dd6d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2136dfcb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186591:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186597:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186601:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186604:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186605:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186608:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186613:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186616:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8600/0xdb7edb52b831dd82 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd891c8f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186624:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186627:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186630:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186633:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186635:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186639:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186643:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186646:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5200/0xdb7edb52b831dd97 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5c1f12fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186668:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34a5458 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186675:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34a5458 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186680:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34a5458 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186688:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186690:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34a5458 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186697:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34a5458 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186708:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34a5458 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186714:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4a00/0xdb7edb52b831ddac lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34a5458 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186733:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8389925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186739:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8389925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186744:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8389925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.186749:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638892544:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.186750:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186753:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8389925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186758:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8389925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186765:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8389925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186770:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b831ddc1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8389925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.186772:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b0a80, transno 0 00000004:00080000:2.0:1788572217.186776:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a9b0a80/1, rc -2, transno 0 00010000:00010000:3.0:1788572217.186784:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce09e17a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.186790:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638891008:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.186790:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce09e17a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186796:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce09e17a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.186799:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637794000, transno 0 00000004:00080000:2.0:1788572217.186801:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637794000/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.186805:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638891520:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.186806:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186809:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce09e17a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.186813:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637795f80, transno 0 00000004:00080000:2.0:1788572217.186815:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637795f80/1, rc -2, transno 0 00010000:00010000:3.0:1788572217.186815:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xce09e17a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.186819:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638892032:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.186822:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xce09e17a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186828:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5400/0xdb7edb52b831ddd6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xce09e17a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.186833:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788572217.186841:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.186842:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638893440:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.186847:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186852:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186857:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186860:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186866:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186873:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186879:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4400/0xdb7edb52b831ddeb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x43b9eadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.186885:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572217.186892:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6874834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186897:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6874834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186903:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6874834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186908:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186910:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6874834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186916:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6874834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186923:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6874834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.186927:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638893056 00010000:00010000:3.0:1788572217.186929:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5600/0xdb7edb52b831de00 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6874834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.186934:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638893056 00010000:00010000:3.0:1788572217.186943:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186949:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186957:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186961:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.186964:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186970:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.186974:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638893440 00000100:00100000:2.0:1788572217.186977:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638893440 00010000:00010000:3.0:1788572217.186977:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.186983:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4800/0xdb7edb52b831de15 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6e458d01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.186993:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646 00010000:00010000:3.0:1788572217.186997:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.187001:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638893056:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.187017:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187022:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187027:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.187029:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187035:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187043:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187048:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4c00/0xdb7edb52b831de2a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc71d6a56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572217.187054:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2074 count 1 00000100:00100000:2.0:1788572217.187176:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638893056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 174us (1782us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.187182:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646 00000100:00100000:2.0:1788572217.187197:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647 00000100:00100000:2.0:1788572217.187203:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638893440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.187214:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2077 count 1 00000100:00100000:2.0:1788572217.187267:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638893440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 63us (381us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.187274:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647 00000100:00100000:2.0:1788572217.187450:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572217.187460:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638893696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.187486:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572217.187517:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187526:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187532:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.187536:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638893568:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.187538:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.187542:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187549:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.187556:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572217.187559:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187565:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5a00/0xdb7edb52b831de3f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd383ee7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.187580:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 0 00010000:00010000:3.0:1788572217.187583:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.187584:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11f80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.187589:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638893440:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.187594:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.187596:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10000, transno 0 00000004:00080000:2.0:1788572217.187599:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10000/1, rc -2, transno 0 00010000:00010000:3.0:1788572217.187601:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.187603:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638893056:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.187607:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14a200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.187609:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187615:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187623:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187629:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14a200/0xdb7edb52b831de54 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8b735ce0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187649:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187664:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187669:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187673:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.187676:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187682:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187690:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187695:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9600/0xdb7edb52b831de69 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe861a1ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187708:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5341837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187715:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5341837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187720:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5341837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187725:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.187727:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5341837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187732:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5341837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187739:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe5341837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187744:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12800/0xdb7edb52b831de7e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe5341837 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187763:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4c00/0xdb7edb52b831de93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44656244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187769:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4c00/0xdb7edb52b831de93 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44656244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187774:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4c00/0xdb7edb52b831de93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44656244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187778:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6376e4c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.187780:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4c00/0xdb7edb52b831de93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44656244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187847:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4c00/0xdb7edb52b831de93 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44656244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187856:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4c00/0xdb7edb52b831de93 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44656244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187863:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6376e4c00/0xdb7edb52b831de93 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44656244 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187883:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728600/0xdb7edb52b831dea8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1b94a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187888:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728600/0xdb7edb52b831dea8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1b94a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187951:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728600/0xdb7edb52b831dea8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1b94a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187962:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.187965:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728600/0xdb7edb52b831dea8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1b94a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187971:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728600/0xdb7edb52b831dea8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1b94a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187980:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728600/0xdb7edb52b831dea8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1b94a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.187986:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728600/0xdb7edb52b831dea8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1b94a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188026:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729200/0xdb7edb52b831debd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3af3aebe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188034:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729200/0xdb7edb52b831debd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3af3aebe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188039:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729200/0xdb7edb52b831debd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3af3aebe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188044:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.188048:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729200/0xdb7edb52b831debd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3af3aebe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188053:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729200/0xdb7edb52b831debd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3af3aebe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188061:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729200/0xdb7edb52b831debd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3af3aebe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188068:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729200/0xdb7edb52b831debd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3af3aebe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188083:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188089:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188094:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188099:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.188102:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188107:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188114:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188118:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4e00/0xdb7edb52b831ded2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x80a8c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188131:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188137:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188146:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188151:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.188154:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188160:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188168:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188174:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4200/0xdb7edb52b831dee7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x99c8d0e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188189:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728800/0xdb7edb52b831defc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xac18ce35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188195:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728800/0xdb7edb52b831defc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xac18ce35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188213:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638893696 00000100:00100000:2.0:1788572217.188218:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638893696 00000100:00100000:2.0:1788572217.188252:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638893568 00000100:00100000:2.0:1788572217.188255:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638893568 00000100:00100000:2.0:1788572217.188274:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648 00000100:00100000:2.0:1788572217.188282:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638893696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.188298:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2076 count 1 00010000:00010000:3.0:1788572217.188342:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728800/0xdb7edb52b831defc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xac18ce35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188348:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.188351:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728800/0xdb7edb52b831defc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xac18ce35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188358:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728800/0xdb7edb52b831defc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xac18ce35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188367:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728800/0xdb7edb52b831defc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xac18ce35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188372:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638893696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 92us (885us total) trans 0 rc -2/-2 00010000:00010000:3.0:1788572217.188374:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728800/0xdb7edb52b831defc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xac18ce35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188379:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648 00010000:00010000:3.0:1788572217.188389:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe152379a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188392:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649 00010000:00010000:3.0:1788572217.188396:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe152379a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188398:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638893568:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.188403:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe152379a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188407:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4600 already unused, calling callback (ffffffffc17dd4f0) 00002000:00080000:2.0:1788572217.188409:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2075 count 1 00010000:00010000:3.0:1788572217.188410:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe152379a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188416:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe152379a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188423:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe152379a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188429:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca4600/0xdb7edb52b831df11 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe152379a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188443:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188449:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638893568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52us (891us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.188455:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649 00010000:00010000:3.0:1788572217.188455:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188461:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188465:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f8000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.188468:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188474:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188481:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188487:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f8000/0xdb7edb52b831df26 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4ad20bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.188491:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c380, transno 0 00000004:00080000:2.0:1788572217.188495:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2c380/1, rc -2, transno 0 00010000:00010000:3.0:1788572217.188500:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729600/0xdb7edb52b831df3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9ef658c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188504:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638893696:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.188507:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729600/0xdb7edb52b831df3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9ef658c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188512:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729600/0xdb7edb52b831df3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9ef658c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188517:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.188520:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729600/0xdb7edb52b831df3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9ef658c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188526:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729600/0xdb7edb52b831df3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf9ef658c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188534:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729600/0xdb7edb52b831df3b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9ef658c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188539:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729600/0xdb7edb52b831df3b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf9ef658c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188551:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728000/0xdb7edb52b831df50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf304283c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188557:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728000/0xdb7edb52b831df50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf304283c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188562:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728000/0xdb7edb52b831df50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf304283c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188566:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.188569:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728000/0xdb7edb52b831df50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf304283c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188574:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728000/0xdb7edb52b831df50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf304283c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188582:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728000/0xdb7edb52b831df50 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf304283c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188588:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728000/0xdb7edb52b831df50 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf304283c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188590:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638893824:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.188606:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188612:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188615:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572217.188618:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188624:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.188626:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188632:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188639:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638893824 00010000:00010000:3.0:1788572217.188640:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188642:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638893824 00010000:00010000:3.0:1788572217.188646:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5e00/0xdb7edb52b831df65 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa3f26d09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188677:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6146555e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188678:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:2.0:1788572217.188684:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638893824:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.188684:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6146555e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188691:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6146555e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572217.188697:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2077 count 1 00010000:00010000:3.0:1788572217.188700:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637696c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.188704:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6146555e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188710:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6146555e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188718:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6146555e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188724:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637696c00/0xdb7edb52b831df7a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6146555e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188741:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638893824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 56us (124us total) trans 0 rc -2/-2 00010000:00010000:3.0:1788572217.188741:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188747:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00010000:00010000:3.0:1788572217.188747:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188753:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188758:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.188761:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188767:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.188768:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c380, transno 0 00000004:00080000:2.0:1788572217.188771:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2c380/1, rc -2, transno 0 00010000:00010000:3.0:1788572217.188776:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188778:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638893824:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.188782:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5800/0xdb7edb52b831df8f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x971fbec3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572217.188835:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f100, transno 0 00000004:00080000:2.0:1788572217.188839:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2f100/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.188846:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638893568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.188853:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572217.188857:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638893952:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.188878:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188880:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572217.188884:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188890:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188896:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e618716400 already unused, calling callback (ffffffffc17dd4f0) 00000100:00100000:2.0:1788572217.188906:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638893952 00000100:00100000:2.0:1788572217.188909:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638893952 00000100:00100000:2.0:1788572217.188929:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:2.0:1788572217.188935:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638893952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.188949:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2078 count 1 00010000:00010000:3.0:1788572217.188968:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188977:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.188986:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.188993:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638893952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59us (113us total) trans 0 rc -2/-2 00010000:00010000:3.0:1788572217.188993:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e618716400/0xdb7edb52b831dfa4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe0f11c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572217.189000:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00010000:00010000:3.0:1788572217.189033:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728200/0xdb7edb52b831dfb9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5dff60e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189040:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728200/0xdb7edb52b831dfb9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5dff60e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189050:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728200/0xdb7edb52b831dfb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5dff60e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189055:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641728200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.189058:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728200/0xdb7edb52b831dfb9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5dff60e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189065:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728200/0xdb7edb52b831dfb9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5dff60e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189074:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728200/0xdb7edb52b831dfb9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5dff60e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189080:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641728200/0xdb7edb52b831dfb9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5dff60e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189096:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729e00/0xdb7edb52b831dfce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc84f5e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189102:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729e00/0xdb7edb52b831dfce lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc84f5e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189109:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729e00/0xdb7edb52b831dfce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc84f5e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189113:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.189116:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729e00/0xdb7edb52b831dfce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc84f5e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189122:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729e00/0xdb7edb52b831dfce lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc84f5e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189131:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729e00/0xdb7edb52b831dfce lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc84f5e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189136:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729e00/0xdb7edb52b831dfce lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc84f5e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189150:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189156:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189162:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189166:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.189169:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189174:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189181:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189186:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12400/0xdb7edb52b831dfe3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7ee9c25f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189335:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189347:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189351:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189356:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.189359:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189364:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189372:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189377:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13e00/0xdb7edb52b831dff8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8e3b0c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189396:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189402:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189407:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189412:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.189415:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189420:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189428:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189433:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729a00/0xdb7edb52b831e00d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8af5f591 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189449:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe163740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189455:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe163740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189461:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe163740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189466:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.189469:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe163740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189475:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe163740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189483:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe163740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189489:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b13000/0xdb7edb52b831e022 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe163740 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189507:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189514:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189520:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189524:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.189527:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189533:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189542:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189548:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12600/0xdb7edb52b831e037 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe8871c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189563:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189568:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189574:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189581:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641729400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.189583:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189588:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189596:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189601:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641729400/0xdb7edb52b831e04c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9eac6462 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189616:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189631:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189637:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189642:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572217.189644:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.189646:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638892416:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.189658:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.189665:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638892928:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.189666:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.189672:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12c00/0xdb7edb52b831e061 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe85cdc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 112013 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572217.189698:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572217.189741:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641694e00, transno 0 00000004:00080000:0.0:1788572217.189746:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641694e00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.189750:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638890496:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.189759:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641694380, transno 0 00000004:00080000:0.0:1788572217.189761:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641694380/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.189764:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638890368:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.189777:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637795180, transno 0 00000100:00100000:3.0:1788572217.189778:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638892928 00000004:00080000:0.0:1788572217.189780:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637795180/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.189781:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638892928 00000100:00100000:0.0:1788572217.189783:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638891392:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.189790:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11180, transno 0 00000004:00080000:0.0:1788572217.189793:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11180/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.189796:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638891904:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.189828:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.189851:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638892672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.189873:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572217.189963:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 171 changes, 3 in progress, 3 in flight, 4 done 00000100:00100000:2.0:1788572217.190077:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638894336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.190102:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638894080:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.190208:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 172 changes, 3 in progress, 3 in flight, 5 done 00000100:00100000:3.0:1788572217.190458:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638892160 00000100:00100000:3.0:1788572217.190462:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638892160 00000004:00080000:0.0:1788572217.190483:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b0e00, transno 0 00000100:00100000:3.0:1788572217.190485:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638892672 00000100:00100000:3.0:1788572217.190487:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638892672 00000004:00080000:0.0:1788572217.190488:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a9b0e00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.190496:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638891136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.190503:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652 00000100:00100000:0.0:1788572217.190508:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638894208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.190510:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638892928:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.190530:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1788572217.190530:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2073 count 1 00000100:00100000:0.0:1788572217.190551:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638894720:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.190568:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.190582:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638895232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.190598:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.190598:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638892928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 89us (900us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.190605:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652 00000100:00100000:0.0:1788572217.190614:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572217.190618:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638894208 00000100:00100000:0.0:1788572217.190619:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638894848:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.190621:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638894208 00000100:00100000:0.0:1788572217.190636:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.190636:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638894720 00000100:00100000:3.0:1788572217.190638:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638894720 00000100:00100000:3.0:1788572217.190665:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638895232 00000100:00100000:3.0:1788572217.190668:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638895232 00000100:00100000:0.0:1788572217.190672:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638894848 00000100:00100000:0.0:1788572217.190674:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638894848 00000100:00100000:3.0:1788572217.190685:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653 00000100:00100000:3.0:1788572217.190690:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638890880:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.190696:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1788572217.190701:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638892160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.190703:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2066 count 1 00002000:00080000:0.0:1788572217.190711:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2067 count 1 00000100:00100000:0.0:1788572217.190752:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638892160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 52us (924us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.190752:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638890880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 60us (11716us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.190758:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653 00000100:00100000:0.0:1788572217.190830:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1788572217.190845:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1788572217.190851:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638892672:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.190862:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00002000:00080000:0.0:1788572217.190863:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2071 count 1 00000100:00100000:3.0:1788572217.190870:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638894208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.190880:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2080 count 1 00000100:00100000:0.0:1788572217.190904:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638892672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 54us (1029us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.190910:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1788572217.190923:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:0.0:1788572217.190929:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638894720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.190939:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2078 count 1 00000100:00100000:0.0:1788572217.190978:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638894720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49us (408us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.190984:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:3.0:1788572217.190986:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638894208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 118us (456us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.190992:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00100000:0.0:1788572217.190996:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:0.0:1788572217.191002:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638895232:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.191002:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:3.0:1788572217.191025:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638894848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.191029:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2082 count 1 00002000:00080000:3.0:1788572217.191033:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2079 count 1 00000100:00100000:2.0:1788572217.191183:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.191456:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638894336 00000100:00100000:1.0:1788572217.191461:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638894336 00000100:00100000:1.0:1788572217.191481:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:1.0:1788572217.191487:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638894336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.191498:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2081 count 1 00000100:00100000:0.0:1788572217.191564:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638895232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 562us (964us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.191569:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000004:00080000:0.0:1788572217.191611:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d500, transno 0 00000004:00080000:0.0:1788572217.191615:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d500/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.191621:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638894208:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.191628:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 0 00000004:00080000:0.0:1788572217.191630:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11f80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.191639:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638894720:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.191645:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10e00, transno 0 00000004:00080000:0.0:1788572217.191647:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10e00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.191661:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638895232:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.191671:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637794e00, transno 0 00000004:00080000:0.0:1788572217.191673:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637794e00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.191675:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638892160:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.191681:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637594a80, transno 0 00000004:00080000:0.0:1788572217.191683:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637594a80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.191686:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638892672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.191703:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638894464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.191725:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.191747:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638894976:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.191761:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572217.191774:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc45880, transno 0 00000004:00080000:0.0:1788572217.191777:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc45880/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.191780:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638890880:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.191786:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637594e00, transno 0 00000004:00080000:0.0:1788572217.191787:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637594e00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.191791:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638892928:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.191800:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572217.191804:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638895104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.191825:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.191845:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638894464 00000100:00100000:0.0:1788572217.191848:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638894464 00000100:00100000:0.0:1788572217.191884:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638894976 00000100:00100000:0.0:1788572217.191887:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638894976 00000100:00100000:0.0:1788572217.191898:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638895104 00000100:00100000:0.0:1788572217.191900:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638895104 00000100:00100000:0.0:1788572217.191912:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:0.0:1788572217.191918:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638894464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.191930:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2082 count 1 00000100:00100000:3.0:1788572217.191995:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638894848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 970us (1357us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.192020:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:2.0:1788572217.192026:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:2.0:1788572217.192034:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638894976:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.192034:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:3.0:1788572217.192039:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638895104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.192046:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2080 count 1 00002000:00080000:3.0:1788572217.192048:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2081 count 1 00000100:00100000:3.0:1788572217.192094:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638895104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 54us (267us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.192100:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000001:00080000:3.0:1788572217.192140:0:112013:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788572217.192182:0:112013:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788572217.192195:0:112013:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff94e6412c1f80 x1875449638886528/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:629/0 lens 224/0 e 0 to 0 dl 1788572224 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788572217.192407:0:112013:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.202.13@tcp: req@ffff94e61e637800 x1875449615202176/t0(0) o400->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:633/0 lens 224/0 e 0 to 0 dl 1788572228 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572217.192439:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788572217.192446:0:3649:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff94e63ae3d180 x1875449638886528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572229 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572217.192455:0:3649:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff94e63ae3d180 x1875449638886528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572229 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572217.192462:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788572217.192472:0:3649:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788572217.192478:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009dca05cd): req@ffff94e61e57ce00 x1875449638865024/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572192 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572217.192489:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449638886528:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788572217.192548:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638894464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 629us (821us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.192555:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00010000:02000000:3.0:1788572217.192556:0:112013:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:08, of 2 clients 2 recovered and 0 were evicted. 00000004:00080000:0.0:1788572217.192586:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10000, transno 0 00000004:00080000:0.0:1788572217.192590:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10000/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.192594:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638894848:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.192618:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572217.192667:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13100, transno 0 00000004:00080000:0.0:1788572217.192670:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13100/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.192674:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638895104:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.192682:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641694380, transno 0 00000004:00080000:0.0:1788572217.192684:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641694380/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.192688:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638894464:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.192694:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 0 00000004:00080000:0.0:1788572217.192696:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.192699:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638894976:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.192871:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 167 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:0.0:1788572217.192967:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638895744:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.192991:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.193368:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638896256:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.193390:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.193407:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788572217.193412:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638895360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.193428:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.193439:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638895872:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.193454:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.193780:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638895744 00000100:00100000:0.0:1788572217.193786:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638895744 00000100:00100000:0.0:1788572217.193816:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638896256 00000100:00100000:0.0:1788572217.193819:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638896256 00000100:00100000:0.0:1788572217.193833:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638895360 00000100:00100000:0.0:1788572217.193835:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638895360 00000100:00100000:0.0:1788572217.193848:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638895872 00000100:00100000:0.0:1788572217.193850:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638895872 00000100:00100000:0.0:1788572217.193866:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:0.0:1788572217.193873:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638895744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.193911:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2086 count 1 00000100:00100000:0.0:1788572217.193987:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638895744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 113us (994us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.193994:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:0.0:1788572217.194029:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:0.0:1788572217.194035:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638896256:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.194218:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638894336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2729us (3033us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.194227:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:1.0:1788572217.194313:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:1.0:1788572217.194321:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638895360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.194333:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2083 count 1 00000100:00100000:1.0:1788572217.194394:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638895360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 75us (965us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.194400:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:1.0:1788572217.194411:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:1.0:1788572217.194416:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638895872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.194445:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2087 count 1 00000100:00100000:1.0:1788572217.194478:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638895872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 62us (1022us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.194484:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00002000:00080000:0.0:1788572217.194585:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2090 count 1 00000100:00100000:0.0:1788572217.194645:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638896256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 611us (1253us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.194662:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000004:00080000:0.0:1788572217.194714:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a93aa00, transno 0 00000004:00080000:0.0:1788572217.194721:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a93aa00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.194832:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638894976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2798us (3068us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.194840:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:2.0:1788572217.194863:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638865024 00000100:00100000:2.0:1788572217.194867:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638865024 00000100:00100000:2.0:1788572217.194900:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:2.0:1788572217.194906:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449638865024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572217.194932:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445969920 avail 1299730432 00000100:00100000:2.0:1788572217.194967:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449638865024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572217.194973:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:2.0:1788572217.195321:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638896384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572217.195356:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572217.195400:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641694e00, transno 0 00000004:00080000:2.0:1788572217.195405:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641694e00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.195411:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638894336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.195432:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638896384 00000100:00100000:2.0:1788572217.195436:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638896384 00000100:00100000:2.0:1788572217.195460:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:2.0:1788572217.195466:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449638896384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572217.195479:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445969920 avail 1299730432 00000100:00100000:2.0:1788572217.195511:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449638896384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572217.195516:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00100000:2.0:1788572217.195551:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638896384:0@lo:41:osp-pre-0-1.0 00000004:00080000:2.0:1788572217.195674:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 166 changes, 3 in progress, 3 in flight, 5 done 00000100:00100000:2.0:1788572217.195739:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638896896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.195763:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.195785:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572217.195791:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638896768:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.195811:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.195835:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638896896 00000100:00100000:2.0:1788572217.195839:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638896896 00000100:00100000:2.0:1788572217.195867:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638896768 00000100:00100000:2.0:1788572217.195871:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638896768 00000100:00100000:2.0:1788572217.195891:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1788572217.195897:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638896896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.195911:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2087 count 1 00000100:00100000:2.0:1788572217.195972:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638896896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 75us (207us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.195980:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1788572217.195991:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:2.0:1788572217.195996:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638896768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.196026:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2086 count 1 00000100:00100000:2.0:1788572217.196146:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638896768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 150us (334us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.196152:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000004:00080000:2.0:1788572217.196179:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641694380, transno 0 00000004:00080000:2.0:1788572217.196183:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641694380/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.196190:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638896768:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.196197:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641694e00, transno 0 00000004:00080000:2.0:1788572217.196199:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641694e00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.196203:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638896896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.196354:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572217.196361:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638897280:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.196382:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.196407:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638897280 00000100:00100000:2.0:1788572217.196410:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638897280 00000100:00100000:2.0:1788572217.196431:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:2.0:1788572217.196436:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638897280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.196446:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2090 count 1 00000100:00100000:2.0:1788572217.196487:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638897280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (103us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.196493:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000004:00080000:2.0:1788572217.196511:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0700, transno 0 00000004:00080000:2.0:1788572217.196514:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412b0700/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.196520:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638897280:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.196566:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638897408:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.196586:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.196609:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638897408 00000100:00100000:2.0:1788572217.196613:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638897408 00000100:00100000:2.0:1788572217.196633:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:2.0:1788572217.196638:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638897408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.196649:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2091 count 1 00000100:00100000:2.0:1788572217.196703:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638897408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 65us (116us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.196709:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000004:00080000:2.0:1788572217.196730:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641694e00, transno 0 00000004:00080000:2.0:1788572217.196733:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641694e00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.196739:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638897408:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.196791:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.196809:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638894592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.196829:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572217.196847:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c380, transno 0 00000004:00080000:2.0:1788572217.196850:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2c380/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.196856:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638893952:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.196866:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638895616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.196885:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.196900:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638896128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.196915:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.196927:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638896640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.196941:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.196953:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638897152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.196968:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.196982:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [2->3] 00000100:00100000:2.0:1788572217.196987:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638895488:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.197025:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.197039:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638896000:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.197150:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.197169:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638896512:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.197190:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.197202:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638897024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.197219:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.197230:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638897536:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.197316:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.197345:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638894080 00000100:00100000:2.0:1788572217.197349:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638894080 00000100:00100000:2.0:1788572217.197369:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638894592 00000100:00100000:2.0:1788572217.197372:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638894592 00000100:00100000:2.0:1788572217.197382:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638895616 00000100:00100000:2.0:1788572217.197385:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638895616 00000100:00100000:2.0:1788572217.197394:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638896128 00000100:00100000:2.0:1788572217.197396:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638896128 00000100:00100000:2.0:1788572217.197403:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638896640 00000100:00100000:2.0:1788572217.197405:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638896640 00000100:00100000:2.0:1788572217.197413:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638897152 00000100:00100000:2.0:1788572217.197414:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638897152 00000100:00100000:2.0:1788572217.197421:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638895488 00000100:00100000:2.0:1788572217.197424:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638895488 00000100:00100000:2.0:1788572217.197431:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638896000 00000100:00100000:2.0:1788572217.197433:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638896000 00000100:00100000:2.0:1788572217.197441:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638896512 00000100:00100000:2.0:1788572217.197443:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638896512 00000100:00100000:2.0:1788572217.197451:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638897024 00000100:00100000:2.0:1788572217.197453:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638897024 00000100:00100000:2.0:1788572217.197463:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1788572217.197469:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3653:x1875449638894080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.197483:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2079 count 1 00000100:00100000:2.0:1788572217.197535:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3653:x1875449638894080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 66us (743us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.197542:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1788572217.197620:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638897536 00000100:00100000:2.0:1788572217.197624:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638897536 00000100:00100000:2.0:1788572217.197638:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:2.0:1788572217.197643:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3653:x1875449638894592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.197663:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2083 count 1 00000100:00100000:2.0:1788572217.197702:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3653:x1875449638894592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59us (871us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.197708:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:2.0:1788572217.197720:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:2.0:1788572217.197726:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3653:x1875449638895616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.197737:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2085 count 1 00000100:00100000:2.0:1788572217.197783:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3653:x1875449638895616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 57us (896us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.197788:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:2.0:1788572217.197799:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:2.0:1788572217.197805:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638896128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.197816:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2089 count 1 00000100:00100000:2.0:1788572217.197851:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638896128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47us (934us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.197856:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:2.0:1788572217.197865:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:2.0:1788572217.197870:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3653:x1875449638896640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.197880:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2085 count 1 00000100:00100000:2.0:1788572217.197917:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3653:x1875449638896640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46us (974us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.197923:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:2.0:1788572217.197934:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:2.0:1788572217.197939:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3653:x1875449638897152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.197949:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2089 count 1 00000100:00100000:2.0:1788572217.197987:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3653:x1875449638897152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 47us (1017us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.197993:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00100000:1.0:1788572217.198369:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:1.0:1788572217.198377:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638895488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.198389:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2084 count 1 00000100:00100000:1.0:1788572217.198437:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638895488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 60us (1431us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.198444:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:1.0:1788572217.198457:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:1.0:1788572217.198463:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638896000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.198473:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2088 count 1 00000100:00100000:1.0:1788572217.198512:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638896000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50us (1454us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.198518:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00100000:1.0:1788572217.198531:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:1.0:1788572217.198537:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638896512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.198549:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2084 count 1 00000100:00100000:1.0:1788572217.198585:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638896512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48us (1394us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.198591:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:1.0:1788572217.198601:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1788572217.198607:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638897024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.198616:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2088 count 1 00000100:00100000:1.0:1788572217.198666:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638897024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59us (1446us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.198672:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1788572217.198682:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1788572217.198688:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638897536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.198717:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2092 count 1 00000100:00100000:1.0:1788572217.198769:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638897536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 82us (1453us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.198775:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:2.0:1788572217.198991:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638897664:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.199037:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.199149:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638897664 00000100:00100000:1.0:1788572217.199154:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638897664 00000100:00100000:1.0:1788572217.199185:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:1.0:1788572217.199190:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638897664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.199205:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2091 count 1 00000100:00100000:1.0:1788572217.199317:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638897664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 126us (279us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.199324:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:1.0:1788572217.199341:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572217.199350:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638897792:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.199374:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.199396:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638897792 00000100:00100000:1.0:1788572217.199399:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638897792 00000100:00100000:1.0:1788572217.199419:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:1.0:1788572217.199424:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638897792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.199434:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2093 count 1 00000100:00100000:1.0:1788572217.199497:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638897792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 72us (122us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.199503:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000004:00080000:1.0:1788572217.199529:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931880, transno 0 00000004:00080000:1.0:1788572217.199535:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931880/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.199545:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638897792:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.199587:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a93bb80, transno 0 00000004:00080000:2.0:1788572217.199591:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a93bb80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199606:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638895488:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.199616:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc45c00, transno 0 00000004:00080000:2.0:1788572217.199618:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc45c00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199622:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638896000:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.199632:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d500, transno 0 00000004:00080000:2.0:1788572217.199634:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d500/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199637:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638896512:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.199643:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57c700, transno 0 00000004:00080000:2.0:1788572217.199645:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57c700/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199648:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638897024:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.199666:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641694e00, transno 0 00000004:00080000:2.0:1788572217.199668:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641694e00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199671:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638897536:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.199678:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637594a80, transno 0 00000004:00080000:2.0:1788572217.199680:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637594a80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199683:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638895616:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.199690:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637794e00, transno 0 00000004:00080000:2.0:1788572217.199692:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637794e00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199695:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638896128:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.199702:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc45880, transno 0 00000004:00080000:2.0:1788572217.199704:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc45880/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199707:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638896640:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.199713:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0380, transno 0 00000004:00080000:2.0:1788572217.199716:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412b0380/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199718:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638897152:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.199726:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f100, transno 0 00000004:00080000:2.0:1788572217.199728:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2f100/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199731:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638894080:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.199737:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3e300, transno 0 00000004:00080000:2.0:1788572217.199740:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc3e300/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199742:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638894592:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.199753:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10e00, transno 0 00000004:00080000:2.0:1788572217.199756:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10e00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.199759:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638897664:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.199843:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 156 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:2.0:1788572217.199935:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638898176:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.199959:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.199982:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638898176 00000100:00100000:2.0:1788572217.199986:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638898176 00000100:00100000:2.0:1788572217.200030:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:2.0:1788572217.200036:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638898176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.200048:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2096 count 1 00000100:00100000:2.0:1788572217.200178:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638898176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 142us (218us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.200184:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000004:00080000:2.0:1788572217.200207:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931180, transno 0 00000004:00080000:2.0:1788572217.200211:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931180/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.200219:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638898176:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.200224:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638898688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.200330:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638897920:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.200354:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.200375:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638898432:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.200391:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.200409:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572217.200413:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638898304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.200430:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.200444:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638898816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.200459:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.200479:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638897920 00000100:00100000:1.0:1788572217.200482:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638897920 00000100:00100000:1.0:1788572217.200502:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638898432 00000100:00100000:1.0:1788572217.200504:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638898432 00000100:00100000:1.0:1788572217.200517:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638898304 00000100:00100000:1.0:1788572217.200519:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638898304 00000100:00100000:1.0:1788572217.200530:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638898816 00000100:00100000:1.0:1788572217.200532:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638898816 00000100:00100000:1.0:1788572217.200545:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1788572217.200551:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638897920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.200572:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2094 count 1 00000100:00100000:1.0:1788572217.200619:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638897920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 67us (264us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.200624:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1788572217.200635:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1788572217.200640:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638898432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.200661:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2098 count 1 00000100:00100000:1.0:1788572217.200702:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638898432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62us (310us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.200707:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:1.0:1788572217.200718:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1788572217.200723:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638898304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.200752:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2097 count 1 00000100:00100000:1.0:1788572217.200806:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638898304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 83us (375us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.200811:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1788572217.200823:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1788572217.200829:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638898816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.200840:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2101 count 1 00000100:00100000:1.0:1788572217.200877:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638898816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (417us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.200883:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000004:00080000:1.0:1788572217.200909:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503933800, transno 0 00000004:00080000:1.0:1788572217.200913:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503933800/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.200917:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638898304:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.200924:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931f80, transno 0 00000004:00080000:1.0:1788572217.200926:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931f80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.200929:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638898816:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.200936:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931880, transno 0 00000004:00080000:1.0:1788572217.200938:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931880/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.200941:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638897920:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.200947:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931c00, transno 0 00000004:00080000:1.0:1788572217.200950:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931c00/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.200953:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638898432:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.201224:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 148 changes, 3 in progress, 3 in flight, 5 done 00000100:00100000:2.0:1788572217.201392:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.201419:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638899200:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.201438:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.201457:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638898688 00000100:00100000:2.0:1788572217.201461:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638898688 00000100:00100000:2.0:1788572217.201488:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638899200 00000100:00100000:2.0:1788572217.201491:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638899200 00000100:00100000:2.0:1788572217.201505:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690 00000100:00100000:2.0:1788572217.201510:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638898688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.201541:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2100 count 1 00000100:00100000:2.0:1788572217.201600:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638898688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 89us (207us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.201605:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690 00000100:00100000:2.0:1788572217.201616:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:2.0:1788572217.201621:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638899200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.201633:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2104 count 1 00000100:00100000:2.0:1788572217.201683:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638899200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62us (243us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.201689:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000004:00080000:2.0:1788572217.201709:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931880, transno 0 00000004:00080000:2.0:1788572217.201712:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931880/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.201719:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638899200:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.201797:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503933b80, transno 0 00000004:00080000:2.0:1788572217.201801:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503933b80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.201807:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638898688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.201817:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788572217.201822:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638898048:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.201844:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.201861:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638898560:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.201882:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.201897:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638898048 00000100:00100000:2.0:1788572217.201901:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638898048 00000100:00100000:2.0:1788572217.201919:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638898560 00000100:00100000:2.0:1788572217.201922:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638898560 00000100:00100000:2.0:1788572217.201936:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:2.0:1788572217.201941:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638898048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.201953:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2095 count 1 00000100:00100000:2.0:1788572217.202027:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638898048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 85us (181us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.202033:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:2.0:1788572217.202043:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:2.0:1788572217.202048:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638898560:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.202175:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638898944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.202202:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.202220:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638899456:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.202310:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.202332:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572217.202337:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638899328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.202358:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.202381:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638898944 00000100:00100000:1.0:1788572217.202384:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638898944 00000100:00100000:1.0:1788572217.202405:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638899456 00000100:00100000:1.0:1788572217.202407:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638899456 00000100:00100000:1.0:1788572217.202417:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638899328 00000100:00100000:1.0:1788572217.202419:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638899328 00000100:00100000:1.0:1788572217.202432:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:1.0:1788572217.202437:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638898944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.202448:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2102 count 1 00000100:00100000:1.0:1788572217.202509:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638898944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 71us (306us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.202515:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:1.0:1788572217.202525:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:1.0:1788572217.202530:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638899456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.202558:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2106 count 1 00000100:00100000:1.0:1788572217.202611:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638899456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 80us (300us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.202616:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:1.0:1788572217.202626:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:1.0:1788572217.202631:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638899328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.202649:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2105 count 1 00000100:00100000:1.0:1788572217.202715:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638899328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 83us (355us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.202720:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000004:00080000:1.0:1788572217.202743:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931c00, transno 0 00000004:00080000:1.0:1788572217.202748:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931c00/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.202753:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638899328:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.202760:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503933800, transno 0 00000004:00080000:1.0:1788572217.202762:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503933800/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.202765:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638898944:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.202771:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503930a80, transno 0 00000004:00080000:1.0:1788572217.202773:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503930a80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.202776:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638899456:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.202810:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 158 changes, 3 in progress, 3 in flight, 5 done 00000100:00100000:1.0:1788572217.202871:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638899968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.202893:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.202911:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572217.202916:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638899840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.202934:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.202956:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638899968 00000100:00100000:1.0:1788572217.202960:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638899968 00000100:00100000:1.0:1788572217.202979:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638899840 00000100:00100000:1.0:1788572217.202981:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638899840 00000100:00100000:1.0:1788572217.202992:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:1.0:1788572217.202997:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638899968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.203027:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2094 count 1 00000100:00100000:0.0:1788572217.203171:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638895360:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.203189:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634ad6d80, transno 0 00000004:00080000:0.0:1788572217.203192:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634ad6d80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.203195:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638895872:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.203205:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637594e00, transno 0 00000004:00080000:0.0:1788572217.203207:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637594e00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.203210:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638895744:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.203218:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637795f80, transno 0 00000004:00080000:0.0:1788572217.203220:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637795f80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.203223:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638896256:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.203311:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638865024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572217.203339:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638900096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.203365:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.203383:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788572217.203388:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638899712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.203405:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.203419:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638900224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.203436:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.203457:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638900096 00000100:00100000:0.0:1788572217.203460:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638900096 00000100:00100000:0.0:1788572217.203481:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638899712 00000100:00100000:0.0:1788572217.203483:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638899712 00000100:00100000:0.0:1788572217.203492:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638900224 00000100:00100000:0.0:1788572217.203494:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638900224 00000100:00100000:0.0:1788572217.203504:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:0.0:1788572217.203509:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+9:3651:x1875449638899840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.203537:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2093 count 1 00000100:00100000:0.0:1788572217.203587:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+9:3651:x1875449638899840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 78us (651us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.203593:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00100000:0.0:1788572217.203606:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00100000:0.0:1788572217.203611:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638900096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.203639:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2095 count 1 00000100:00100000:0.0:1788572217.203705:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638900096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 94us (339us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.203715:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00100000:0.0:1788572217.203725:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:0.0:1788572217.203731:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638899712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.203753:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2092 count 1 00000100:00100000:0.0:1788572217.203807:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638899712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 75us (400us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.203812:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:0.0:1788572217.203822:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:0.0:1788572217.203828:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638900224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.203838:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2096 count 1 00000100:00100000:0.0:1788572217.203874:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638900224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 46us (437us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.203880:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000004:00080000:0.0:1788572217.203909:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12680, transno 0 00000004:00080000:0.0:1788572217.203913:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12680/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.203917:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638899712:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.203924:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12300, transno 0 00000004:00080000:0.0:1788572217.203926:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12300/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.203929:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638900224:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.203935:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11c00, transno 0 00000004:00080000:0.0:1788572217.203937:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11c00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.203940:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638900096:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.204162:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2099 count 1 00000100:00100000:2.0:1788572217.204217:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638898560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2168us (2333us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.204224:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000004:00080000:2.0:1788572217.204505:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 142 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:2.0:1788572217.204589:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638900352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.204614:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.204635:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572217.204639:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638900480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.204669:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.204694:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638900352 00000100:00100000:2.0:1788572217.204697:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638900352 00000100:00100000:2.0:1788572217.204720:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638900480 00000100:00100000:2.0:1788572217.204722:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638900480 00000100:00100000:2.0:1788572217.204736:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702 00000100:00100000:2.0:1788572217.204742:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638900352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.204773:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2108 count 1 00000100:00100000:2.0:1788572217.204830:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638900352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 86us (214us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.204837:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702 00000100:00100000:2.0:1788572217.204848:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703 00000100:00100000:2.0:1788572217.204854:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638900480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.204865:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2109 count 1 00000100:00100000:2.0:1788572217.204905:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638900480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51us (234us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.204910:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703 00000004:00080000:2.0:1788572217.204940:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931c00, transno 0 00000004:00080000:2.0:1788572217.204944:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931c00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.204953:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638900480:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.204960:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503933b80, transno 0 00000004:00080000:2.0:1788572217.204963:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503933b80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.204966:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638900352:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.205182:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638899968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2183us (2286us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.205190:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000004:00080000:1.0:1788572217.205230:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10380, transno 0 00000004:00080000:1.0:1788572217.205307:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10380/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.205312:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638899840:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.205326:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12d80, transno 0 00000004:00080000:1.0:1788572217.205328:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12d80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.205331:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638899968:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.205461:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 153 changes, 2 in progress, 0 in flight, 6 done 00000100:00100000:1.0:1788572217.205644:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638901120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.205683:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.205708:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638901632:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.205725:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.205742:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572217.205746:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638900992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.205763:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.205776:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638901504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.205792:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.205816:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638901120 00000100:00100000:1.0:1788572217.205820:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638901120 00000100:00100000:1.0:1788572217.205847:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638901632 00000100:00100000:1.0:1788572217.205850:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638901632 00000100:00100000:1.0:1788572217.205864:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638900992 00000100:00100000:1.0:1788572217.205867:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638900992 00000100:00100000:1.0:1788572217.205878:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638901504 00000100:00100000:1.0:1788572217.205880:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638901504 00000100:00100000:1.0:1788572217.205892:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:1.0:1788572217.205898:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638901120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.205912:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2098 count 1 00000100:00100000:1.0:1788572217.205971:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638901120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 72us (287us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.205977:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:1.0:1788572217.205989:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:1.0:1788572217.205995:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638901632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.206028:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2102 count 1 00000100:00100000:0.0:1788572217.206153:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00100000:0.0:1788572217.206161:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638900992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.206192:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2097 count 1 00000100:00100000:0.0:1788572217.206310:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638900992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 149us (545us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.206317:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00000100:00100000:0.0:1788572217.206329:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:0.0:1788572217.206335:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638901504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.206364:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2101 count 1 00000100:00100000:0.0:1788572217.206400:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638901504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 65us (606us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.206405:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000004:00080000:0.0:1788572217.206465:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b2680, transno 0 00000004:00080000:0.0:1788572217.206469:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a9b2680/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.206478:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638900992:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.206484:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637795180, transno 0 00000004:00080000:0.0:1788572217.206487:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637795180/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.206490:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638901504:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.206495:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b0a80, transno 0 00000004:00080000:0.0:1788572217.206497:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a9b0a80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.206500:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638901120:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.206567:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 145 changes, 5 in progress, 5 in flight, 3 done 00000100:00100000:0.0:1788572217.206617:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638902144:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.206638:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.206668:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572217.206673:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638902016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.206691:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.206808:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638902144 00000100:00100000:2.0:1788572217.206813:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638902144 00000100:00100000:2.0:1788572217.206835:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638902016 00000100:00100000:2.0:1788572217.206838:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638902016 00000100:00100000:2.0:1788572217.206854:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708 00000100:00100000:2.0:1788572217.206861:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638902144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.206877:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2106 count 1 00000100:00100000:2.0:1788572217.206923:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638902144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 62us (283us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.206928:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708 00000100:00100000:2.0:1788572217.206941:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:2.0:1788572217.206947:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638902016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.206957:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2105 count 1 00000100:00100000:2.0:1788572217.206994:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638902016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47us (301us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.206999:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000004:00080000:2.0:1788572217.207054:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637795180, transno 0 00000100:00100000:0.0:1788572217.207174:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638902400:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.207201:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.207338:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638901632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1341us (1610us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.207345:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:1.0:1788572217.207357:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638902400 00000100:00100000:1.0:1788572217.207361:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638902400 00000100:00100000:1.0:1788572217.207386:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:1.0:1788572217.207392:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638902400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.207422:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2113 count 1 00000100:00100000:1.0:1788572217.207471:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638902400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 79us (270us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.207477:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00000004:00080000:1.0:1788572217.207498:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503933b80, transno 0 00000004:00080000:1.0:1788572217.207502:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503933b80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.207512:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638902400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.207625:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572217.207632:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638902528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.207664:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.207686:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638902528 00000100:00100000:1.0:1788572217.207689:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638902528 00000100:00100000:1.0:1788572217.207708:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:1.0:1788572217.207713:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638902528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.207737:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2114 count 1 00000100:00100000:1.0:1788572217.207799:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638902528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 85us (133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.207804:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000004:00080000:1.0:1788572217.207827:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13100, transno 0 00000004:00080000:1.0:1788572217.207830:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13100/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.207837:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638902528:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.207961:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637795180/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.207975:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638902016:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.207988:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637795f80, transno 0 00000004:00080000:2.0:1788572217.207990:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637795f80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.207994:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638902144:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.208032:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637796a00, transno 0 00000004:00080000:2.0:1788572217.208035:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637796a00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.208039:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638901632:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.208054:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638900608:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.208225:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 142 changes, 5 in progress, 5 in flight, 3 done 00000100:00100000:2.0:1788572217.208384:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.208408:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638901248:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.208426:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.208438:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638901760:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.208454:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.208464:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638902272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.208479:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.208491:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638902656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.208506:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.208521:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [3->2] 00000100:00100000:2.0:1788572217.208526:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638900736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.208544:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.208556:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638901376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.208572:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.208583:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638901888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.208597:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.208608:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638900864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.208622:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.208633:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638902784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.208648:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.208684:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638900608 00000100:00100000:2.0:1788572217.208687:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638900608 00000100:00100000:2.0:1788572217.208710:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638901248 00000100:00100000:2.0:1788572217.208712:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638901248 00000100:00100000:2.0:1788572217.208725:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638901760 00000100:00100000:2.0:1788572217.208727:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638901760 00000100:00100000:2.0:1788572217.208736:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638902272 00000100:00100000:2.0:1788572217.208738:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638902272 00000100:00100000:2.0:1788572217.208747:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638902656 00000100:00100000:2.0:1788572217.208749:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638902656 00000100:00100000:2.0:1788572217.208756:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638900736 00000100:00100000:2.0:1788572217.208757:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638900736 00000100:00100000:2.0:1788572217.208764:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638901376 00000100:00100000:2.0:1788572217.208766:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638901376 00000100:00100000:2.0:1788572217.208772:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638901888 00000100:00100000:2.0:1788572217.208774:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638901888 00000100:00100000:2.0:1788572217.208781:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638900864 00000100:00100000:2.0:1788572217.208783:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638900864 00000100:00100000:2.0:1788572217.208790:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638902784 00000100:00100000:2.0:1788572217.208794:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638902784 00000100:00100000:2.0:1788572217.208805:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:2.0:1788572217.208810:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638900608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.208825:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2110 count 1 00000100:00100000:2.0:1788572217.208882:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638900608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 71us (496us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.208889:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:2.0:1788572217.208901:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00100000:2.0:1788572217.208907:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638901248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.208918:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2099 count 1 00000100:00100000:2.0:1788572217.208963:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638901248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 56us (535us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.208968:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00000100:00100000:2.0:1788572217.208980:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714 00000100:00100000:2.0:1788572217.208986:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638901760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.209028:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2103 count 1 00000100:00100000:2.0:1788572217.209063:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638901760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 78us (608us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.209069:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714 00000100:00100000:2.0:1788572217.209084:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:2.0:1788572217.209090:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638902272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.209099:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2107 count 1 00000100:00100000:2.0:1788572217.209135:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638902272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 46us (654us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.209141:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00100000:2.0:1788572217.209154:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716 00000100:00100000:2.0:1788572217.209161:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638902656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.209177:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2115 count 1 00000100:00100000:2.0:1788572217.209217:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638902656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 56us (710us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.209223:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716 00000100:00100000:1.0:1788572217.209345:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:1.0:1788572217.209353:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638900736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.209365:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2111 count 1 00000100:00100000:1.0:1788572217.209423:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638900736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 71us (878us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.209428:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00100000:1.0:1788572217.209439:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1788572217.209444:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638901376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.209453:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2100 count 1 00000100:00100000:1.0:1788572217.209488:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638901376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 44us (915us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.209494:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1788572217.209504:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1788572217.209509:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638901888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.209537:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2104 count 1 00000100:00100000:1.0:1788572217.209570:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638901888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 60us (971us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.209575:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1788572217.209585:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1788572217.209590:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638900864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.209618:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2112 count 1 00000100:00100000:1.0:1788572217.209682:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638900864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 91us (1058us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.209690:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1788572217.209700:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:1.0:1788572217.209705:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638902784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.209736:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2108 count 1 00000100:00100000:1.0:1788572217.209788:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638902784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 82us (1138us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.209794:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00100000:1.0:1788572217.209822:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638902912:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.209854:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.209879:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572217.209885:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638903040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.209905:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.209926:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638902912 00000100:00100000:1.0:1788572217.209931:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638902912 00000100:00100000:1.0:1788572217.209954:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638903040 00000100:00100000:1.0:1788572217.209956:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638903040 00000100:00100000:1.0:1788572217.209969:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722 00000100:00100000:1.0:1788572217.209974:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638902912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.210001:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2109 count 1 00000100:00100000:1.0:1788572217.210067:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638902912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 92us (212us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.210073:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722 00000100:00100000:1.0:1788572217.210158:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00100000:1.0:1788572217.210165:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638903040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.210175:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2110 count 1 00000100:00100000:1.0:1788572217.210211:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638903040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47us (305us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.210218:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000004:00080000:2.0:1788572217.210446:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503930a80, transno 0 00000004:00080000:2.0:1788572217.210454:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503930a80/1, rc -2, transno 0 00000004:00080000:1.0:1788572217.210531:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0a80, transno 0 00000004:00080000:1.0:1788572217.210535:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db0a80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.210545:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638903040:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.210553:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0000, transno 0 00000004:00080000:1.0:1788572217.210555:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db0000/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.210558:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638902912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.210869:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572217.210879:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638903424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.210908:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.210976:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638903424 00000100:00100000:1.0:1788572217.210980:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638903424 00000100:00100000:1.0:1788572217.211027:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:1.0:1788572217.211033:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638903424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.211062:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2112 count 1 00000100:00100000:1.0:1788572217.211118:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638903424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 86us (209us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.211124:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000004:00080000:1.0:1788572217.211146:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0000, transno 0 00000004:00080000:1.0:1788572217.211150:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db0000/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.211157:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638903424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.211371:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638903552:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.211395:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.211472:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638903552 00000100:00100000:0.0:1788572217.211476:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638903552 00000100:00100000:0.0:1788572217.211507:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:0.0:1788572217.211514:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638903552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.211524:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2113 count 1 00000100:00100000:0.0:1788572217.211571:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638903552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 57us (174us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.211577:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000004:00080000:1.0:1788572217.211640:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0000, transno 0 00000004:00080000:1.0:1788572217.211644:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db0000/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.211665:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638903552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.211861:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638900736:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.211875:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634ad6d80, transno 0 00000004:00080000:2.0:1788572217.211878:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634ad6d80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.211893:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638901376:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.211902:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637794000, transno 0 00000004:00080000:2.0:1788572217.211904:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637794000/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.211908:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638901888:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.211915:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931c00, transno 0 00000004:00080000:2.0:1788572217.211917:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931c00/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.212038:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572217.212045:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638903936:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.212068:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.212164:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638903936 00000100:00100000:0.0:1788572217.212168:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638903936 00000100:00100000:0.0:1788572217.212239:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00100000:0.0:1788572217.212246:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638903936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.212276:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2116 count 1 00000100:00100000:0.0:1788572217.212340:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638903936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 94us (271us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.212346:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00100000:2.0:1788572217.212708:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638900864:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.212723:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 0 00000004:00080000:2.0:1788572217.212726:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3800/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.212733:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638902784:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.212741:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503933800, transno 0 00000004:00080000:2.0:1788572217.212743:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503933800/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.212746:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638900608:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.212753:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b3800, transno 0 00000004:00080000:2.0:1788572217.212755:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a9b3800/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.212758:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638901248:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.212766:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637795500, transno 0 00000004:00080000:2.0:1788572217.212768:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637795500/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.212770:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638901760:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.212777:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b2680, transno 0 00000004:00080000:2.0:1788572217.212779:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a9b2680/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.212782:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638902272:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.212789:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13100, transno 0 00000004:00080000:2.0:1788572217.212791:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13100/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.212794:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638902656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.212823:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638903168:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.212850:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.212975:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638903680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.212999:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.213043:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638903168 00000100:00100000:1.0:1788572217.213047:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638903168 00000100:00100000:1.0:1788572217.213081:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00100000:1.0:1788572217.213089:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638903168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.213103:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2116 count 1 00000100:00100000:1.0:1788572217.213165:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638903168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 78us (314us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.213170:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000004:00080000:1.0:1788572217.213202:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13b80, transno 0 00000004:00080000:1.0:1788572217.213206:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13b80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.213210:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638903936:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.213368:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 133 changes, 3 in progress, 3 in flight, 5 done 00000100:00100000:1.0:1788572217.213428:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638904064:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.213453:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638904448:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.213780:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638904192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.213802:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.213880:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638904704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.213899:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.213938:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638903680 00000100:00100000:0.0:1788572217.213943:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638903680 00000100:00100000:0.0:1788572217.213969:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638904192 00000100:00100000:0.0:1788572217.213971:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638904192 00000100:00100000:0.0:1788572217.213987:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:0.0:1788572217.213993:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638903680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.214026:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2114 count 1 00000100:00100000:0.0:1788572217.214079:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638903680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 87us (1079us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.214086:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:0.0:1788572217.214099:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00100000:0.0:1788572217.214105:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638904192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.214116:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2118 count 1 00000100:00100000:0.0:1788572217.214152:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638904192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47us (349us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.214157:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000004:00080000:2.0:1788572217.214406:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3b80, transno 0 00000004:00080000:2.0:1788572217.214411:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3b80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.214421:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638903168:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.214429:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0000, transno 0 00000004:00080000:2.0:1788572217.214431:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db0000/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.214438:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638903680:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.214448:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10700, transno 0 00000004:00080000:2.0:1788572217.214450:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10700/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.214454:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638904192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.214459:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788572217.214464:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638903296:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.214485:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.214502:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638903808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.214518:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.214531:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638904320:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.214546:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.214556:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638904832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.214571:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.214592:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638904704 00000100:00100000:2.0:1788572217.214596:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638904704 00000100:00100000:2.0:1788572217.214619:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638903296 00000100:00100000:2.0:1788572217.214622:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638903296 00000100:00100000:2.0:1788572217.214634:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638903808 00000100:00100000:2.0:1788572217.214636:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638903808 00000100:00100000:2.0:1788572217.214671:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638904320 00000100:00100000:2.0:1788572217.214674:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638904320 00000100:00100000:2.0:1788572217.214687:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638904832 00000100:00100000:2.0:1788572217.214689:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638904832 00000100:00100000:2.0:1788572217.214703:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730 00000100:00100000:2.0:1788572217.214708:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638904704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.214740:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2117 count 1 00000100:00100000:2.0:1788572217.214793:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638904704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 85us (893us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.214799:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730 00000100:00100000:2.0:1788572217.214812:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:2.0:1788572217.214819:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638903296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.214829:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2111 count 1 00000100:00100000:2.0:1788572217.214885:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638903296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 66us (399us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.214891:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:2.0:1788572217.214901:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:2.0:1788572217.214907:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638903808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.214917:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2115 count 1 00000100:00100000:2.0:1788572217.214953:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638903808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47us (434us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.214959:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:2.0:1788572217.214969:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733 00000100:00100000:2.0:1788572217.214974:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638904320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.214984:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2119 count 1 00000100:00100000:2.0:1788572217.215034:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638904320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 60us (487us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.215041:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733 00000100:00100000:2.0:1788572217.215051:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734 00000100:00100000:2.0:1788572217.215056:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638904832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.215087:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2118 count 1 00000100:00100000:2.0:1788572217.215139:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638904832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 84us (567us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.215145:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734 00000100:00100000:2.0:1788572217.215408:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.215475:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638904576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.215502:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.215581:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572217.215587:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638904960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.215606:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.215622:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638904064 00000100:00100000:1.0:1788572217.215627:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638904064 00000100:00100000:1.0:1788572217.215666:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638904576 00000100:00100000:1.0:1788572217.215669:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638904576 00000100:00100000:1.0:1788572217.215684:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735 00000100:00100000:1.0:1788572217.215690:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638904064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.215740:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2117 count 1 00000100:00100000:1.0:1788572217.215811:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638904064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 120us (402us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.215816:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735 00000100:00100000:1.0:1788572217.215828:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736 00000100:00100000:1.0:1788572217.215835:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638904576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.215863:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2121 count 1 00000100:00100000:1.0:1788572217.215917:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638904576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 82us (414us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.215922:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736 00000004:00080000:2.0:1788572217.216455:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13b80, transno 0 00000004:00080000:2.0:1788572217.216462:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13b80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.216472:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638904064:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.216480:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10000, transno 0 00000004:00080000:2.0:1788572217.216483:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10000/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.216486:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638904576:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.216497:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638905088:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.216520:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.216707:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572217.216713:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638905472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.216732:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.216776:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638904960 00000100:00100000:0.0:1788572217.216781:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638904960 00000100:00100000:0.0:1788572217.216807:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638905088 00000100:00100000:0.0:1788572217.216810:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638905088 00000100:00100000:0.0:1788572217.216825:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737 00000100:00100000:0.0:1788572217.216830:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638904960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.216853:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2119 count 1 00000100:00100000:0.0:1788572217.216932:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638904960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 101us (1324us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.216939:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737 00000100:00100000:0.0:1788572217.216951:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738 00000100:00100000:0.0:1788572217.216957:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638905088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.216966:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2122 count 1 00000100:00100000:0.0:1788572217.217039:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638905088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 82us (517us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.217045:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738 00000004:00080000:2.0:1788572217.217143:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10700, transno 0 00000004:00080000:2.0:1788572217.217147:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10700/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.217156:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638905088:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.217165:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db1880, transno 0 00000004:00080000:2.0:1788572217.217167:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db1880/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.217171:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638904960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.217193:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638905216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.217215:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572217.217247:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0a80, transno 0 00000004:00080000:2.0:1788572217.217250:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db0a80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.217253:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638903296:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.217264:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13480, transno 0 00000004:00080000:2.0:1788572217.217267:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13480/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.217270:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638903808:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.217279:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 0 00000004:00080000:2.0:1788572217.217281:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11f80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.217285:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638904320:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.217292:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 0 00000004:00080000:2.0:1788572217.217294:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3800/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.217298:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638904832:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.217306:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db2680, transno 0 00000004:00080000:2.0:1788572217.217308:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db2680/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.217311:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638904704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.217320:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572217.217325:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638905344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.217346:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572217.217428:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 130 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:2.0:1788572217.217490:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638905600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.217512:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.217531:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572217.217536:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638905984:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.217554:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.217575:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638905728:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.217592:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.217606:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572217.217610:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638905856:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.217626:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.217648:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638905472 00000100:00100000:2.0:1788572217.217668:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638905472 00000100:00100000:2.0:1788572217.217692:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638905216 00000100:00100000:2.0:1788572217.217694:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638905216 00000100:00100000:2.0:1788572217.217704:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638905344 00000100:00100000:2.0:1788572217.217706:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638905344 00000100:00100000:2.0:1788572217.217715:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638905600 00000100:00100000:2.0:1788572217.217717:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638905600 00000100:00100000:2.0:1788572217.217726:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638905984 00000100:00100000:2.0:1788572217.217728:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638905984 00000100:00100000:2.0:1788572217.217737:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638905728 00000100:00100000:2.0:1788572217.217739:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638905728 00000100:00100000:2.0:1788572217.217748:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638905856 00000100:00100000:2.0:1788572217.217749:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638905856 00000100:00100000:2.0:1788572217.217759:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739 00000100:00100000:2.0:1788572217.217764:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638905472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.217789:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2125 count 1 00000100:00100000:2.0:1788572217.217843:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638905472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 78us (1109us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.217849:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739 00000100:00100000:2.0:1788572217.217863:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740 00000100:00100000:2.0:1788572217.217868:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638905216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.217879:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2123 count 1 00000100:00100000:2.0:1788572217.217921:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638905216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (705us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.217926:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740 00000100:00100000:2.0:1788572217.217936:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741 00000100:00100000:2.0:1788572217.217942:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638905344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.217952:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2124 count 1 00000100:00100000:2.0:1788572217.217990:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638905344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48us (643us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.217996:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741 00000100:00100000:2.0:1788572217.218033:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742 00000100:00100000:2.0:1788572217.218039:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638905600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.218061:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2120 count 1 00000100:00100000:2.0:1788572217.218104:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638905600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 65us (590us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.218110:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742 00000100:00100000:2.0:1788572217.218122:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:2.0:1788572217.218127:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638905984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.218137:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2123 count 1 00000100:00100000:2.0:1788572217.218175:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638905984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48us (619us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.218181:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00000100:00100000:2.0:1788572217.218195:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744 00000100:00100000:2.0:1788572217.218200:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638905728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.218209:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2121 count 1 00000100:00100000:2.0:1788572217.218246:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638905728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46us (652us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.218251:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744 00000100:00100000:2.0:1788572217.218263:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745 00000100:00100000:2.0:1788572217.218269:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638905856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.218278:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2122 count 1 00000100:00100000:2.0:1788572217.218314:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638905856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 45us (685us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.218322:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745 00000004:00080000:2.0:1788572217.218348:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d500, transno 0 00000004:00080000:2.0:1788572217.218353:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d500/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.218362:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638905984:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.218371:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0700, transno 0 00000004:00080000:2.0:1788572217.218373:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412b0700/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.218376:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638905600:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.218384:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10000, transno 0 00000004:00080000:2.0:1788572217.218385:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10000/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.218389:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638905472:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.218403:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3e300, transno 0 00000004:00080000:2.0:1788572217.218406:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc3e300/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.218409:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638905856:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.218414:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0380, transno 0 00000004:00080000:2.0:1788572217.218416:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412b0380/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.218419:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638905728:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.218425:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13b80, transno 0 00000004:00080000:2.0:1788572217.218427:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13b80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.218430:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638905344:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.218436:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10380, transno 0 00000004:00080000:2.0:1788572217.218438:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10380/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.218441:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638905216:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.218505:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 126 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:2.0:1788572217.218575:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638906112:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.218601:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.218616:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572217.218621:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638906496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.218636:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.218661:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638906240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.218679:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.218689:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572217.218693:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638906368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.218706:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.218720:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638906112 00000100:00100000:2.0:1788572217.218724:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638906112 00000100:00100000:2.0:1788572217.218742:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638906496 00000100:00100000:2.0:1788572217.218744:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638906496 00000100:00100000:2.0:1788572217.218750:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638906240 00000100:00100000:2.0:1788572217.218752:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638906240 00000100:00100000:2.0:1788572217.218760:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638906368 00000100:00100000:2.0:1788572217.218761:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638906368 00000100:00100000:2.0:1788572217.218772:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746 00000100:00100000:2.0:1788572217.218776:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638906112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.218789:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2124 count 1 00000100:00100000:2.0:1788572217.218836:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638906112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 58us (234us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.218841:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746 00000100:00100000:2.0:1788572217.218853:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747 00000100:00100000:2.0:1788572217.218858:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638906496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.218887:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2127 count 1 00000100:00100000:2.0:1788572217.218921:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638906496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 63us (284us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.218930:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747 00000100:00100000:2.0:1788572217.218940:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748 00000100:00100000:2.0:1788572217.218945:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638906240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.218975:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2125 count 1 00000100:00100000:2.0:1788572217.219048:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638906240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 102us (367us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.219054:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748 00000100:00100000:2.0:1788572217.219065:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:2.0:1788572217.219071:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638906368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.219099:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2126 count 1 00000100:00100000:2.0:1788572217.219152:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638906368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 81us (444us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.219157:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 00000004:00080000:2.0:1788572217.219177:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2ce00, transno 0 00000004:00080000:2.0:1788572217.219181:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2ce00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.219188:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638906496:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.219197:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d500, transno 0 00000004:00080000:2.0:1788572217.219199:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d500/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.219202:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638906112:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.219216:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c000, transno 0 00000004:00080000:2.0:1788572217.219219:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2c000/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.219222:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638906368:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.219227:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d180, transno 0 00000004:00080000:2.0:1788572217.219230:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d180/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.219233:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638906240:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.219287:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 122 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:2.0:1788572217.219338:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638906624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.219362:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.219387:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572217.219392:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638907008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.219411:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.219431:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638906752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.219447:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.219460:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572217.219465:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638906880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.219482:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572217.219503:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503932d80, transno 0 00000004:00080000:2.0:1788572217.219507:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503932d80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.219514:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638898560:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.219519:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638899072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.219541:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.219552:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638899584:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.219569:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572217.219583:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503932680, transno 0 00000004:00080000:2.0:1788572217.219586:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503932680/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.219589:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638898048:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.219687:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638907136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.219707:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638906624 00000100:00100000:2.0:1788572217.219710:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.219712:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638906624 00000100:00100000:2.0:1788572217.219730:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638907264:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.219732:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638907008 00000100:00100000:3.0:1788572217.219734:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638907008 00000100:00100000:3.0:1788572217.219743:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638906752 00000100:00100000:3.0:1788572217.219745:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638906752 00000100:00100000:2.0:1788572217.219750:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.219753:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638906880 00000100:00100000:3.0:1788572217.219756:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638906880 00000100:00100000:3.0:1788572217.219765:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638899072 00000100:00100000:3.0:1788572217.219768:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638899072 00000100:00100000:2.0:1788572217.219772:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638899584 00000100:00100000:2.0:1788572217.219775:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638899584 00000100:00100000:3.0:1788572217.219776:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638907136 00000100:00100000:3.0:1788572217.219778:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638907136 00000100:00100000:2.0:1788572217.219785:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638907264 00000100:00100000:2.0:1788572217.219787:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638907264 00000100:00100000:3.0:1788572217.219789:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:3.0:1788572217.219795:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+12:3651:x1875449638906624:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.219797:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751 00000100:00100000:2.0:1788572217.219802:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3651:x1875449638907008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.219807:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2128 count 1 00002000:00080000:2.0:1788572217.219810:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2131 count 1 00000100:00100000:0.0:1788572217.220029:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752 00000100:00100000:0.0:1788572217.220039:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3652:x1875449638906752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.220052:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2129 count 1 00000100:00100000:0.0:1788572217.220105:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3652:x1875449638906752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 69us (656us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.220111:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752 00000100:00100000:0.0:1788572217.220125:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00100000:0.0:1788572217.220131:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449638906880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.220142:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2130 count 1 00000100:00100000:0.0:1788572217.220179:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449638906880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48us (696us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.220185:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:3.0:1788572217.220191:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+11:3651:x1875449638906624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 396us (828us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.220196:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:0.0:1788572217.220202:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3653:x1875449638899072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.220212:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2103 count 1 00000100:00100000:0.0:1788572217.220314:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3653:x1875449638899072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 112us (771us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.220329:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:2.0:1788572217.220364:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3651:x1875449638907008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51us (440us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.220438:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:3.0:1788572217.220441:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755 00000100:00100000:3.0:1788572217.220448:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+9:3653:x1875449638899584:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.220454:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756 00000100:00100000:0.0:1788572217.220459:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638907136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.220460:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2107 count 1 00002000:00080000:0.0:1788572217.220468:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2132 count 1 00000100:00100000:0.0:1788572217.220501:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638907136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41us (790us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.220501:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+8:3653:x1875449638899584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54us (931us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.220508:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756 00000100:00100000:3.0:1788572217.220510:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755 00000100:00100000:3.0:1788572217.220520:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757 00000100:00100000:3.0:1788572217.220526:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638907264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.220537:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2133 count 1 00000100:00100000:3.0:1788572217.220579:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638907264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53us (828us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.220585:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757 00000100:00100000:1.0:1788572217.220588:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.220596:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638904448 00000100:00100000:3.0:1788572217.220599:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638904448 00000100:00100000:3.0:1788572217.220621:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758 00000100:00100000:3.0:1788572217.220626:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638904448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.220637:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2120 count 1 00000100:00100000:3.0:1788572217.220701:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638904448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 75us (112us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.220707:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758 00000004:00080000:1.0:1788572217.220728:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 124 changes, 1 in progress, 1 in flight, 7 done 00000100:00100000:1.0:1788572217.220785:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638907520:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.220813:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.220830:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638908032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.220848:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.220868:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638907520 00000004:00080000:1.0:1788572217.220871:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12d80, transno 0 00000100:00100000:3.0:1788572217.220873:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638907520 00000004:00080000:1.0:1788572217.220875:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12d80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.220883:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638904448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.220890:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572217.220892:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638908032 00000100:00100000:3.0:1788572217.220894:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638908032 00000100:00100000:1.0:1788572217.220895:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638907648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.220914:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.220929:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638908160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.220947:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.220967:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638907648 00000100:00100000:1.0:1788572217.220971:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638907648 00000100:00100000:3.0:1788572217.220983:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638908160 00000100:00100000:3.0:1788572217.220986:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638908160 00000100:00100000:1.0:1788572217.220988:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759 00000100:00100000:1.0:1788572217.220994:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638907520:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.221000:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760 00002000:00080000:1.0:1788572217.221021:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2127 count 1 00000100:00100000:3.0:1788572217.221022:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638908032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.221033:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2131 count 1 00000100:00100000:1.0:1788572217.221067:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638907520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 72us (253us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.221076:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759 00000100:00100000:1.0:1788572217.221090:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761 00000100:00100000:1.0:1788572217.221096:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638907648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.221108:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2128 count 1 00000100:00100000:1.0:1788572217.221146:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638907648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50us (230us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.221152:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761 00000100:00100000:3.0:1788572217.221153:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638908032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 149us (304us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.221159:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760 00000100:00100000:1.0:1788572217.221164:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762 00000100:00100000:1.0:1788572217.221169:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638908160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.221180:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2132 count 1 00000004:00000080:3.0:1788572217.221188:0:112013:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa895c342be10 00100000:10000000:3.0:1788572217.221197:0:112013:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:1.0:1788572217.221216:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638908160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47us (268us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.221222:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762 00000004:00080000:1.0:1788572217.221267:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 0 00000004:00080000:1.0:1788572217.221271:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11f80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.221275:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638907648:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.221282:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 0 00000004:00080000:1.0:1788572217.221284:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.221287:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638908160:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.221293:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13480, transno 0 00000004:00080000:1.0:1788572217.221295:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13480/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.221298:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638907520:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.221304:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10380, transno 0 00000004:00080000:1.0:1788572217.221306:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10380/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.221309:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638908032:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.221358:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 117 changes, 3 in progress, 3 in flight, 5 done 00000100:00100000:1.0:1788572217.221407:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638908544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.221428:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.221446:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572217.221451:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638908672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.221467:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.221493:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638908544 00000100:00100000:1.0:1788572217.221496:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638908544 00000100:00100000:1.0:1788572217.221513:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638908672 00000100:00100000:1.0:1788572217.221516:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638908672 00000100:00100000:1.0:1788572217.221529:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763 00000100:00100000:1.0:1788572217.221535:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638908544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.221545:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2135 count 1 00000100:00100000:1.0:1788572217.221588:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638908544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (158us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.221593:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763 00000100:00100000:1.0:1788572217.221605:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:1.0:1788572217.221611:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638908672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.221621:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2136 count 1 00000100:00100000:1.0:1788572217.221672:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638908672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 61us (204us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.221677:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000004:00080000:1.0:1788572217.221700:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13480, transno 0 00000004:00080000:1.0:1788572217.221702:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13480/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.221710:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638908672:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.221716:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 0 00000004:00080000:1.0:1788572217.221719:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.221722:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638908544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.221795:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638909056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.221817:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.221840:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638909056 00000100:00100000:1.0:1788572217.221843:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638909056 00000100:00100000:1.0:1788572217.221865:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00100000:1.0:1788572217.221871:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638909056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.221882:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2139 count 1 00000100:00100000:1.0:1788572217.221928:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638909056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 57us (110us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.221934:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000004:00080000:1.0:1788572217.221956:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 0 00000004:00080000:1.0:1788572217.221960:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.221967:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638909056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.222035:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572217.222041:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638909184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.222064:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.222086:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638909184 00000100:00100000:1.0:1788572217.222091:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638909184 00000100:00100000:1.0:1788572217.222110:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766 00000100:00100000:1.0:1788572217.222116:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638909184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.222127:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2140 count 1 00000100:00100000:1.0:1788572217.222170:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638909184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 54us (105us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.222175:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766 00000004:00080000:1.0:1788572217.222195:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 0 00000004:00080000:1.0:1788572217.222199:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.222205:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638909184:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.222396:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637594700, transno 0 00000004:00080000:3.0:1788572217.222400:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637594700/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.222409:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638907136:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.222417:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d180, transno 0 00000004:00080000:3.0:1788572217.222419:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d180/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.222422:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638907008:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.222429:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2ce00, transno 0 00000004:00080000:3.0:1788572217.222432:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2ce00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.222435:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638906624:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.222463:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638907776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.222493:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.222507:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638908288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.222523:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.222533:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638908800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.222549:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.222559:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638909312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.222577:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.222592:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637595c00, transno 0 00000004:00080000:3.0:1788572217.222595:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637595c00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.222598:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638907264:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.222605:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c000, transno 0 00000004:00080000:3.0:1788572217.222608:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2c000/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.222611:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638906880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.222668:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638907776 00000100:00100000:0.0:1788572217.222672:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638907776 00000100:00100000:0.0:1788572217.222693:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638908288 00000100:00100000:0.0:1788572217.222696:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638908288 00000100:00100000:0.0:1788572217.222714:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638908800 00000100:00100000:0.0:1788572217.222717:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638908800 00000100:00100000:0.0:1788572217.222731:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638909312 00000100:00100000:0.0:1788572217.222734:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638909312 00000100:00100000:0.0:1788572217.222747:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767 00000100:00100000:0.0:1788572217.222753:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638907776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.222766:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2129 count 1 00000004:00080000:3.0:1788572217.222779:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d500, transno 0 00000004:00080000:3.0:1788572217.222782:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d500/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.222814:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638907776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 60us (320us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.222820:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767 00000100:00100000:0.0:1788572217.222840:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768 00000100:00100000:0.0:1788572217.222846:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638908288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.222857:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2133 count 1 00000100:00100000:3.0:1788572217.222862:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638906752:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.222879:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10000, transno 0 00000004:00080000:3.0:1788572217.222882:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10000/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.222889:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638907776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.222894:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638908288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49us (370us total) trans 0 rc -2/-2 00000004:00080000:3.0:1788572217.222896:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12d80, transno 0 00000100:00100000:0.0:1788572217.222899:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768 00000100:00100000:0.0:1788572217.222910:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769 00000100:00100000:0.0:1788572217.222916:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638908800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.222926:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2137 count 1 00000100:00100000:0.0:1788572217.222967:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638908800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 51us (416us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.222972:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769 00000004:00080000:3.0:1788572217.222972:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12d80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.222976:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638908288:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.222983:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000004:00080000:3.0:1788572217.222986:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10380, transno 0 00000100:00100000:0.0:1788572217.222989:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638909312:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.222989:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10380/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.222992:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638908800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.222998:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00002000:00080000:0.0:1788572217.223000:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2141 count 1 00000100:00100000:3.0:1788572217.223027:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638907392:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.223049:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.223051:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638909312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 63us (474us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.223057:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770 00000100:00100000:0.0:1788572217.223066:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638907392 00000100:00100000:0.0:1788572217.223069:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638907392 00000100:00100000:0.0:1788572217.223089:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771 00000100:00100000:0.0:1788572217.223094:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638907392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.223105:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2126 count 1 00000100:00100000:3.0:1788572217.223126:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638907904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.223141:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638907392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47us (92us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.223146:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.223148:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771 00000100:00100000:3.0:1788572217.223155:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638908416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.223156:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638907904 00000100:00100000:0.0:1788572217.223159:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638907904 00000100:00100000:0.0:1788572217.223171:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772 00000100:00100000:3.0:1788572217.223172:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.223176:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638907904:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.223181:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638908928:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.223187:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2130 count 1 00000100:00100000:3.0:1788572217.223198:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.223222:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638907904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 45us (75us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.223228:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772 00000100:00100000:0.0:1788572217.223308:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638908416 00000100:00100000:0.0:1788572217.223312:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638908416 00000100:00100000:0.0:1788572217.223327:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773 00000100:00100000:0.0:1788572217.223333:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638908416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.223344:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2134 count 1 00000004:00080000:3.0:1788572217.223352:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 0 00000004:00080000:3.0:1788572217.223356:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.223360:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638909312:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.223368:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10700, transno 0 00000004:00080000:3.0:1788572217.223370:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10700/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.223374:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638907392:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.223380:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13b80, transno 0 00000100:00100000:0.0:1788572217.223381:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638908416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49us (208us total) trans 0 rc -2/-2 00000004:00080000:3.0:1788572217.223382:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13b80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.223386:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638907904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.223387:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773 00000004:00080000:3.0:1788572217.223392:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 0 00000004:00080000:3.0:1788572217.223394:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11f80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.223396:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638908928 00000100:00100000:3.0:1788572217.223397:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638908416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.223400:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638908928 00000100:00100000:0.0:1788572217.223412:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1788572217.223416:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638908928:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.223422:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931f80, transno 0 00000004:00080000:3.0:1788572217.223424:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931f80/1, rc -2, transno 0 00002000:00080000:0.0:1788572217.223426:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2138 count 1 00000100:00100000:3.0:1788572217.223428:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638899072:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.223436:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641694e00, transno 0 00000004:00080000:3.0:1788572217.223439:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641694e00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.223442:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638899584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.223472:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638908928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 55us (273us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.223478:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774 00000004:00080000:3.0:1788572217.223556:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 116 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:3.0:1788572217.223662:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638909568:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.223688:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572217.223703:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 108 changes, 1 in progress, 1 in flight, 7 done 00000100:00100000:3.0:1788572217.223705:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638910080:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.223723:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.223739:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638910592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.223757:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.223772:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638911104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.223866:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.223883:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788572217.223888:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638909696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.224999:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638909568 00000100:00100000:0.0:1788572217.225040:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638909568 00000100:00100000:0.0:1788572217.225077:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638910080 00000100:00100000:0.0:1788572217.225081:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638910080 00000100:00100000:0.0:1788572217.225098:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638910592 00000100:00100000:0.0:1788572217.225101:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638910592 00000100:00100000:0.0:1788572217.225115:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638911104 00000100:00100000:0.0:1788572217.225117:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638911104 00000100:00100000:0.0:1788572217.225135:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775 00000100:00100000:0.0:1788572217.225141:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638909568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.225164:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2135 count 1 00000100:00100000:1.0:1788572217.226811:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776 00000100:00100000:1.0:1788572217.226833:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638910080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.226862:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2139 count 1 00000100:00100000:2.0:1788572217.227871:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751 00000100:00100000:2.0:1788572217.227913:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:2.0:1788572217.227928:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638910592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.227948:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2143 count 1 00000100:00100000:3.0:1788572217.229767:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.229775:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638909568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4632us (6084us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.229789:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775 00000100:00100000:0.0:1788572217.229825:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638909696 00000100:00100000:3.0:1788572217.229830:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638910208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.229832:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638909696 00000100:00100000:3.0:1788572217.229868:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.229872:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:0.0:1788572217.229880:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638911104:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.229886:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638910720:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.229910:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2147 count 1 00000100:00100000:3.0:1788572217.229920:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.229937:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638911232:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.229957:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.229991:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b4000, transno 0 00000100:00100000:0.0:1788572217.229997:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638911104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 119us (6132us total) trans 0 rc -2/-2 00000004:00080000:3.0:1788572217.229999:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b4000/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.230018:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00100000:0.0:1788572217.230029:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638910208 00000100:00100000:0.0:1788572217.230032:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638910208 00000100:00100000:0.0:1788572217.230048:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638910720 00000100:00100000:0.0:1788572217.230050:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638910720 00000100:00100000:0.0:1788572217.230065:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638911232 00000100:00100000:0.0:1788572217.230067:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638911232 00000100:00100000:0.0:1788572217.230081:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779 00000100:00100000:0.0:1788572217.230086:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638909696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.230098:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2136 count 1 00000100:00100000:0.0:1788572217.230147:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638909696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 60us (387us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.230152:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779 00000100:00100000:0.0:1788572217.230163:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780 00000100:00100000:0.0:1788572217.230169:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638910208:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.230171:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638909568:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.230178:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2140 count 1 00000004:00080000:3.0:1788572217.230187:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b5880, transno 0 00000004:00080000:3.0:1788572217.230190:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b5880/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.230194:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638909696:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.230216:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13b80, transno 0 00000100:00100000:0.0:1788572217.230217:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638910208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (348us total) trans 0 rc -2/-2 00000004:00080000:3.0:1788572217.230219:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13b80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.230223:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780 00000100:00100000:3.0:1788572217.230230:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638911104:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.230240:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57c700, transno 0 00000004:00080000:3.0:1788572217.230242:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57c700/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.230246:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638910208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.230310:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781 00000100:00100000:0.0:1788572217.230317:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638910720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.230329:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2144 count 1 00000100:00100000:0.0:1788572217.230400:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638910720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 83us (478us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.230406:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781 00000100:00100000:0.0:1788572217.230420:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782 00000100:00100000:0.0:1788572217.230426:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638911232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.230436:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2148 count 1 00000100:00100000:0.0:1788572217.230474:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638911232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49us (516us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.230480:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782 00000100:00100000:0.0:1788572217.230524:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638909440:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.230552:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.230571:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638909952:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.230590:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.230604:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638910464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.230623:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.230639:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638909440 00000100:00100000:0.0:1788572217.230643:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638909440 00000100:00100000:0.0:1788572217.230673:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638909952 00000100:00100000:0.0:1788572217.230676:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638909952 00000100:00100000:0.0:1788572217.230686:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638910464 00000100:00100000:0.0:1788572217.230689:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638910464 00000100:00100000:0.0:1788572217.230702:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783 00000100:00100000:0.0:1788572217.230708:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638909440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.230719:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2134 count 1 00000100:00100000:0.0:1788572217.230763:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638909440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55us (210us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.230769:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783 00000100:00100000:0.0:1788572217.230780:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2784 00000100:00100000:0.0:1788572217.230786:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638909952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.230797:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2138 count 1 00000100:00100000:0.0:1788572217.230833:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638909952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 47us (242us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.230838:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2784 00000100:00100000:0.0:1788572217.230849:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785 00000100:00100000:0.0:1788572217.230854:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638910464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.230864:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2142 count 1 00000100:00100000:0.0:1788572217.230900:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638910464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 46us (276us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.230906:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785 00000004:00080000:0.0:1788572217.230935:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10000, transno 0 00000004:00080000:0.0:1788572217.230939:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10000/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.230944:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638910464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.230950:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638910976:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.230971:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.230990:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638910976 00000100:00100000:0.0:1788572217.230993:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638910976 00000100:00100000:0.0:1788572217.231034:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786 00000100:00100000:0.0:1788572217.231041:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638910976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.231051:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2146 count 1 00000100:00100000:0.0:1788572217.231093:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638910976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 51us (119us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.231099:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786 00000004:00080000:0.0:1788572217.231121:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10700, transno 0 00000004:00080000:0.0:1788572217.231124:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10700/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.231128:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638910976:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.231142:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b7b80, transno 0 00000004:00080000:0.0:1788572217.231144:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b7b80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.231147:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638909440:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.231153:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57ce00, transno 0 00000004:00080000:0.0:1788572217.231156:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57ce00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.231158:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638909952:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.231165:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572217.231171:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638909824:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.231193:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.231208:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638910336:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.231226:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.231321:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638909824 00000100:00100000:0.0:1788572217.231325:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638909824 00000100:00100000:0.0:1788572217.231343:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638910336 00000100:00100000:0.0:1788572217.231346:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638910336 00000100:00100000:0.0:1788572217.231361:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787 00000100:00100000:0.0:1788572217.231365:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638909824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.231377:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2137 count 1 00000100:00100000:0.0:1788572217.231417:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638909824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (222us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.231422:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787 00000100:00100000:0.0:1788572217.231434:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:0.0:1788572217.231440:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638910336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.231451:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2141 count 1 00000100:00100000:0.0:1788572217.231488:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638910336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (260us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.231495:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000004:00080000:0.0:1788572217.231524:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc45c00, transno 0 00000004:00080000:0.0:1788572217.231528:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc45c00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.231532:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638910336:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.231537:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638910848:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.231557:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.231576:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638910848 00000100:00100000:0.0:1788572217.231579:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638910848 00000100:00100000:0.0:1788572217.231600:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:0.0:1788572217.231606:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638910848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.231616:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2145 count 1 00000100:00100000:0.0:1788572217.231668:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638910848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 61us (109us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.231674:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000004:00080000:0.0:1788572217.231696:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 0 00000004:00080000:0.0:1788572217.231700:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.231704:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638910848:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.231712:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d4b0380, transno 0 00000004:00080000:0.0:1788572217.231715:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d4b0380/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.231717:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638909824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.231986:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638910080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5162us (8259us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.231993:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776 00000004:00080000:1.0:1788572217.232130:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 101 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:0.0:1788572217.232320:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638911488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.232349:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.232377:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572217.232383:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638911360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.232405:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.232427:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638911488 00000100:00100000:0.0:1788572217.232431:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638911488 00000100:00100000:0.0:1788572217.232453:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790 00000100:00100000:0.0:1788572217.232459:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638911488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.232475:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2150 count 1 00000100:00100000:0.0:1788572217.232525:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638911488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 66us (175us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.232531:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790 00000100:00100000:0.0:1788572217.232541:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638911360 00000100:00100000:0.0:1788572217.232544:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638911360 00000100:00100000:0.0:1788572217.232564:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:0.0:1788572217.232570:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638911360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.232581:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2149 count 1 00000100:00100000:0.0:1788572217.232620:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638911360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50us (213us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.232626:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000004:00080000:0.0:1788572217.232666:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13b80, transno 0 00000004:00080000:0.0:1788572217.232671:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13b80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.232678:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638911360:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.232687:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10000, transno 0 00000004:00080000:0.0:1788572217.232690:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10000/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.232693:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638911488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.232840:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572217.232928:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638910592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5008us (9169us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.232936:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777 00000100:00100000:0.0:1788572217.233084:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638912000:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.233110:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.233179:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638911872:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.233199:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.233400:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638912000 00000100:00100000:2.0:1788572217.233405:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638912000 00000100:00100000:2.0:1788572217.233436:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638911872 00000100:00100000:2.0:1788572217.233439:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638911872 00000100:00100000:2.0:1788572217.233457:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:2.0:1788572217.233463:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638912000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.233475:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2154 count 1 00000100:00100000:2.0:1788572217.233526:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638912000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 63us (413us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.233531:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00100000:3.0:1788572217.233534:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638911744:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.233545:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:2.0:1788572217.233550:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638911872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.233560:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2153 count 1 00000100:00100000:3.0:1788572217.233561:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.233584:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572217.233590:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638911616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.233595:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449638911872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 45us (396us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.233601:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:3.0:1788572217.233607:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.233612:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638911744 00000100:00100000:2.0:1788572217.233615:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638911744 00000100:00100000:2.0:1788572217.233674:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638911616 00000100:00100000:2.0:1788572217.233679:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638911616 00000100:00100000:1.0:1788572217.233709:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00100000:1.0:1788572217.233717:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638911744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.233729:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2152 count 1 00000100:00100000:1.0:1788572217.233778:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638911744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 62us (216us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.233783:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00000100:00100000:1.0:1788572217.233795:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00100000:1.0:1788572217.233801:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638911616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.233811:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2151 count 1 00000100:00100000:1.0:1788572217.233847:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638911616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47us (238us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.233853:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00000004:00080000:1.0:1788572217.238897:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10700, transno 0 00000004:00080000:1.0:1788572217.238911:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10700/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.238929:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638911616:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.238943:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 0 00000004:00080000:1.0:1788572217.238946:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.238950:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638911744:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.239152:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638912256:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.239215:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.240410:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572217.240428:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638912128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.240476:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.240527:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638912256 00000100:00100000:1.0:1788572217.240535:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638912256 00000100:00100000:1.0:1788572217.240576:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638912128 00000100:00100000:1.0:1788572217.240578:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638912128 00000100:00100000:1.0:1788572217.240596:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796 00000100:00100000:1.0:1788572217.240604:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638912256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.240633:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2156 count 1 00000100:00100000:1.0:1788572217.240743:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638912256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 137us (1527us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.240751:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796 00000100:00100000:1.0:1788572217.240769:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:1.0:1788572217.240776:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638912128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.240788:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2155 count 1 00000100:00100000:1.0:1788572217.240828:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638912128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (352us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.240834:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000004:00080000:1.0:1788572217.240875:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10700, transno 0 00000004:00080000:1.0:1788572217.240881:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10700/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.240892:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638912128:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.240902:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 0 00000004:00080000:1.0:1788572217.240904:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.240907:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638912256:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.241987:0:112001:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x991:0x0] 00000100:00100000:3.0:1788572217.242047:0:112001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:112001:1875449638912640:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788572217.242098:0:112001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.242131:0:112001:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e6184b0f00 going to sleep for 11 seconds 00000004:00080000:3.0:1788572217.242545:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10380, transno 0 00000004:00080000:3.0:1788572217.242552:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10380/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.242562:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638910720:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.242573:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 0 00000004:00080000:3.0:1788572217.242576:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11f80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.242579:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638911232:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.242587:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12d80, transno 0 00000004:00080000:3.0:1788572217.242589:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12d80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.242592:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638910592:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.242602:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57f480, transno 0 00000004:00080000:3.0:1788572217.242605:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57f480/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.242608:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638910080:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.242630:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638912384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.242669:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.242692:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13480, transno 0 00000004:00080000:3.0:1788572217.242696:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13480/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.242699:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638908928:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.242707:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572217.242713:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638912512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.242735:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.242845:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 108 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:3.0:1788572217.242927:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638912768:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.242952:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.242968:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638913280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.242987:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.243029:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572217.243035:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638912896:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.243056:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.243079:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638912640 00000100:00100000:3.0:1788572217.243086:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638912640 00000100:00100000:3.0:1788572217.243120:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638912384 00000100:00100000:3.0:1788572217.243123:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638912384 00000100:00100000:3.0:1788572217.243136:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638912512 00000100:00100000:3.0:1788572217.243139:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638912512 00000100:00100000:3.0:1788572217.243152:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638912768 00000100:00100000:3.0:1788572217.243154:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638912768 00000100:00100000:3.0:1788572217.243168:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638913280 00000100:00100000:3.0:1788572217.243171:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638913280 00000100:00100000:3.0:1788572217.243182:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638912896 00000100:00100000:3.0:1788572217.243184:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638912896 00000100:00100000:3.0:1788572217.243199:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:3.0:1788572217.243206:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:112001:x1875449638912640:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788572217.243350:0:43964:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 2465 -> diff = -16 00002000:02000040:3.0:1788572217.243356:0:43964:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:2450 to 0x2c0000401:2465) 00000100:00100000:0.0:1788572217.244018:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:0.0:1788572217.244038:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800 00000100:00100000:0.0:1788572217.244049:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638912512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.244068:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2158 count 1 00000100:00100000:0.0:1788572217.244160:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638912512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 116us (1423us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.244167:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800 00000100:00100000:0.0:1788572217.244184:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:0.0:1788572217.244191:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638912768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.244202:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2142 count 1 00000100:00100000:0.0:1788572217.244266:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638912768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 76us (1313us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.244383:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00100000:0.0:1788572217.244397:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802 00000100:00100000:0.0:1788572217.244405:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638913280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.244418:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2146 count 1 00000100:00100000:0.0:1788572217.244463:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638913280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59us (1474us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.244469:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802 00000100:00100000:0.0:1788572217.244481:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:0.0:1788572217.244487:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638912896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.244498:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2143 count 1 00000100:00100000:0.0:1788572217.244538:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638912896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51us (1480us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.244544:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:0.0:1788572217.244589:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638912384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.244602:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2157 count 1 00000100:00100000:0.0:1788572217.244646:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638912384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 619us (1977us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.244665:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000004:00080000:1.0:1788572217.245029:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 91 changes, 4 in progress, 4 in flight, 4 done 00000004:00080000:2.0:1788572217.245188:0:111999:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x991:0x0] 00000100:00100000:2.0:1788572217.245213:0:111999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:111999:1875449638914304:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788572217.245258:0:111999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.245400:0:111999:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e60fac7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572217.245419:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638914304 00000100:00100000:2.0:1788572217.245426:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638914304 00000100:00100000:2.0:1788572217.245460:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804 00000100:00100000:2.0:1788572217.245467:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:111999:x1875449638914304:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788572217.245486:0:8464:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 2465 -> diff = -16 00002000:02000040:2.0:1788572217.245490:0:8464:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:2450 to 0x280000401:2465) 00000100:00100000:0.0:1788572217.245573:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638913920:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.245606:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.245628:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572217.245634:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638913792:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.245668:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.245690:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638913920 00000100:00100000:0.0:1788572217.245695:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638913920 00000100:00100000:0.0:1788572217.245716:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638913792 00000100:00100000:0.0:1788572217.245719:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638913792 00000100:00100000:0.0:1788572217.245735:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:0.0:1788572217.245742:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638913920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.245755:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2160 count 1 00000100:00100000:0.0:1788572217.245821:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638913920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 79us (213us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.245828:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00100000:0.0:1788572217.245842:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:0.0:1788572217.245849:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638913792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.245861:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2159 count 1 00000100:00100000:0.0:1788572217.245899:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638913792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 51us (231us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.245905:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00000004:00080000:0.0:1788572217.245941:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10380, transno 0 00000004:00080000:0.0:1788572217.245948:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10380/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.245956:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638913792:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.245964:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 0 00000004:00080000:0.0:1788572217.245967:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11f80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.245970:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638913920:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.247450:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638914560:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.247498:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.247532:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572217.247538:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638914432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.247561:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.247627:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638914560 00000100:00100000:1.0:1788572217.247634:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638914560 00000100:00100000:1.0:1788572217.247686:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638914432 00000100:00100000:1.0:1788572217.247689:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638914432 00000100:00100000:1.0:1788572217.247711:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:1.0:1788572217.247719:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638914560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.247741:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2164 count 1 00000100:00100000:1.0:1788572217.247809:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638914560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 91us (309us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.247816:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807 00000100:00100000:1.0:1788572217.247831:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808 00000100:00100000:1.0:1788572217.247838:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50384e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638914432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.247848:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2163 count 1 00000100:00100000:1.0:1788572217.247890:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50384e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638914432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (328us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.247895:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808 00000004:00080000:0.0:1788572217.247969:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10380, transno 0 00000004:00080000:0.0:1788572217.247975:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10380/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.247990:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638914432:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.248000:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 0 00000004:00080000:0.0:1788572217.248026:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11f80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.248030:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638914560:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.252200:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638913152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.252412:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.252450:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638913664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.252472:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.252495:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638914176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.252517:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.252545:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638913152 00000100:00100000:0.0:1788572217.252554:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638913152 00000100:00100000:0.0:1788572217.252604:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638913664 00000100:00100000:0.0:1788572217.252607:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638913664 00000100:00100000:0.0:1788572217.252621:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638914176 00000100:00100000:0.0:1788572217.252623:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638914176 00000100:00100000:0.0:1788572217.252643:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:0.0:1788572217.252666:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638913152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.252696:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2145 count 1 00000100:00100000:0.0:1788572217.252789:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638913152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 137us (378us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.252797:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00100000:0.0:1788572217.252814:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:0.0:1788572217.252820:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638913664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.252830:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2149 count 1 00000100:00100000:0.0:1788572217.252870:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638913664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (396us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.252876:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00100000:0.0:1788572217.252888:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811 00000100:00100000:0.0:1788572217.252894:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638914176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.252905:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2162 count 1 00000100:00100000:0.0:1788572217.252952:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638914176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 58us (432us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.252958:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811 00000004:00080000:0.0:1788572217.252997:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13480, transno 0 00000004:00080000:0.0:1788572217.253030:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13480/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.253055:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638914176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.253063:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638914816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.253085:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.253106:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638914816 00000100:00100000:0.0:1788572217.253110:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638914816 00000100:00100000:0.0:1788572217.253134:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812 00000100:00100000:0.0:1788572217.253140:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638914816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.253151:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2166 count 1 00000100:00100000:0.0:1788572217.253193:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638914816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (107us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.253200:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812 00000004:00080000:0.0:1788572217.253222:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799180, transno 0 00000004:00080000:0.0:1788572217.253226:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637799180/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.253354:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638914816:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.253372:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10000, transno 0 00000004:00080000:0.0:1788572217.253376:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10000/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.253380:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638912000:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.253389:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13b80, transno 0 00000004:00080000:0.0:1788572217.253392:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13b80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.253395:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638911872:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.253412:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d180, transno 0 00000004:00080000:0.0:1788572217.253414:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d180/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.253428:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638913152:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.253437:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d4b0380, transno 0 00000004:00080000:0.0:1788572217.253439:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d4b0380/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.253443:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638913664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.253450:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788572217.253457:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638913024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.253481:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.253500:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638913536:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.253520:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.253536:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638914048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.253555:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.253571:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638914688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.253589:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.253611:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638913024 00000100:00100000:0.0:1788572217.253615:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638913024 00000100:00100000:0.0:1788572217.253636:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638913536 00000100:00100000:0.0:1788572217.253639:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638913536 00000100:00100000:0.0:1788572217.253665:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638914048 00000100:00100000:0.0:1788572217.253668:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638914048 00000100:00100000:0.0:1788572217.253682:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638914688 00000100:00100000:0.0:1788572217.253685:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638914688 00000100:00100000:0.0:1788572217.253701:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1788572217.253708:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638913024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.253722:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2144 count 1 00000100:00100000:0.0:1788572217.253773:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638913024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 65us (291us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.253779:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1788572217.253792:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814 00000100:00100000:0.0:1788572217.253798:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638913536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.253808:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2148 count 1 00000100:00100000:0.0:1788572217.253848:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638913536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (326us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.253854:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814 00000100:00100000:0.0:1788572217.253866:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:0.0:1788572217.253872:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638914048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.253883:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2161 count 1 00000100:00100000:0.0:1788572217.253925:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638914048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (368us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.253930:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00100000:0.0:1788572217.253942:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816 00000100:00100000:0.0:1788572217.253947:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638914688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.253957:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2165 count 1 00000100:00100000:0.0:1788572217.253995:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638914688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48us (404us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.254001:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816 00000004:00080000:0.0:1788572217.254174:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 83 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:0.0:1788572217.254497:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638915072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.254526:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.254548:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572217.254554:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638914944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.254574:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.254598:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638915072 00000100:00100000:0.0:1788572217.254603:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638915072 00000100:00100000:0.0:1788572217.254625:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638914944 00000100:00100000:0.0:1788572217.254629:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638914944 00000100:00100000:0.0:1788572217.254647:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:0.0:1788572217.254665:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638915072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.254679:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2168 count 1 00000100:00100000:0.0:1788572217.254754:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638915072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 90us (227us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.254761:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00000100:00100000:0.0:1788572217.254774:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1788572217.254780:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638914944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.254791:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2167 count 1 00000100:00100000:0.0:1788572217.254829:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638914944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50us (255us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.254838:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818 00000004:00080000:0.0:1788572217.254874:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799180, transno 0 00000004:00080000:0.0:1788572217.254880:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637799180/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.254889:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638914944:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.254897:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779a300, transno 0 00000004:00080000:0.0:1788572217.254899:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63779a300/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.254902:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638915072:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.254919:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50384df80, transno 0 00000004:00080000:0.0:1788572217.254922:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e50384df80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.254926:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638914688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.254934:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638915328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.254955:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.254975:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638915328 00000100:00100000:0.0:1788572217.254978:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638915328 00000100:00100000:0.0:1788572217.254999:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1788572217.255029:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638915328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.255162:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2170 count 1 00000100:00100000:0.0:1788572217.255209:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638915328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 204us (253us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.255216:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00000004:00080000:0.0:1788572217.255253:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779aa00, transno 0 00000004:00080000:0.0:1788572217.255257:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63779aa00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.255261:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638915328:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.255335:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c000, transno 0 00000004:00080000:0.0:1788572217.255339:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2c000/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.255344:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638913024:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.255354:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b7b80, transno 0 00000004:00080000:0.0:1788572217.255357:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b7b80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.255361:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638913536:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.255368:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12d80, transno 0 00000004:00080000:0.0:1788572217.255370:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12d80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.255373:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638914048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.255381:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572217.255387:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638915200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.255411:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.255431:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638915200 00000100:00100000:0.0:1788572217.255434:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638915200 00000100:00100000:0.0:1788572217.255454:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:0.0:1788572217.255459:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638915200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.255471:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2169 count 1 00000100:00100000:0.0:1788572217.255513:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638915200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (100us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.255519:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00000004:00080000:0.0:1788572217.255542:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798700, transno 0 00000004:00080000:0.0:1788572217.255546:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637798700/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.255550:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638915200:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.255635:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 79 changes, 2 in progress, 2 in flight, 6 done 00000100:00100000:0.0:1788572217.255816:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638915584:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.255839:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.255855:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638916096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.255874:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.255890:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788572217.255895:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638915456:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.255914:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.255928:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638915968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.255945:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.255968:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638915584 00000100:00100000:0.0:1788572217.255971:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638915584 00000100:00100000:0.0:1788572217.255991:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638916096 00000100:00100000:0.0:1788572217.255994:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638916096 00000100:00100000:0.0:1788572217.256028:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638915456 00000100:00100000:0.0:1788572217.256031:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638915456 00000100:00100000:0.0:1788572217.256060:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638915968 00000100:00100000:0.0:1788572217.256064:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638915968 00000100:00100000:0.0:1788572217.256077:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821 00000100:00100000:0.0:1788572217.256083:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3651:x1875449638915584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.256095:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2172 count 1 00000100:00100000:0.0:1788572217.256145:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3651:x1875449638915584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 62us (305us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.256152:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821 00000100:00100000:0.0:1788572217.256163:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000100:00100000:0.0:1788572217.256168:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638916096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.256179:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2176 count 1 00000100:00100000:0.0:1788572217.256217:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638916096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49us (341us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.256223:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00000100:00100000:0.0:1788572217.256246:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823 00000100:00100000:0.0:1788572217.256253:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638915456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.256263:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2171 count 1 00000100:00100000:0.0:1788572217.256461:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638915456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 208us (545us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.256467:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823 00000004:00080000:3.0:1788572217.256469:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2ce00, transno 0 00000004:00080000:3.0:1788572217.256473:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2ce00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.256478:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824 00000100:00100000:3.0:1788572217.256478:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638912896:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.256484:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638915968:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.256488:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638913408:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.256494:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2175 count 1 00000100:00100000:3.0:1788572217.256513:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.256528:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638915968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 44us (581us total) trans 0 rc -2/-2 00000004:00080000:3.0:1788572217.256530:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d880, transno 0 00000004:00080000:3.0:1788572217.256533:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d880/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.256534:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824 00000100:00100000:3.0:1788572217.256537:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638912768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.256542:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638913408 00000100:00100000:0.0:1788572217.256545:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638913408 00000004:00080000:3.0:1788572217.256545:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b4000, transno 0 00000004:00080000:3.0:1788572217.256547:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b4000/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.256550:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638913280:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.256558:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:0.0:1788572217.256563:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638913408:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.256566:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638915712:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.256574:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2147 count 1 00000100:00100000:3.0:1788572217.256588:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.256603:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 0 00000004:00080000:3.0:1788572217.256606:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.256618:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638912512:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.256621:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638913408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 58us (108us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.256627:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00000004:00080000:3.0:1788572217.256627:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10700, transno 0 00000004:00080000:3.0:1788572217.256629:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10700/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.256632:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638912384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.256636:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638915712 00000100:00100000:0.0:1788572217.256638:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638915712 00000100:00100000:3.0:1788572217.256640:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572217.256644:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638915840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.256662:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826 00000100:00100000:0.0:1788572217.256668:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638915712:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.256678:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788572217.256679:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2173 count 1 00000004:00080000:3.0:1788572217.256700:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b5880, transno 0 00000004:00080000:3.0:1788572217.256703:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b5880/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.256707:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638913408:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.256721:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638915712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (132us total) trans 0 rc -2/-2 00000004:00080000:3.0:1788572217.256722:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637715880, transno 0 00000004:00080000:3.0:1788572217.256725:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637715880/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.256727:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826 00000100:00100000:3.0:1788572217.256728:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638915712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.256736:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638915840 00000100:00100000:0.0:1788572217.256739:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638915840 00000100:00100000:0.0:1788572217.256751:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827 00000100:00100000:0.0:1788572217.256756:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638915840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.256764:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2174 count 1 00000100:00100000:0.0:1788572217.256807:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638915840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50us (127us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.256812:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827 00000004:00080000:0.0:1788572217.256856:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637715500, transno 0 00000004:00080000:0.0:1788572217.256861:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637715500/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.256865:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638915456:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.256873:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637717800, transno 0 00000004:00080000:0.0:1788572217.256875:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637717800/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.256878:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638915968:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.256884:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637714000, transno 0 00000004:00080000:0.0:1788572217.256886:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637714000/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.256889:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638915584:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.256897:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50384df80, transno 0 00000004:00080000:0.0:1788572217.256899:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e50384df80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.256902:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638916096:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.258028:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 100 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:0.0:1788572217.258390:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638916352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.258410:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638916480:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.258679:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.258716:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638916992:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.258739:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.258762:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572217.258768:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638916608:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.259400:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.259428:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638917120:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.259455:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.259494:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638916224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.259517:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.259534:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638916736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.259553:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.259584:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637717100, transno 0 00000004:00080000:3.0:1788572217.259591:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637717100/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.259597:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638915840:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.259606:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572217.259611:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638916864:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.259633:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.259809:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638916480 00000100:00100000:3.0:1788572217.259816:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638916480 00000100:00100000:3.0:1788572217.259858:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638916992 00000100:00100000:3.0:1788572217.259861:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638916992 00000100:00100000:3.0:1788572217.259879:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638916608 00000100:00100000:3.0:1788572217.259882:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638916608 00000100:00100000:3.0:1788572217.259892:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638917120 00000100:00100000:3.0:1788572217.259894:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638917120 00000100:00100000:3.0:1788572217.259903:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638916224 00000100:00100000:3.0:1788572217.259906:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638916224 00000100:00100000:3.0:1788572217.259914:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638916736 00000100:00100000:3.0:1788572217.259917:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638916736 00000100:00100000:3.0:1788572217.259926:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638916864 00000100:00100000:3.0:1788572217.259928:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638916864 00000100:00100000:3.0:1788572217.259941:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:3.0:1788572217.259948:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3650:x1875449638916480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.259976:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2152 count 1 00000100:00100000:1.0:1788572217.259997:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:1.0:1788572217.260023:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3650:x1875449638916992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.260036:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2156 count 1 00000100:00100000:1.0:1788572217.260092:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3650:x1875449638916992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 89us (1352us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.260092:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3650:x1875449638916480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 144us (1413us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.260100:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00000100:00100000:1.0:1788572217.260103:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00100000:1.0:1788572217.260116:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830 00000100:00100000:1.0:1788572217.260122:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449638916608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.260138:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2153 count 1 00000100:00100000:1.0:1788572217.260181:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449638916608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59us (781us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.261412:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.261457:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638916352 00000100:00100000:0.0:1788572217.261464:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638916352 00000100:00100000:3.0:1788572217.261888:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:3.0:1788572217.261902:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3650:x1875449638917120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.261930:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2157 count 1 00000100:00100000:3.0:1788572217.262033:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3650:x1875449638917120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 136us (2576us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.262040:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00100000:3.0:1788572217.262157:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:3.0:1788572217.262165:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638916224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.262179:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2150 count 1 00000100:00100000:3.0:1788572217.262426:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638916224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 261us (2907us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.262433:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00000100:00100000:3.0:1788572217.262447:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833 00000100:00100000:3.0:1788572217.262454:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638916736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.262467:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2154 count 1 00000100:00100000:3.0:1788572217.262510:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638916736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57us (2956us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.262516:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833 00000100:00100000:3.0:1788572217.262530:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834 00000100:00100000:3.0:1788572217.262537:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638916864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.262548:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2155 count 1 00000100:00100000:3.0:1788572217.262587:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638916864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (2952us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.262593:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834 00000004:00080000:3.0:1788572217.262635:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae69180, transno 0 00000004:00080000:3.0:1788572217.262643:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae69180/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.262664:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638916608:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.262676:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d180, transno 0 00000004:00080000:3.0:1788572217.262679:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d180/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.262683:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638917120:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.262691:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6bb80, transno 0 00000004:00080000:3.0:1788572217.262694:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae6bb80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.262697:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638916480:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.262706:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d4b0380, transno 0 00000004:00080000:3.0:1788572217.262707:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d4b0380/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.262710:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638916992:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.262731:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6a680, transno 0 00000004:00080000:3.0:1788572217.262734:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae6a680/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.262737:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638916864:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.262747:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae69500, transno 0 00000004:00080000:3.0:1788572217.262749:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae69500/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.262751:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638916224:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.262759:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae69f80, transno 0 00000004:00080000:3.0:1788572217.262761:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae69f80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.262764:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638916736:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.263850:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 92 changes, 1 in progress, 1 in flight, 7 done 00000100:00100000:3.0:1788572217.263957:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638917632:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.263995:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830 00000100:00100000:3.0:1788572217.264019:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.264033:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638917632 00000100:00100000:1.0:1788572217.264038:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638917632 00000100:00100000:3.0:1788572217.264049:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572217.264064:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835 00000100:00100000:1.0:1788572217.264071:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638917632:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.264071:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638917504:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.264091:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2161 count 1 00000100:00100000:3.0:1788572217.264093:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.264104:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638918016:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.264123:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.264144:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638917248:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.264156:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638917632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 86us (136us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.264163:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835 00000100:00100000:3.0:1788572217.264164:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.264173:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638917760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.264174:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638917504 00000100:00100000:1.0:1788572217.264177:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638917504 00000100:00100000:1.0:1788572217.264188:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638918016 00000100:00100000:3.0:1788572217.264189:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.264190:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638918016 00000100:00100000:1.0:1788572217.264199:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638917248 00000100:00100000:1.0:1788572217.264201:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638917248 00000100:00100000:1.0:1788572217.264210:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638917760 00000100:00100000:1.0:1788572217.264212:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638917760 00000100:00100000:3.0:1788572217.264212:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572217.264217:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638917376:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.264222:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836 00000100:00100000:1.0:1788572217.264226:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449638917504:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.264235:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.264245:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638917888:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.264248:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2160 count 1 00000100:00100000:3.0:1788572217.264261:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.264358:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449638917504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 130us (263us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.264366:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836 00000100:00100000:1.0:1788572217.264376:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638917376 00000100:00100000:1.0:1788572217.264379:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638917376 00000100:00100000:1.0:1788572217.264391:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638917888 00000100:00100000:1.0:1788572217.264392:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638917888 00000100:00100000:1.0:1788572217.264403:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837 00000100:00100000:1.0:1788572217.264408:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+11:3651:x1875449638918016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.264419:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2164 count 1 00000100:00100000:1.0:1788572217.264460:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+11:3651:x1875449638918016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52us (336us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.264467:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837 00000100:00100000:1.0:1788572217.264478:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:1.0:1788572217.264483:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638917248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.264494:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2158 count 1 00000100:00100000:1.0:1788572217.264529:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638917248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46us (363us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.264534:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:1.0:1788572217.264545:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839 00000100:00100000:1.0:1788572217.264549:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638917760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.264559:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2162 count 1 00000100:00100000:1.0:1788572217.264593:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638917760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44us (403us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.264599:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839 00000100:00100000:1.0:1788572217.264610:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:1.0:1788572217.264616:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638917376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.264626:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2159 count 1 00000004:00080000:3.0:1788572217.264660:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6300, transno 0 00000004:00080000:3.0:1788572217.264666:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a6300/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.264674:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638917376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 58us (438us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.264677:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638917248:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.264680:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000004:00080000:3.0:1788572217.264686:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4380, transno 0 00000004:00080000:3.0:1788572217.264689:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a4380/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.264691:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:3.0:1788572217.264693:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638917760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.264697:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638917888:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.264700:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a7b80, transno 0 00000004:00080000:3.0:1788572217.264702:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a7b80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.264706:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638917376:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.264707:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2163 count 1 00000004:00080000:3.0:1788572217.264723:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a7800, transno 0 00000004:00080000:3.0:1788572217.264726:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a7800/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.264729:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638917504:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.264737:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4e00, transno 0 00000004:00080000:3.0:1788572217.264740:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a4e00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.264743:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638918016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.264745:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638917888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (483us total) trans 0 rc -2/-2 00000004:00080000:3.0:1788572217.264749:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5180, transno 0 00000100:00100000:1.0:1788572217.264751:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000004:00080000:3.0:1788572217.264751:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a5180/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.264754:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638917632:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.264767:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6d80, transno 0 00000004:00080000:3.0:1788572217.264770:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a6d80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.264773:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638917888:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.264901:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 85 changes, 1 in progress, 1 in flight, 7 done 00000100:00100000:3.0:1788572217.264970:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638918144:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.264993:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1788572217.265119:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.265128:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b550e4f/0xdb7edb52b831ec69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.265145:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a1:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.265150:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.265156:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b550e4f/0xdb7edb52b831ec69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.265172:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b550e4f/0xdb7edb52b831ec69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572217.265175:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638918656:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572217.265184:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b550e4f/0xdb7edb52b831ec69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.265193:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b550e4f/0xdb7edb52b831ec69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572217.265195:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572217.265213:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572217.265346:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638918144 00000100:00100000:0.0:1788572217.265352:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638918144 00000100:00100000:0.0:1788572217.265384:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842 00000100:00100000:0.0:1788572217.265391:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638916352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.265405:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2151 count 1 00000100:00100000:0.0:1788572217.265456:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449638916352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 65us (5188us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.265462:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842 00000100:00100000:0.0:1788572217.265546:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843 00000100:00100000:0.0:1788572217.265552:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638918144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.265564:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2165 count 1 00000100:00100000:0.0:1788572217.265602:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638918144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (608us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.265608:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843 00000004:00080000:3.0:1788572217.265679:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6300, transno 0 00000004:00080000:3.0:1788572217.265684:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a6300/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.265693:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638918144:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.265698:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572217.265703:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638918528:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.265724:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1788572217.265742:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.265748:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5730e99/0xdb7edb52b831ec70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572217.265749:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638918272:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572217.265758:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a0:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.265761:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.265765:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5730e99/0xdb7edb52b831ec70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572217.265769:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572217.265775:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5730e99/0xdb7edb52b831ec70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.265784:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5730e99/0xdb7edb52b831ec70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572217.265794:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638918784:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572217.265797:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5730e99/0xdb7edb52b831ec70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.265810:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572217.265812:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.265826:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572217.265831:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638918400:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1788572217.265850:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x99f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1788572217.265850:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572217.265854:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df682488/0xdb7edb52b831ec77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.265862:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99f:0x0].0x0 since=4134s v=(0 0) 00000100:00100000:3.0:1788572217.265864:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638918912:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572217.265865:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.265869:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df682488/0xdb7edb52b831ec77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.265878:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df682488/0xdb7edb52b831ec77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572217.265879:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572217.265886:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df682488/0xdb7edb52b831ec77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.265893:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df682488/0xdb7edb52b831ec77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572217.265957:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638919040:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.265976:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638918656 00000100:00100000:1.0:1788572217.265981:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638918656 00000100:00100000:3.0:1788572217.265981:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.265996:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638918528 00000100:00100000:1.0:1788572217.265998:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638918528 00000100:00100000:1.0:1788572217.266025:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638918784 00000100:00100000:3.0:1788572217.266025:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638918272 00000100:00100000:1.0:1788572217.266028:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638918784 00000100:00100000:3.0:1788572217.266028:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638918272 00000100:00100000:1.0:1788572217.266036:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638918400 00000100:00100000:1.0:1788572217.266038:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638918400 00000100:00100000:3.0:1788572217.266041:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638918912 00000100:00100000:3.0:1788572217.266044:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638918912 00000100:00100000:1.0:1788572217.266045:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638919040 00000100:00100000:1.0:1788572217.266047:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638919040 00000100:00100000:3.0:1788572217.266053:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:3.0:1788572217.266072:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3651:x1875449638918656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.266084:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2169 count 1 00010000:00010000:2.0:1788572217.266092:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788572217.266130:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x99e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1788572217.266133:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3651:x1875449638918656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62us (937us total) trans 0 rc -2/-2 00010000:00010000:2.0:1788572217.266135:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff33121a/0xdb7edb52b831ec7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266144:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99e:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.266147:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.266151:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff33121a/0xdb7edb52b831ec7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266206:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff33121a/0xdb7edb52b831ec7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266215:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff33121a/0xdb7edb52b831ec7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266221:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff33121a/0xdb7edb52b831ec7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266248:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788572217.266295:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x99d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.266301:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a29fd884/0xdb7edb52b831ec85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266309:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99d:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.266312:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.266316:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a29fd884/0xdb7edb52b831ec85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266325:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a29fd884/0xdb7edb52b831ec85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266339:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a29fd884/0xdb7edb52b831ec85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266346:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a29fd884/0xdb7edb52b831ec85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266358:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788572217.266386:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x99c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.266391:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027eb663a/0xdb7edb52b831ec8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266398:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99c:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.266400:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.266404:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027eb663a/0xdb7edb52b831ec8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266413:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027eb663a/0xdb7edb52b831ec8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266421:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027eb663a/0xdb7edb52b831ec8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266428:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027eb663a/0xdb7edb52b831ec8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266441:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788572217.266466:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x99b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.266471:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8fbc977/0xdb7edb52b831ec93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266478:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99b:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.266481:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.266485:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8fbc977/0xdb7edb52b831ec93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266493:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8fbc977/0xdb7edb52b831ec93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266501:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8fbc977/0xdb7edb52b831ec93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266508:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8fbc977/0xdb7edb52b831ec93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266515:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788572217.266541:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x99a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.266546:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c9f27ec/0xdb7edb52b831ec9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266552:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99a:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.266556:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x99a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.266559:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c9f27ec/0xdb7edb52b831ec9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266567:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9f27ec/0xdb7edb52b831ec9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266575:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c9f27ec/0xdb7edb52b831ec9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266583:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c9f27ec/0xdb7edb52b831ec9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266590:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788572217.266614:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x999:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.266618:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831eca1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266625:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x999:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.266627:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x999:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.266631:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831eca1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266639:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831eca1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266647:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831eca1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266724:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831eca1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266734:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1788572217.266765:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x998:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.266769:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831eca8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266777:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x998:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.266780:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x998:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.266784:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831eca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266792:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831eca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266799:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831eca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266807:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831eca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266814:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1788572217.266839:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x997:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.266843:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ecaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266851:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x997:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.266854:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x997:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.266858:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ecaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266865:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ecaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266873:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ecaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266880:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ecaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266888:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1788572217.266924:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x996:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.266928:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ecb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266936:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x996:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.266938:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x996:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.266942:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ecb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266951:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ecb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266964:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ecb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266971:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ecb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.266977:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1788572217.267022:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x995:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.267026:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ecbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267033:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x995:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.267036:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x995:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.267039:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ecbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267048:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ecbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267056:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ecbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267062:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ecbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267082:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1788572217.267088:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b550e4f/0xdb7edb52b831ec69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267096:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421eee00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267101:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b550e4f/0xdb7edb52b831ec69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267111:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b550e4f/0xdb7edb52b831ec69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267126:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b550e4f/0xdb7edb52b831ec69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267134:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b550e4f/0xdb7edb52b831ec69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267151:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1788572217.267154:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5730e99/0xdb7edb52b831ec70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267160:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ee800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267163:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5730e99/0xdb7edb52b831ec70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267176:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5730e99/0xdb7edb52b831ec70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267185:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5730e99/0xdb7edb52b831ec70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267192:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5730e99/0xdb7edb52b831ec70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267201:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1788572217.267204:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df682488/0xdb7edb52b831ec77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267210:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ef000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267213:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df682488/0xdb7edb52b831ec77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267219:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df682488/0xdb7edb52b831ec77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267227:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df682488/0xdb7edb52b831ec77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267234:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df682488/0xdb7edb52b831ec77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267249:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788572217.267252:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff33121a/0xdb7edb52b831ec7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267258:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ee600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267260:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff33121a/0xdb7edb52b831ec7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267324:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff33121a/0xdb7edb52b831ec7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267334:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff33121a/0xdb7edb52b831ec7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267341:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff33121a/0xdb7edb52b831ec7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267351:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788572217.267355:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a29fd884/0xdb7edb52b831ec85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267361:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421eea00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267364:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a29fd884/0xdb7edb52b831ec85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267377:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a29fd884/0xdb7edb52b831ec85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267384:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a29fd884/0xdb7edb52b831ec85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267391:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a29fd884/0xdb7edb52b831ec85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267399:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788572217.267402:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027eb663a/0xdb7edb52b831ec8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267407:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ef400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267410:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027eb663a/0xdb7edb52b831ec8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267417:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027eb663a/0xdb7edb52b831ec8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267425:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027eb663a/0xdb7edb52b831ec8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267432:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027eb663a/0xdb7edb52b831ec8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267446:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788572217.267450:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8fbc977/0xdb7edb52b831ec93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267455:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421ee200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267458:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8fbc977/0xdb7edb52b831ec93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267465:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8fbc977/0xdb7edb52b831ec93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267473:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8fbc977/0xdb7edb52b831ec93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267479:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8fbc977/0xdb7edb52b831ec93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267488:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788572217.267491:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c9f27ec/0xdb7edb52b831ec9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267497:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6421eec00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267500:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c9f27ec/0xdb7edb52b831ec9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267512:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c9f27ec/0xdb7edb52b831ec9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267520:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c9f27ec/0xdb7edb52b831ec9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267527:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c9f27ec/0xdb7edb52b831ec9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267535:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572217.267539:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831eca1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267544:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267547:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831eca1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267554:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831eca1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267562:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831eca1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267568:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831eca1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267582:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572217.267586:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831eca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267591:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267594:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831eca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267601:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831eca8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267608:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831eca8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267615:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831eca8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267623:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572217.267626:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ecaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267632:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267635:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ecaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267647:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ecaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267666:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ecaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267673:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ecaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267683:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.267686:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ecb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267691:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.267695:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ecb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267702:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ecb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267709:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ecb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267716:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ecb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267729:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.267730:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.267732:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.267739:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.267744:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.267749:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.267830:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572217.267876:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x994:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.267881:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ecc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267889:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x994:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.267892:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x994:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.267897:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ecc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267906:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ecc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267914:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ecc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267922:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ecc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267932:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788572217.267960:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x993:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.267964:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831eccb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267972:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x993:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.267975:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x993:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.267979:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831eccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267987:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831eccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.267994:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831eccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.268028:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831eccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.268040:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788572217.268072:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x992:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.268077:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066a6ba11/0xdb7edb52b831ecd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.268084:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x992:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.268087:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x992:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.268091:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066a6ba11/0xdb7edb52b831ecd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.268104:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066a6ba11/0xdb7edb52b831ecd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.268113:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066a6ba11/0xdb7edb52b831ecd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.268120:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066a6ba11/0xdb7edb52b831ecd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.268131:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:2.0:1788572217.268153:0:8464:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:2449 00000100:00100000:2.0:1788572217.268222:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:111999:x1875449638914304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22753us (22961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572217.268502:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845 00000100:00100000:1.0:1788572217.268515:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3651:x1875449638918528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.268540:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2168 count 1 00000100:00100000:1.0:1788572217.268600:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3651:x1875449638918528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 89us (2875us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.268607:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845 00000100:00100000:1.0:1788572217.268628:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846 00000100:00100000:1.0:1788572217.268634:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449638918784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.268646:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2170 count 1 00000100:00100000:1.0:1788572217.268717:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449638918784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 83us (2903us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.268723:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846 00000100:00100000:1.0:1788572217.268736:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:1.0:1788572217.268743:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638918272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.268756:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2166 count 1 00000100:00100000:1.0:1788572217.268797:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638918272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54us (3027us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.268803:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00100000:1.0:1788572217.268818:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:1.0:1788572217.268824:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638918400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.268835:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2167 count 1 00000100:00100000:1.0:1788572217.268877:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638918400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53us (3026us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.268882:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00100000:1.0:1788572217.268893:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:1.0:1788572217.268913:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638918912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.268925:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2171 count 1 00000100:00100000:1.0:1788572217.268964:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638918912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53us (3083us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.268970:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00100000:1.0:1788572217.268982:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850 00000100:00100000:1.0:1788572217.268989:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638919040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.269000:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2172 count 1 00000100:00100000:1.0:1788572217.269066:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638919040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 77us (3083us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.269075:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850 00000004:00080000:1.0:1788572217.270158:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6ad80, transno 0 00000004:00080000:1.0:1788572217.270167:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae6ad80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.270183:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638916352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.273604:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00010000:00010000:0.0:1788572217.273646:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572217.273669:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ecbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273682:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.273689:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ecbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572217.273696:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a7b80, transno 0 00010000:00010000:0.0:1788572217.273701:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ecbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572217.273703:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a7b80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.273711:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638918400:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.273720:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6d80, transno 0 00000004:00080000:3.0:1788572217.273723:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a6d80/1, rc -2, transno 0 00010000:00010000:0.0:1788572217.273724:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ecbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572217.273727:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638918912:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.273732:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ecbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572217.273735:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4380, transno 0 00000004:00080000:3.0:1788572217.273737:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a4380/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.273740:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638918272:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.273748:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5180, transno 0 00000004:00080000:3.0:1788572217.273749:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a5180/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.273752:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638918784:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.273758:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572217.273761:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ecc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273767:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.273770:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ecc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572217.273777:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6b800, transno 0 00010000:00010000:0.0:1788572217.273778:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ecc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572217.273780:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae6b800/1, rc -2, transno 0 00010000:00010000:0.0:1788572217.273787:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ecc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273795:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ecc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273807:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572217.273810:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831eccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273816:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.273819:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831eccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273832:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831eccb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273841:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831eccb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273848:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831eccb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273861:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572217.273865:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066a6ba11/0xdb7edb52b831ecd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273870:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.273873:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066a6ba11/0xdb7edb52b831ecd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273881:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066a6ba11/0xdb7edb52b831ecd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273889:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066a6ba11/0xdb7edb52b831ecd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273895:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066a6ba11/0xdb7edb52b831ecd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.273922:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572217.273924:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572217.273926:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572217.273988:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804 00000100:00100000:2.0:1788572217.274189:0:111999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:111999:1875449638914304:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788572217.274206:0:111999:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x9a1:0x0] from OST, last_created [0x280000401:0x9a1:0x0]last_used is [0x280000401:0x991:0x0] 00000100:00100000:2.0:1788572217.274404:0:111999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:111999:1875449638919296:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788572217.274467:0:111999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.274549:0:111999:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e504b97a80 going to sleep for 11 seconds 00010000:00010000:2.0:1788572217.274563:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.274569:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.274575:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.274580:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572217.274589:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638919296 00000100:00100000:2.0:1788572217.274596:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638919296 00000100:00100000:1.0:1788572217.274776:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:0.0:1788572217.274848:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:111999:x1875449638919296:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788572217.274905:0:43972:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2466 00000100:00100000:3.0:1788572217.275104:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638919040:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.275117:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572217.275124:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638919168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572217.275159:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.275451:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638919168 00000100:00100000:1.0:1788572217.275457:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638919168 00000100:00100000:1.0:1788572217.275497:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:1.0:1788572217.275505:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638919168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572217.275519:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484851520 pending 896 free 3923480576 avail 3691958272 00000100:00100000:1.0:1788572217.275567:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638919168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572217.275573:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000004:00080000:3.0:1788572217.276381:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a7800, transno 0 00000004:00080000:3.0:1788572217.276389:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a7800/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.276396:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638918528:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.276435:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638919168:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788572217.276464:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4e00, transno 0 00000004:00080000:3.0:1788572217.276468:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a4e00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.276472:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638918656:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.276581:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 77 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:1.0:1788572217.276694:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638919424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.276731:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638919680:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.276742:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.276755:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638919808:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.276773:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.277423:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:111999:x1875449638919296:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2636us (2953us total) trans 8589935539 rc 0/0 00000100:00100000:0.0:1788572217.277432:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:3.0:1788572217.277560:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638920320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.277626:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638919424 00000100:00100000:1.0:1788572217.277634:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638919424 00000100:00100000:1.0:1788572217.277683:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638919808 00000100:00100000:1.0:1788572217.277686:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638919808 00000100:00100000:1.0:1788572217.277706:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:1.0:1788572217.277715:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638919424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.277741:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2173 count 1 00000100:00100000:1.0:1788572217.277809:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638919424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 96us (1066us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.277815:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:1.0:1788572217.277830:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:1.0:1788572217.277836:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638919808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.277848:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2176 count 1 00000100:00100000:1.0:1788572217.277889:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638919808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53us (1114us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.278077:0:111999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:111999:1875449638919296:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788572217.278091:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9a1:0x0]-[0x280000401:0x9c1:0x0] 00000100:00100000:1.0:1788572217.278174:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000004:00080000:1.0:1788572217.278210:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6ad80, transno 0 00000004:00080000:1.0:1788572217.278215:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae6ad80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.278340:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638919424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.278356:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638919936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.278394:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.278418:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788572217.278423:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638919552:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.278443:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.278461:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638920064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.278480:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.278505:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638919936 00000100:00100000:1.0:1788572217.278511:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638919936 00000100:00100000:1.0:1788572217.278535:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638919552 00000100:00100000:1.0:1788572217.278538:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638919552 00000100:00100000:1.0:1788572217.278551:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638920064 00000100:00100000:1.0:1788572217.278554:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638920064 00000100:00100000:1.0:1788572217.278570:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854 00000100:00100000:1.0:1788572217.278577:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638919936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.278594:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2177 count 1 00000100:00100000:1.0:1788572217.278660:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638919936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 72us (254us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.278667:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854 00000100:00100000:1.0:1788572217.278682:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:1.0:1788572217.278688:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638919552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.278698:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2174 count 1 00000100:00100000:1.0:1788572217.278758:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638919552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 70us (313us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.278764:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:1.0:1788572217.278777:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:1.0:1788572217.278782:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638920064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.278792:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2178 count 1 00000100:00100000:1.0:1788572217.278829:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638920064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 47us (348us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.278835:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00000004:00080000:1.0:1788572217.278863:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6b800, transno 0 00000004:00080000:1.0:1788572217.278867:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae6b800/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.278871:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638919552:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.278878:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5063ab800, transno 0 00000004:00080000:1.0:1788572217.278881:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5063ab800/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.278883:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638920064:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.278889:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae69f80, transno 0 00000004:00080000:1.0:1788572217.278892:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae69f80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.278895:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638919936:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.279113:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 69 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:1.0:1788572217.279371:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638920448:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.279399:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.279413:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638920576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.279446:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638920448 00000100:00100000:0.0:1788572217.279451:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638920448 00000100:00100000:0.0:1788572217.279477:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:0.0:1788572217.279484:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638920448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.279497:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2181 count 1 00002000:00010000:2.0:1788572217.279694:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.279704:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5affd11/0xdb7edb52b831ecd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.279721:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9a1:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.279725:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.279732:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5affd11/0xdb7edb52b831ecd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.279746:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5affd11/0xdb7edb52b831ecd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.279756:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5affd11/0xdb7edb52b831ecd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.279764:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5affd11/0xdb7edb52b831ecd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.279781:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788572217.279856:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.279861:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ece0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.279868:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9a0:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.279871:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.279875:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ece0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.279888:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ece0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280496:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ece0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280507:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ece0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280523:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572217.280534:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572217.280539:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5affd11/0xdb7edb52b831ecd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280547:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.280552:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5affd11/0xdb7edb52b831ecd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280561:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5affd11/0xdb7edb52b831ecd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280578:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5affd11/0xdb7edb52b831ecd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280586:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5affd11/0xdb7edb52b831ecd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280603:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.280607:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ece0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280613:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.280616:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ece0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280624:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ece0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280633:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ece0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280640:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831ece0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.280661:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.280663:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.280665:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572217.280766:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 73 changes, 0 in progress, 0 in flight, 8 done 00002000:00010000:2.0:1788572217.280990:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x99f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.280995:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030983a4c/0xdb7edb52b831ece7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281026:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99f:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.281030:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.281035:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030983a4c/0xdb7edb52b831ece7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281044:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030983a4c/0xdb7edb52b831ece7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281053:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030983a4c/0xdb7edb52b831ece7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281060:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030983a4c/0xdb7edb52b831ece7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281077:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.281084:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.281089:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030983a4c/0xdb7edb52b831ece7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281096:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.281098:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030983a4c/0xdb7edb52b831ece7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281105:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030983a4c/0xdb7edb52b831ece7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281121:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030983a4c/0xdb7edb52b831ece7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281127:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030983a4c/0xdb7edb52b831ece7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281139:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.281141:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.281142:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.281185:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x99e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.281191:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070b1f926/0xdb7edb52b831ecee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281199:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99e:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.281202:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.281207:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070b1f926/0xdb7edb52b831ecee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281215:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070b1f926/0xdb7edb52b831ecee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281223:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070b1f926/0xdb7edb52b831ecee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281356:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070b1f926/0xdb7edb52b831ecee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281377:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.281385:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.281399:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070b1f926/0xdb7edb52b831ecee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281407:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.281411:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070b1f926/0xdb7edb52b831ecee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281418:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070b1f926/0xdb7edb52b831ecee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281430:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070b1f926/0xdb7edb52b831ecee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281437:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070b1f926/0xdb7edb52b831ecee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281448:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.281450:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.281451:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.281492:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x99d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.281498:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ecf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281506:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99d:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.281510:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.281514:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ecf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281523:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ecf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281530:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ecf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281537:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ecf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281549:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.281556:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.281560:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ecf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281568:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.281571:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ecf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281579:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ecf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281589:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ecf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281602:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ecf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281614:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.281616:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.281618:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.281670:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x99c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.281676:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ecfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281684:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99c:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.281687:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.281692:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ecfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281701:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ecfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281710:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ecfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281718:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ecfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281730:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.281738:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.281741:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ecfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281748:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.281752:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ecfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281760:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ecfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281770:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ecfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281779:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ecfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281791:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.281793:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.281794:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.281830:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x99b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.281837:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ed03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281845:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99b:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.281848:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.281852:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ed03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281865:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ed03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281872:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ed03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281879:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ed03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.281893:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.282177:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.282182:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ed03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282189:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.282192:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ed03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282200:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ed03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282211:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ed03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282218:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ed03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282243:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.282244:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.282246:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.282351:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x99a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.282357:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c0da613/0xdb7edb52b831ed0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282365:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99a:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.282367:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x99a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.282371:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c0da613/0xdb7edb52b831ed0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282380:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c0da613/0xdb7edb52b831ed0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282387:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c0da613/0xdb7edb52b831ed0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282393:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c0da613/0xdb7edb52b831ed0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282407:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.282414:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.282417:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c0da613/0xdb7edb52b831ed0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282428:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.282432:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c0da613/0xdb7edb52b831ed0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282440:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c0da613/0xdb7edb52b831ed0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282450:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c0da613/0xdb7edb52b831ed0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282458:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c0da613/0xdb7edb52b831ed0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x99a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282470:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.282471:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.282473:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.282506:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x999:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.282510:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ed11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282518:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x999:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.282521:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x999:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.282525:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ed11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282533:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ed11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282540:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ed11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282547:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ed11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282557:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.282562:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.282565:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ed11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282570:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.282573:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ed11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282579:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ed11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282587:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ed11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282594:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ed11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x999:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282603:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.282605:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.282606:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.282637:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x998:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.282641:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831ed18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282648:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x998:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.282676:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x998:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.282680:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831ed18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282689:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831ed18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282696:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831ed18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282702:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831ed18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282713:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.282719:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.282722:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831ed18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282728:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.282732:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831ed18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282742:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831ed18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282752:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831ed18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282758:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831ed18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x998:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282769:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.282770:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.282772:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.282811:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x997:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.282815:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282823:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x997:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.282825:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x997:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.282829:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282837:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282844:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282850:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282861:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.282867:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.282870:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282876:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.282879:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282886:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282962:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282973:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x997:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.282986:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.282987:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.282989:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.283050:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x996:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.283055:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283063:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x996:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.283066:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x996:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.283070:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283078:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283085:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283092:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283105:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.283111:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.283115:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283121:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.283125:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283132:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283142:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283149:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x996:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283162:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.283163:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.283165:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.283202:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x995:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.283207:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283216:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x995:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.283219:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x995:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.283223:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283231:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283239:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283245:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283262:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.283373:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.283378:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283384:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.283387:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283395:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283405:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283412:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x995:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283425:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.283427:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.283428:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.283473:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x994:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.283478:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283486:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x994:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.283489:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x994:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.283493:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283502:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283510:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283518:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283529:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.283536:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.283539:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283545:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.283548:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283556:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283565:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283576:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x994:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283589:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.283591:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.283593:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.283631:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x993:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.283637:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283644:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x993:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.283647:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x993:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.283739:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283749:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283757:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283764:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283777:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.283785:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.283789:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283795:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.283798:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283805:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283815:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283822:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x993:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283835:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.283836:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.283838:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572217.283879:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x992:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.283884:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283892:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x992:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.283895:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x992:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.283913:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283925:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283933:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283940:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283953:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.283959:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.283962:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283968:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.283971:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283978:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283988:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.283995:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x992:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.284029:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.284031:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.284033:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788572217.284063:0:43964:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:2449 00000100:00100000:3.0:1788572217.284591:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.284596:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638920448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5110us (5193us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.284607:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:3.0:1788572217.284633:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638920192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.284639:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638919680 00000100:00100000:0.0:1788572217.284646:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638919680 00000100:00100000:3.0:1788572217.284679:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572217.284754:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493100, transno 0 00000004:00080000:1.0:1788572217.284761:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493100/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.284773:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638920448:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.284789:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638920960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.284889:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:112001:x1875449638912640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 41682us (42789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572217.284911:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:0.0:1788572217.289108:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638920192 00000100:00100000:0.0:1788572217.289124:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638920192 00000100:00100000:0.0:1788572217.289199:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:0.0:1788572217.289210:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638919680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.289256:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2175 count 1 00000100:00100000:3.0:1788572217.289403:0:112001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:112001:1875449638912640:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788572217.289417:0:112001:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x9a1:0x0] from OST, last_created [0x2c0000401:0x9a1:0x0]last_used is [0x2c0000401:0x991:0x0] 00000100:00100000:0.0:1788572217.289465:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638919680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 256us (4877us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.289472:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000100:00100000:3.0:1788572217.289476:0:112001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5063a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:112001:1875449638922112:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788572217.289490:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:0.0:1788572217.289496:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638920192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.289507:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2179 count 1 00000100:00100000:3.0:1788572217.289507:0:112001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.289527:0:112001:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e6184b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572217.289549:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638920192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54us (4869us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.289549:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638920704:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.289556:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00100000:0.0:1788572217.289566:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638922112 00000100:00100000:0.0:1788572217.289569:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638922112 00000100:00100000:3.0:1788572217.289569:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.289586:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638921216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.289589:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638920704 00000100:00100000:0.0:1788572217.289591:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638920704 00000100:00100000:3.0:1788572217.289606:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.289607:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:0.0:1788572217.289613:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:112001:x1875449638922112:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788572217.289621:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638921728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.289639:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788572217.289640:0:43975:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2466 00000004:00080000:3.0:1788572217.289674:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6a680, transno 0 00000004:00080000:3.0:1788572217.289679:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae6a680/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.289684:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638919680:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.289692:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5063aaa00, transno 0 00000004:00080000:3.0:1788572217.289695:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5063aaa00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.289698:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638920192:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.289706:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788572217.289712:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638920832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.289730:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.289753:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638921344:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.289773:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572217.291042:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572217.291064:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638921216 00000100:00100000:0.0:1788572217.291071:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638921216 00000100:00100000:0.0:1788572217.291112:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638921728 00000100:00100000:0.0:1788572217.291116:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638921728 00000100:00100000:0.0:1788572217.291129:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638920832 00000100:00100000:0.0:1788572217.291131:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638920832 00000100:00100000:0.0:1788572217.291141:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638921344 00000100:00100000:0.0:1788572217.291143:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638921344 00000100:00100000:0.0:1788572217.291158:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:0.0:1788572217.291165:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638920704:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.291173:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638921856:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.291189:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2183 count 1 00000100:00100000:0.0:1788572217.291388:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638920704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 222us (1816us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.291394:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.291397:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:0.0:1788572217.291411:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638921856 00000100:00100000:0.0:1788572217.291415:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638921856 00000004:00080000:3.0:1788572217.291420:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493800, transno 0 00000004:00080000:3.0:1788572217.291426:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493800/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.291428:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:3.0:1788572217.291431:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638920704:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.291433:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638921216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.291444:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2179 count 1 00000100:00100000:3.0:1788572217.291452:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.291476:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae69500, transno 0 00000004:00080000:3.0:1788572217.291480:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae69500/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.291484:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638919808:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.291489:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638921216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 56us (1883us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.291495:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00000004:00080000:3.0:1788572217.291502:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637597480, transno 0 00000100:00100000:0.0:1788572217.291505:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638920320 00000004:00080000:3.0:1788572217.291505:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637597480/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.291508:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638920320 00000100:00100000:3.0:1788572217.291515:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638921216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.291520:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:0.0:1788572217.291526:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638921728:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.291533:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788572217.291537:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2183 count 1 00000100:00100000:3.0:1788572217.291551:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638921472:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.291571:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.291577:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638921728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 52us (1937us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.291583:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00000100:00100000:3.0:1788572217.291585:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5063ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638921984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572217.291592:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638920960 00000100:00100000:0.0:1788572217.291595:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638920960 00000100:00100000:0.0:1788572217.291605:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638921472 00000100:00100000:3.0:1788572217.291606:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.291607:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638921472 00000100:00100000:0.0:1788572217.291616:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:0.0:1788572217.291622:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638920832:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.291631:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638921984 00002000:00080000:0.0:1788572217.291633:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2184 count 1 00000100:00100000:3.0:1788572217.291635:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638921984 00000100:00100000:3.0:1788572217.291676:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00100000:3.0:1788572217.291683:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638921984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572217.291687:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638920832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 65us (1956us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.291692:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00002000:00000024:3.0:1788572217.291695:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491795648 pending 896 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572217.291702:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:0.0:1788572217.291708:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449638921344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.291718:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2180 count 1 00000100:00100000:3.0:1788572217.291723:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638921984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572217.291729:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000004:00080000:3.0:1788572217.291753:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493b80, transno 0 00000100:00100000:0.0:1788572217.291755:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638921344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47us (1980us total) trans 0 rc -2/-2 00000004:00080000:3.0:1788572217.291756:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493b80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.291760:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638920832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.291761:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000004:00080000:3.0:1788572217.291767:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637596d80, transno 0 00000004:00080000:3.0:1788572217.291769:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637596d80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.291772:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:3.0:1788572217.291773:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638921344:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.291778:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638921856:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.291779:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637596300, transno 0 00000004:00080000:3.0:1788572217.291782:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637596300/1, rc -2, transno 0 00002000:00080000:0.0:1788572217.291789:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2184 count 1 00000100:00100000:0.0:1788572217.291828:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638921856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50us (434us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.291834:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00100000:0.0:1788572217.291845:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:0.0:1788572217.291851:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638920320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.291862:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2180 count 1 00000100:00100000:2.0:1788572217.292090:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:2.0:1788572217.292100:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638920960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.292113:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2177 count 1 00000100:00100000:2.0:1788572217.292163:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638920960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 65us (628us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.292169:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00000100:00100000:2.0:1788572217.292182:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:2.0:1788572217.292187:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638921472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.292198:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2181 count 1 00000100:00100000:2.0:1788572217.292248:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638921472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 60us (675us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.292254:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:3.0:1788572217.292507:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638921728:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.292513:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638920320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 663us (1060us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.292520:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00000100:00100000:3.0:1788572217.292523:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638922368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.292549:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.292571:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637595880, transno 0 00000004:00080000:3.0:1788572217.292576:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637595880/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.292580:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638921856:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.292592:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638922368 00000100:00100000:1.0:1788572217.292597:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638922368 00000100:00100000:0.0:1788572217.293714:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:112001:x1875449638922112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4097us (4202us total) trans 4294968240 rc 0/0 00000100:00100000:0.0:1788572217.293724:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000004:00080000:0.0:1788572217.293863:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 65 changes, 2 in progress, 2 in flight, 6 done 00000100:00100000:2.0:1788572217.294143:0:112001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5063a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:112001:1875449638922112:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788572217.294156:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9a1:0x0]-[0x2c0000401:0x9c1:0x0] 00000100:00100000:0.0:1788572217.294389:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:0.0:1788572217.294398:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638922368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.294419:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2186 count 1 00000100:00100000:0.0:1788572217.294483:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638922368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 86us (1932us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.294489:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000004:00080000:3.0:1788572217.294728:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5063aa680, transno 0 00000004:00080000:3.0:1788572217.294734:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5063aa680/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.295178:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5063ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638921984:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788572217.295192:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637596680, transno 0 00000004:00080000:2.0:1788572217.295195:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637596680/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.295212:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638920960:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.295223:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637595500, transno 0 00000004:00080000:2.0:1788572217.295225:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637595500/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.295229:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638921472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.295264:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638922624:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.295508:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.295545:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638923136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.295566:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.295594:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638923648:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.295616:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.295631:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 6 async RPCs [3->2] 00000100:00100000:2.0:1788572217.295636:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638921088:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.295667:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.295682:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638921600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.295701:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.295714:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638922240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.295730:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.295744:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638922752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.295764:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.295778:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638923264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.295799:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.295814:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638923776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.295831:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.295859:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638922624 00000100:00100000:2.0:1788572217.295865:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638922624 00000100:00100000:1.0:1788572217.296093:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638923136 00000100:00100000:1.0:1788572217.296098:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638923136 00000100:00100000:1.0:1788572217.296122:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638923648 00000100:00100000:1.0:1788572217.296125:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638923648 00000100:00100000:1.0:1788572217.296139:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638921088 00000100:00100000:1.0:1788572217.296141:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638921088 00000100:00100000:1.0:1788572217.296152:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638921600 00000100:00100000:1.0:1788572217.296155:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638921600 00000100:00100000:1.0:1788572217.296170:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638922240 00000100:00100000:1.0:1788572217.296172:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638922240 00000100:00100000:1.0:1788572217.296187:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1788572217.296195:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638922624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.296218:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2188 count 1 00000100:00100000:1.0:1788572217.296371:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638922624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 177us (862us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.296379:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1788572217.296394:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638922752 00000100:00100000:1.0:1788572217.296398:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638922752 00000100:00100000:1.0:1788572217.296417:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638923264 00000100:00100000:1.0:1788572217.296421:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638923264 00000100:00100000:1.0:1788572217.296434:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638923776 00000100:00100000:1.0:1788572217.296437:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638923776 00000100:00100000:1.0:1788572217.296447:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:1.0:1788572217.296453:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638923136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.296465:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2188 count 1 00000100:00100000:1.0:1788572217.296515:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638923136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62us (948us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.296522:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:1.0:1788572217.296534:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873 00000100:00100000:1.0:1788572217.296541:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638923648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.296551:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2189 count 1 00000100:00100000:1.0:1788572217.296588:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638923648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48us (971us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.296594:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873 00000100:00100000:1.0:1788572217.296605:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:1.0:1788572217.296610:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638921088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.296621:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2178 count 1 00000100:00100000:1.0:1788572217.296671:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638921088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 61us (1003us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.296677:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00000100:00100000:1.0:1788572217.296688:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875 00000100:00100000:1.0:1788572217.296694:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638921600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.296706:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2182 count 1 00000100:00100000:1.0:1788572217.296742:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638921600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48us (1040us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.296747:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875 00000100:00100000:1.0:1788572217.296760:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:1.0:1788572217.296766:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638922240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.296776:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2185 count 1 00000100:00100000:1.0:1788572217.297109:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638922240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 343us (1377us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.297116:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:1.0:1788572217.297130:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:1.0:1788572217.297137:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638922752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.297149:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2185 count 1 00000100:00100000:1.0:1788572217.297197:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638922752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 61us (1431us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.297203:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:1.0:1788572217.297215:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:1.0:1788572217.297221:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638923264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.297231:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2189 count 1 00000100:00100000:2.0:1788572217.297360:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879 00000100:00100000:2.0:1788572217.297370:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638923776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.297384:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2190 count 1 00000100:00100000:2.0:1788572217.297456:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638923776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 88us (1623us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.297462:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000004:00080000:2.0:1788572217.297506:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637596a00, transno 0 00000004:00080000:2.0:1788572217.297513:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637596a00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.297527:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638921088:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.297536:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637597800, transno 0 00000004:00080000:2.0:1788572217.297538:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637597800/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.297541:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638921600:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.297547:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637597480, transno 0 00000004:00080000:2.0:1788572217.297549:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637597480/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.297552:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638922240:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.297558:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493100, transno 0 00000004:00080000:2.0:1788572217.297560:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493100/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.297583:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638923264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (1469us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.297589:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000004:00080000:1.0:1788572217.297694:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 59 changes, 5 in progress, 5 in flight, 3 done 00000100:00100000:3.0:1788572217.298105:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638920320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.298161:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638922880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.298201:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.298228:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638923392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.298249:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.298264:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638923904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.298431:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.298458:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637594a80, transno 0 00000004:00080000:3.0:1788572217.298463:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637594a80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.298472:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638922368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.298492:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638922880 00000100:00100000:3.0:1788572217.298499:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638922880 00000100:00100000:3.0:1788572217.298532:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638923392 00000100:00100000:3.0:1788572217.298535:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638923392 00000100:00100000:3.0:1788572217.298551:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638923904 00000100:00100000:3.0:1788572217.298553:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638923904 00000100:00100000:3.0:1788572217.298573:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880 00000100:00100000:3.0:1788572217.298580:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638922880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.298596:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2186 count 1 00000100:00100000:3.0:1788572217.298673:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638922880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 92us (470us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.298680:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880 00000100:00100000:3.0:1788572217.298696:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:3.0:1788572217.298703:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638923392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.298714:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2190 count 1 00000100:00100000:3.0:1788572217.298755:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638923392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52us (504us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.298761:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00000100:00100000:3.0:1788572217.298773:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:3.0:1788572217.298780:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638923904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.298790:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2191 count 1 00000100:00100000:3.0:1788572217.298832:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638923904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (400us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.298838:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000004:00080000:3.0:1788572217.298867:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493800, transno 0 00000004:00080000:3.0:1788572217.298872:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493800/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.299038:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638922752:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.299063:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618491880, transno 0 00000004:00080000:2.0:1788572217.299066:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618491880/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.299070:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638923264:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.299079:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12680, transno 0 00000004:00080000:2.0:1788572217.299081:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12680/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.299084:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638923776:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.299091:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13100, transno 0 00000004:00080000:2.0:1788572217.299094:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13100/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.299097:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638923648:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.299105:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637595880, transno 0 00000004:00080000:2.0:1788572217.299107:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637595880/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.299109:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638922624:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.299116:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490a80, transno 0 00000004:00080000:2.0:1788572217.299119:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490a80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.299122:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638923136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.299144:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638924160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.299170:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.299208:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638924160 00000100:00100000:2.0:1788572217.299212:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638924160 00000100:00100000:2.0:1788572217.299587:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:2.0:1788572217.299597:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638924160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.299612:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2193 count 1 00000100:00100000:2.0:1788572217.299679:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638924160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 84us (508us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.299685:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000004:00080000:0.0:1788572217.300041:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 58 changes, 4 in progress, 5 in flight, 4 done 00000004:00080000:2.0:1788572217.300403:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10e00, transno 0 00000004:00080000:2.0:1788572217.300410:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10e00/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.300417:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638924160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.300427:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572217.300433:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638924288:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.300471:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.300565:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.300626:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638922880:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.300642:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490e00, transno 0 00000004:00080000:3.0:1788572217.300646:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490e00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.300660:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638923392:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.300670:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11c00, transno 0 00000004:00080000:3.0:1788572217.300673:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11c00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.300676:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638923904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.300690:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638924416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.300717:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638922496:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.300802:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 56 changes, 2 in progress, 2 in flight, 6 done 00000100:00100000:2.0:1788572217.301182:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.301401:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638924288 00000100:00100000:0.0:1788572217.301407:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638924288 00000100:00100000:0.0:1788572217.301444:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638920576 00000100:00100000:0.0:1788572217.301447:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638920576 00000100:00100000:0.0:1788572217.301467:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884 00000100:00100000:0.0:1788572217.301474:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638924288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.301496:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2192 count 1 00000100:00100000:0.0:1788572217.301567:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638924288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 92us (1095us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.301575:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884 00000100:00100000:0.0:1788572217.301590:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:0.0:1788572217.301596:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638920576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.301605:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2182 count 1 00000100:00100000:0.0:1788572217.301644:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638920576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (1079us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.301662:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00000100:00100000:2.0:1788572217.301739:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638923008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.301762:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.301776:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638923520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.301794:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.301809:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638924032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.301828:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.301849:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638924544:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.301868:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.301885:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638925056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.301971:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638922496 00000100:00100000:1.0:1788572217.301975:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638922496 00000100:00100000:1.0:1788572217.302001:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638923008 00000100:00100000:1.0:1788572217.302024:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638923008 00000100:00100000:1.0:1788572217.302043:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638923520 00000100:00100000:1.0:1788572217.302046:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638923520 00000100:00100000:1.0:1788572217.302059:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638924032 00000100:00100000:1.0:1788572217.302062:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638924032 00000100:00100000:1.0:1788572217.302077:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638924544 00000100:00100000:1.0:1788572217.302079:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638924544 00000100:00100000:1.0:1788572217.302095:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:1.0:1788572217.302101:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638922496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.302113:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2187 count 1 00000100:00100000:0.0:1788572217.302239:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:0.0:1788572217.302248:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638923008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.302261:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2187 count 1 00000100:00100000:1.0:1788572217.302435:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638922496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 333us (1252us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.302446:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000100:00100000:1.0:1788572217.302468:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:1.0:1788572217.302474:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638923520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.302485:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2191 count 1 00000100:00100000:1.0:1788572217.302525:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638923520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52us (730us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.302532:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00100000:1.0:1788572217.302545:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:1.0:1788572217.302550:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638924032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.302560:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2192 count 1 00000100:00100000:1.0:1788572217.302596:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638924032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 46us (767us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.302602:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00100000:1.0:1788572217.302614:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:1.0:1788572217.302620:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638924544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.302629:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2194 count 1 00000100:00100000:1.0:1788572217.302680:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638924544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 60us (810us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.302686:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:3.0:1788572217.302820:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638924672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.302850:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.302869:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638925184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.302891:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.303000:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493100, transno 0 00000004:00080000:3.0:1788572217.303027:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493100/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.303037:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638924288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.303046:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572217.303052:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638924800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.303076:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.303095:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638925312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.303115:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.303144:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490380, transno 0 00000004:00080000:3.0:1788572217.303148:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490380/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.303152:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638920576:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.303175:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638924672 00000100:00100000:3.0:1788572217.303179:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638924672 00000100:00100000:3.0:1788572217.303204:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638925184 00000100:00100000:3.0:1788572217.303207:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638925184 00000100:00100000:3.0:1788572217.303221:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638924800 00000100:00100000:3.0:1788572217.303224:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638924800 00000100:00100000:3.0:1788572217.303248:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638925312 00000100:00100000:3.0:1788572217.303251:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638925312 00000100:00100000:3.0:1788572217.303265:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:3.0:1788572217.303391:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638924672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.303407:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2194 count 1 00000100:00100000:3.0:1788572217.303467:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638924672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 79us (615us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.303473:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000100:00100000:3.0:1788572217.303488:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892 00000100:00100000:3.0:1788572217.303494:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638925184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.303505:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2198 count 1 00000100:00100000:3.0:1788572217.303548:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638925184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 54us (655us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.303553:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892 00000100:00100000:3.0:1788572217.303564:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893 00000100:00100000:3.0:1788572217.303569:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638924800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.303580:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2195 count 1 00000100:00100000:3.0:1788572217.303620:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638924800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 51us (543us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.303625:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893 00000100:00100000:3.0:1788572217.303636:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:3.0:1788572217.303643:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638925312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.303664:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2199 count 1 00000100:00100000:3.0:1788572217.303702:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638925312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 60us (586us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.303707:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00100000:3.0:1788572217.303728:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.303752:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638924928:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.303776:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.303789:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638925440:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.303809:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.303838:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f800, transno 0 00000004:00080000:3.0:1788572217.303842:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2f800/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.303852:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638924800:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.303860:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2ce00, transno 0 00000004:00080000:3.0:1788572217.303863:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2ce00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.303866:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638925312:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.303872:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2df80, transno 0 00000004:00080000:3.0:1788572217.303874:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2df80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.303877:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638924672:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.303883:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d880, transno 0 00000004:00080000:3.0:1788572217.303885:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d880/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.303888:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638925184:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.304105:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 50 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:3.0:1788572217.304181:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638925952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.304206:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.304225:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572217.304229:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638926080:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.304422:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638924416 00000100:00100000:1.0:1788572217.304428:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638924416 00000100:00100000:1.0:1788572217.304455:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638924928 00000100:00100000:1.0:1788572217.304458:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638924928 00000100:00100000:1.0:1788572217.304469:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638925440 00000100:00100000:1.0:1788572217.304471:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638925440 00000100:00100000:1.0:1788572217.304481:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638925952 00000100:00100000:1.0:1788572217.304483:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638925952 00000100:00100000:1.0:1788572217.304493:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:1.0:1788572217.304499:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638924416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.304514:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2193 count 1 00000100:00100000:1.0:1788572217.304567:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638924416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 68us (837us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.304572:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:1.0:1788572217.304586:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:1.0:1788572217.304591:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638924928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.304600:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2196 count 1 00000100:00100000:1.0:1788572217.304633:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638924928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 42us (855us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.304639:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000100:00100000:1.0:1788572217.304660:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897 00000100:00100000:1.0:1788572217.304666:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638925440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.304675:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2195 count 1 00000100:00100000:1.0:1788572217.304708:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638925440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43us (898us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.304714:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897 00000100:00100000:1.0:1788572217.304727:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898 00000100:00100000:1.0:1788572217.304732:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638925952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.304741:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2202 count 1 00000100:00100000:1.0:1788572217.304769:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638925952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37us (563us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.304775:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898 00000100:00100000:3.0:1788572217.305118:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.305139:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b2a300, transno 0 00000004:00080000:3.0:1788572217.305144:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634b2a300/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.305153:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638925952:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.305160:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2e680, transno 0 00000004:00080000:3.0:1788572217.305162:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2e680/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.305165:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638924928:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.305173:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12a00, transno 0 00000004:00080000:3.0:1788572217.305175:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12a00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.305180:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638925440:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.305186:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618491880, transno 0 00000004:00080000:3.0:1788572217.305188:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618491880/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.305191:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638924416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.305205:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638926080 00000100:00100000:3.0:1788572217.305209:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638926080 00000100:00100000:3.0:1788572217.305244:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:3.0:1788572217.305249:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638926080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.305260:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2203 count 1 00000100:00100000:3.0:1788572217.305379:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638926080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 129us (260us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.305385:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00000100:00100000:3.0:1788572217.305467:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638926464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.305487:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.305503:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b2aa00, transno 0 00000004:00080000:3.0:1788572217.305506:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634b2aa00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.305512:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638926080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.305519:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572217.305523:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638926592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.305539:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.305586:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638925696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.305607:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.305618:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638926208:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.305633:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.305642:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638926720:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.305672:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.305684:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572217.305689:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638925824:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.305704:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.305713:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638926336:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.305730:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.305749:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638926464 00000100:00100000:3.0:1788572217.305752:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638926464 00000100:00100000:3.0:1788572217.305771:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638926592 00000100:00100000:3.0:1788572217.305773:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638926592 00000100:00100000:3.0:1788572217.305783:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638925696 00000100:00100000:3.0:1788572217.305785:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638925696 00000100:00100000:3.0:1788572217.305794:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638926208 00000100:00100000:3.0:1788572217.305796:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638926208 00000100:00100000:3.0:1788572217.305805:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638926720 00000100:00100000:3.0:1788572217.305807:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638926720 00000100:00100000:3.0:1788572217.305815:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638925824 00000100:00100000:3.0:1788572217.305817:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638925824 00000100:00100000:3.0:1788572217.305824:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638926336 00000100:00100000:3.0:1788572217.305827:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638926336 00000100:00100000:3.0:1788572217.305837:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:3.0:1788572217.305842:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449638926464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.305855:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2204 count 1 00000100:00100000:3.0:1788572217.305972:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449638926464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 129us (483us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.305978:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:3.0:1788572217.305990:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:3.0:1788572217.305995:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638926592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.306027:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2205 count 1 00000100:00100000:3.0:1788572217.306063:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638926592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 68us (522us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.306069:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00000100:00100000:3.0:1788572217.306082:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902 00000100:00100000:3.0:1788572217.306087:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638925696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.306099:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2200 count 1 00000100:00100000:3.0:1788572217.306142:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638925696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 55us (533us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.306147:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902 00000100:00100000:3.0:1788572217.306159:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903 00000100:00100000:3.0:1788572217.306165:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638926208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.306176:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2197 count 1 00000100:00100000:3.0:1788572217.306220:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638926208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55us (585us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.306226:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903 00000100:00100000:3.0:1788572217.306237:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00000100:00100000:3.0:1788572217.306244:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638926720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.306254:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2206 count 1 00000100:00100000:1.0:1788572217.306373:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:1.0:1788572217.306382:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638925824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.306393:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2201 count 1 00000100:00100000:3.0:1788572217.306452:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638926720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 208us (778us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.306458:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00000100:00100000:3.0:1788572217.306468:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:3.0:1788572217.306474:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638926336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.306483:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2198 count 1 00000100:00100000:3.0:1788572217.306515:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638926336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41us (784us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.306520:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000004:00080000:3.0:1788572217.306546:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2df80, transno 0 00000004:00080000:3.0:1788572217.306551:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2df80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.306560:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638926592:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.306569:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2e680, transno 0 00000004:00080000:3.0:1788572217.306571:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2e680/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.306574:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638926464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.306677:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638926976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.306700:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.306720:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638926976 00000100:00100000:3.0:1788572217.306724:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638926976 00000100:00100000:3.0:1788572217.306742:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:3.0:1788572217.306747:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638926976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.306756:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2208 count 1 00000100:00100000:2.0:1788572217.306872:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.306889:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638925568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.306919:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572217.306934:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637596300, transno 0 00000004:00080000:2.0:1788572217.306937:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637596300/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.306946:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638922496:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.306955:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618492300, transno 0 00000004:00080000:2.0:1788572217.306957:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618492300/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.306961:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638923520:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.306968:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11180, transno 0 00000004:00080000:2.0:1788572217.306970:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11180/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.306973:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638924032:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.306983:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490a80, transno 0 00000004:00080000:2.0:1788572217.306985:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490a80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.306988:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638924544:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.307014:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638925056 00000100:00100000:2.0:1788572217.307017:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638925056 00000100:00100000:2.0:1788572217.307032:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638925568 00000100:00100000:2.0:1788572217.307034:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638925568 00000100:00100000:2.0:1788572217.307044:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:2.0:1788572217.307049:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638925056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.307059:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2197 count 1 00000100:00100000:2.0:1788572217.307103:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638925056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (230us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.307109:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00000100:00100000:2.0:1788572217.307121:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909 00000100:00100000:2.0:1788572217.307127:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638925568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.307139:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2196 count 1 00000100:00100000:2.0:1788572217.307176:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638925568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (256us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.307182:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909 00000100:00100000:2.0:1788572217.307386:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572217.307395:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638927104:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.307421:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.307443:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638927104 00000100:00100000:2.0:1788572217.307446:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638927104 00000100:00100000:2.0:1788572217.307462:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1788572217.307467:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638927104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.307477:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2209 count 1 00000100:00100000:2.0:1788572217.307519:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638927104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 51us (96us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.307524:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000004:00080000:2.0:1788572217.307543:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 0 00000004:00080000:2.0:1788572217.307547:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3800/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.307553:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638927104:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.307609:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c000, transno 0 00000004:00080000:2.0:1788572217.307612:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2c000/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.307620:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638925056:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.307627:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13800, transno 0 00000004:00080000:2.0:1788572217.307630:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13800/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.307633:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638925568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.307703:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638927488:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.307726:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.307747:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638927488 00000100:00100000:2.0:1788572217.307750:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638927488 00000100:00100000:2.0:1788572217.307765:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:2.0:1788572217.307769:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638927488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.307780:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2212 count 1 00000100:00100000:0.0:1788572217.307969:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638923008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5721us (6204us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.307977:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00000100:00100000:1.0:1788572217.308355:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638925824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1973us (2647us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.308362:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000004:00080000:1.0:1788572217.308449:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 51 changes, 3 in progress, 3 in flight, 5 done 00000100:00100000:0.0:1788572217.308622:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638928000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.308664:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.308692:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788572217.308698:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638927616:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.308718:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.308734:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638928128:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.308751:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.308773:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638928000 00000100:00100000:0.0:1788572217.308777:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638928000 00000100:00100000:0.0:1788572217.308801:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638927616 00000100:00100000:0.0:1788572217.308803:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638927616 00000100:00100000:0.0:1788572217.308816:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638928128 00000100:00100000:0.0:1788572217.308818:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638928128 00000100:00100000:0.0:1788572217.308833:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1788572217.308840:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638928000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.308854:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2202 count 1 00000100:00100000:0.0:1788572217.308979:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638928000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 139us (314us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.308985:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1788572217.309000:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:0.0:1788572217.309027:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638927616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.309039:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2199 count 1 00000100:00100000:0.0:1788572217.309079:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638927616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54us (359us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.309085:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00000100:00100000:0.0:1788572217.309097:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914 00000100:00100000:0.0:1788572217.309103:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638928128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.309114:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2203 count 1 00000100:00100000:0.0:1788572217.309150:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638928128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 47us (397us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.309156:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914 00000004:00080000:0.0:1788572217.309191:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12a00, transno 0 00000004:00080000:0.0:1788572217.309196:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12a00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.309207:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638927616:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.309216:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13480, transno 0 00000004:00080000:0.0:1788572217.309218:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13480/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.309221:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638928128:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.309228:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12d80, transno 0 00000004:00080000:0.0:1788572217.309231:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12d80/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.309234:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638928000:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.309370:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 46 changes, 5 in progress, 5 in flight, 3 done 00000100:00100000:0.0:1788572217.309416:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638928512:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.309442:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.309463:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638928512 00000100:00100000:0.0:1788572217.309466:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638928512 00000100:00100000:0.0:1788572217.309490:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:0.0:1788572217.309496:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638928512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.309510:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2206 count 1 00000100:00100000:0.0:1788572217.309553:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638928512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57us (110us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.309560:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000004:00080000:0.0:1788572217.309586:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490e00, transno 0 00000004:00080000:0.0:1788572217.309590:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490e00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.309597:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638928512:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.309669:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572217.309678:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638928640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.309703:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.309798:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638928640 00000100:00100000:1.0:1788572217.309802:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638928640 00000100:00100000:1.0:1788572217.309839:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:1.0:1788572217.309847:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638928640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.309859:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2207 count 1 00000100:00100000:1.0:1788572217.309980:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638928640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 134us (276us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.309986:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000100:00100000:3.0:1788572217.310201:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638926976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3451us (3498us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.310210:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00000100:00100000:3.0:1788572217.310252:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638927232:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.310381:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.310399:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638927744:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.310417:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.310428:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638928256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.310442:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.310460:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b29f80, transno 0 00000004:00080000:3.0:1788572217.310464:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634b29f80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.310475:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638925824:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.310485:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 0 00000004:00080000:3.0:1788572217.310488:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.310493:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638926336:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.310502:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b28380, transno 0 00000004:00080000:3.0:1788572217.310505:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634b28380/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.310508:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638925696:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.310515:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12300, transno 0 00000004:00080000:3.0:1788572217.310518:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12300/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.310521:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638926208:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.310528:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b2aa00, transno 0 00000004:00080000:3.0:1788572217.310530:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634b2aa00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.310534:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638926720:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.310542:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788572217.310547:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638926848:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.310566:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.310579:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638927360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.310596:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.310608:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638927872:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.310625:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.310639:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638928384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.310669:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.310699:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638927232 00000100:00100000:3.0:1788572217.310702:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638927232 00000100:00100000:3.0:1788572217.310723:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638927744 00000100:00100000:3.0:1788572217.310726:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638927744 00000100:00100000:3.0:1788572217.310739:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638928256 00000100:00100000:3.0:1788572217.310741:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638928256 00000100:00100000:3.0:1788572217.310753:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638926848 00000100:00100000:3.0:1788572217.310755:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638926848 00000100:00100000:3.0:1788572217.310765:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638927360 00000100:00100000:3.0:1788572217.310768:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638927360 00000100:00100000:3.0:1788572217.310779:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638927872 00000100:00100000:3.0:1788572217.310781:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638927872 00000100:00100000:3.0:1788572217.310792:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638928384 00000100:00100000:3.0:1788572217.310794:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638928384 00000100:00100000:3.0:1788572217.310818:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:3.0:1788572217.310825:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638927232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.310840:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2210 count 1 00000100:00100000:0.0:1788572217.311030:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:0.0:1788572217.311040:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638927744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.311053:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2200 count 1 00000100:00100000:0.0:1788572217.311102:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638927744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 66us (683us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.311108:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00100000:0.0:1788572217.311121:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:0.0:1788572217.311127:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638928256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.311137:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2204 count 1 00000100:00100000:0.0:1788572217.311176:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638928256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (731us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.311182:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:0.0:1788572217.311193:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:0.0:1788572217.311199:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638926848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.311212:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2207 count 1 00000100:00100000:0.0:1788572217.311265:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638926848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 66us (697us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.311406:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638927232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 74us (516us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.311413:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00100000:3.0:1788572217.311426:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00100000:3.0:1788572217.311433:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638927360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.311445:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2211 count 1 00000100:00100000:3.0:1788572217.311485:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638927360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53us (887us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.311491:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00000100:00100000:3.0:1788572217.311503:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:3.0:1788572217.311509:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638927872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.311520:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2201 count 1 00000100:00100000:3.0:1788572217.311558:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638927872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (932us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.311564:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00000100:00100000:3.0:1788572217.311577:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:3.0:1788572217.311583:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638928384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.311594:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2205 count 1 00000100:00100000:3.0:1788572217.311632:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638928384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (962us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.311637:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000004:00080000:3.0:1788572217.311679:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778fb80, transno 0 00000004:00080000:3.0:1788572217.311685:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778fb80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.311690:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638926848:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.311698:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 0 00000004:00080000:3.0:1788572217.311700:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3800/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.311703:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638927360:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.311710:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10700, transno 0 00000004:00080000:3.0:1788572217.311711:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10700/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.311715:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638927872:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.311721:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490380, transno 0 00000004:00080000:3.0:1788572217.311723:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490380/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.311725:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638928384:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.311731:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db2680, transno 0 00000004:00080000:3.0:1788572217.311734:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db2680/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.311737:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638927232:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.311743:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13800, transno 0 00000004:00080000:3.0:1788572217.311745:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13800/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.311747:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638927744:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.311753:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493100, transno 0 00000004:00080000:3.0:1788572217.311755:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493100/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.311758:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638928256:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.311804:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493b80, transno 0 00000004:00080000:3.0:1788572217.311807:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493b80/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.311811:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638923008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.311982:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000004:00080000:0.0:1788572217.312055:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490e00, transno 0 00000004:00080000:0.0:1788572217.312058:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490e00/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.312063:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638928640:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.312073:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778d180, transno 0 00000004:00080000:0.0:1788572217.312075:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778d180/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.312078:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638926976:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572217.312157:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 42 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:0.0:1788572217.312335:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638929024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.312373:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.312395:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638929536:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.312430:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.312452:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788572217.312458:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638929152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.312480:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.312496:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638929664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.312514:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.312533:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638929024 00000100:00100000:0.0:1788572217.312540:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638929024 00000100:00100000:0.0:1788572217.312568:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638929536 00000100:00100000:0.0:1788572217.312571:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638929536 00000100:00100000:0.0:1788572217.312584:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638929152 00000100:00100000:0.0:1788572217.312587:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638929152 00000100:00100000:0.0:1788572217.312601:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638929664 00000100:00100000:0.0:1788572217.312603:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638929664 00000100:00100000:0.0:1788572217.312618:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924 00000100:00100000:0.0:1788572217.312624:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638929024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.312640:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2210 count 1 00000100:00100000:0.0:1788572217.312704:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638929024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 80us (331us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.312712:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924 00000100:00100000:0.0:1788572217.312725:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00100000:0.0:1788572217.312731:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638929536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.312742:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2214 count 1 00000100:00100000:0.0:1788572217.312779:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638929536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48us (349us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.312784:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00000100:00100000:0.0:1788572217.312801:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:0.0:1788572217.312807:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638929152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.312818:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2211 count 1 00000100:00100000:0.0:1788572217.312856:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638929152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48us (373us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.312861:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000100:00100000:0.0:1788572217.312872:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927 00000100:00100000:0.0:1788572217.312877:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638929664:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.313562:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 0 00000004:00080000:1.0:1788572217.313570:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3800/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.313584:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638929024:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.313595:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493b80, transno 0 00000004:00080000:1.0:1788572217.313598:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493b80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.313601:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638929536:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.313612:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db2680, transno 0 00000004:00080000:1.0:1788572217.313614:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db2680/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.313617:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638929152:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.313635:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638928768:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.313680:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.313710:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638929280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.313732:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.313750:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788572217.313755:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638928896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.313773:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.313788:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638929408:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.313805:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.313824:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638928768 00000100:00100000:1.0:1788572217.313828:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638928768 00000100:00100000:1.0:1788572217.313853:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638929280 00000100:00100000:1.0:1788572217.313855:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638929280 00000100:00100000:1.0:1788572217.313869:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638928896 00000100:00100000:1.0:1788572217.313871:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638928896 00000100:00100000:1.0:1788572217.313883:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638929408 00000100:00100000:1.0:1788572217.313886:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638929408 00000004:00080000:3.0:1788572217.315443:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 37 changes, 2 in progress, 1 in flight, 6 done 00002000:00080000:0.0:1788572217.316053:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2215 count 1 00000100:00100000:0.0:1788572217.316183:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449638929664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3301us (3663us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.316194:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927 00000100:00100000:0.0:1788572217.316221:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00100000:0.0:1788572217.316244:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638928768:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.316369:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638930048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.316413:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.316443:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638930560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.316465:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.316497:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490e00, transno 0 00000004:00080000:3.0:1788572217.316504:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490e00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.316511:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638929664:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.316524:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572217.316529:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638930176:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.316554:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.316581:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638930048 00000100:00100000:3.0:1788572217.316587:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638930048 00000100:00100000:3.0:1788572217.316614:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638930560 00000100:00100000:3.0:1788572217.316617:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638930560 00000100:00100000:3.0:1788572217.316628:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638930176 00000100:00100000:3.0:1788572217.316630:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638930176 00000100:00100000:3.0:1788572217.316644:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00100000:3.0:1788572217.316663:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638929280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.316680:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2212 count 1 00000100:00100000:3.0:1788572217.316731:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638929280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 80us (2997us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.316738:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00100000:3.0:1788572217.316755:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:3.0:1788572217.316762:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638928896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.316775:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2209 count 1 00000100:00100000:3.0:1788572217.316816:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638928896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54us (3041us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.316822:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00100000:3.0:1788572217.316834:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00100000:3.0:1788572217.316840:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638929408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.316851:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2213 count 1 00000100:00100000:3.0:1788572217.316894:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638929408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54us (3087us total) trans 0 rc -2/-2 00002000:00080000:0.0:1788572217.318026:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2208 count 1 00000100:00100000:0.0:1788572217.318130:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638928768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1899us (4447us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.318139:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00100000:0.0:1788572217.318172:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:0.0:1788572217.318183:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638930048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.318201:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2215 count 1 00000100:00100000:0.0:1788572217.318341:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638930048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 160us (1926us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.318348:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00100000:0.0:1788572217.318363:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933 00000100:00100000:0.0:1788572217.318369:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638930560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.318381:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2219 count 1 00000100:00100000:0.0:1788572217.318451:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449638930560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 82us (1985us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.318457:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933 00000100:00100000:0.0:1788572217.318471:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934 00000100:00100000:0.0:1788572217.318477:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638930176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.318488:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2216 count 1 00000100:00100000:0.0:1788572217.318528:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638930176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 51us (1973us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.318534:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934 00000004:00080000:0.0:1788572217.318685:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 34 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:3.0:1788572217.318841:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000100:00100000:3.0:1788572217.318868:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638931072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.319070:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.319105:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d180, transno 0 00000004:00080000:3.0:1788572217.319112:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d180/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.319124:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638930176:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.319133:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f480, transno 0 00000004:00080000:3.0:1788572217.319136:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2f480/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.319139:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638930048:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.319146:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2e680, transno 0 00000004:00080000:3.0:1788572217.319149:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2e680/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.319152:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638930560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.319163:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572217.319168:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638930688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.319190:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.319369:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 30 changes, 5 in progress, 5 in flight, 3 done 00000100:00100000:3.0:1788572217.319417:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572217.319426:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638931200:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.319449:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.319476:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638931072 00000100:00100000:3.0:1788572217.319481:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638931072 00000100:00100000:3.0:1788572217.319509:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638930688 00000100:00100000:3.0:1788572217.319512:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638930688 00000100:00100000:3.0:1788572217.319525:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638931200 00000100:00100000:3.0:1788572217.319528:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638931200 00000100:00100000:3.0:1788572217.319542:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:3.0:1788572217.319549:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638931072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.319564:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2219 count 1 00000100:00100000:3.0:1788572217.319616:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638931072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 67us (547us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.319622:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000004:00080000:3.0:1788572217.319641:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490e00, transno 0 00000004:00080000:3.0:1788572217.319645:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490e00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.319663:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638931072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.319677:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936 00000100:00100000:3.0:1788572217.319685:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638930688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.319696:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2216 count 1 00000100:00100000:3.0:1788572217.319738:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638930688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55us (546us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.319744:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936 00000004:00080000:3.0:1788572217.319762:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 0 00000004:00080000:3.0:1788572217.319766:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3800/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.319770:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638930688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.319784:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937 00000100:00100000:3.0:1788572217.319790:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638931200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.319802:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2220 count 1 00000100:00100000:3.0:1788572217.319848:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638931200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 59us (398us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572217.319855:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937 00000004:00080000:3.0:1788572217.319874:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670700, transno 0 00000004:00080000:3.0:1788572217.319878:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637670700/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.319884:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638931200:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.320578:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638927488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12806us (12849us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.320586:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00100000:3.0:1788572217.321412:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638931584:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.321446:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572217.321474:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637596300, transno 0 00000004:00080000:3.0:1788572217.321478:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637596300/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.321557:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638931584 00000100:00100000:0.0:1788572217.321562:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638931584 00000100:00100000:0.0:1788572217.321594:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938 00000100:00100000:0.0:1788572217.321601:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638931584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.321621:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2220 count 1 00000100:00100000:0.0:1788572217.321691:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449638931584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 90us (244us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.321701:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938 00000004:00080000:1.0:1788572217.324125:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493100, transno 0 00000004:00080000:1.0:1788572217.324139:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493100/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.324153:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638929408:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.324164:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3480, transno 0 00000004:00080000:1.0:1788572217.324167:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3480/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.324170:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638928768:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.324178:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490380, transno 0 00000004:00080000:1.0:1788572217.324180:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490380/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.324183:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638929280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.324203:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638929792:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.324389:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.324415:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638930304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.324437:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.324452:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638930816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.324470:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.324485:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638931328:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.324504:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.324519:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638931840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.324537:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572217.324553:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0a80, transno 0 00000004:00080000:1.0:1788572217.324557:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db0a80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.324561:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638928896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.324571:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788572217.324576:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638929920:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.324595:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.324609:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638930432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.324627:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.324640:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638930944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.324670:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.324691:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638931456:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.324706:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.324732:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638929792 00000100:00100000:1.0:1788572217.324738:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638929792 00000100:00100000:1.0:1788572217.324777:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638930304 00000100:00100000:1.0:1788572217.324779:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638930304 00000100:00100000:1.0:1788572217.324796:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638930816 00000100:00100000:1.0:1788572217.324799:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638930816 00000100:00100000:1.0:1788572217.324812:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638931328 00000100:00100000:1.0:1788572217.324814:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638931328 00000100:00100000:1.0:1788572217.324823:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638931840 00000100:00100000:1.0:1788572217.324825:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638931840 00000100:00100000:1.0:1788572217.324835:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638929920 00000100:00100000:1.0:1788572217.324837:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638929920 00000100:00100000:1.0:1788572217.324844:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638930432 00000100:00100000:1.0:1788572217.324846:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638930432 00000100:00100000:1.0:1788572217.324853:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638930944 00000100:00100000:1.0:1788572217.324855:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638930944 00000100:00100000:1.0:1788572217.324862:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638931456 00000100:00100000:1.0:1788572217.324865:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638931456 00000100:00100000:1.0:1788572217.324881:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:1.0:1788572217.324888:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3652:x1875449638929792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.325002:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2213 count 1 00000100:00100000:1.0:1788572217.325113:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3652:x1875449638929792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 224us (724us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.325121:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00100000:1.0:1788572217.325140:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00100000:1.0:1788572217.325146:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449638930304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.325157:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2217 count 1 00000100:00100000:1.0:1788572217.325196:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449638930304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50us (757us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.325202:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00000100:00100000:1.0:1788572217.325214:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00100000:1.0:1788572217.325220:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638930816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.325243:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2217 count 1 00000100:00100000:1.0:1788572217.325412:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638930816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 192us (940us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.325419:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00100000:1.0:1788572217.325432:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:1.0:1788572217.325438:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638931328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.325449:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2221 count 1 00000100:00100000:1.0:1788572217.325487:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638931328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49us (981us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.325492:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00100000:1.0:1788572217.325502:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943 00000100:00100000:1.0:1788572217.325508:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638931840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.325518:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2223 count 1 00000100:00100000:1.0:1788572217.325555:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638931840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47us (1016us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.325561:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943 00000100:00100000:1.0:1788572217.325571:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944 00000100:00100000:1.0:1788572217.325577:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638929920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.325586:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2214 count 1 00000100:00100000:1.0:1788572217.325622:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449638929920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 45us (1026us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.325628:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944 00000100:00100000:1.0:1788572217.325638:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945 00000100:00100000:1.0:1788572217.325643:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638930432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.325671:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2218 count 1 00000100:00100000:1.0:1788572217.325737:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449638930432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 94us (1109us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.325743:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945 00000100:00100000:1.0:1788572217.325756:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946 00000100:00100000:1.0:1788572217.325761:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638930944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.325775:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2218 count 1 00000100:00100000:1.0:1788572217.325814:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638930944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53us (1142us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.325819:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946 00000100:00100000:1.0:1788572217.325831:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:1.0:1788572217.325837:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638931456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.325849:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2222 count 1 00000100:00100000:1.0:1788572217.325887:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638931456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 50us (1179us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572217.325893:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000004:00080000:0.0:1788572217.326385:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 28 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:1.0:1788572217.327062:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638932352:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.327117:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572217.327157:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c380, transno 0 00000004:00080000:1.0:1788572217.327164:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2c380/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.327219:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638932352 00000100:00100000:0.0:1788572217.327226:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638932352 00000100:00100000:0.0:1788572217.328554:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:0.0:1788572217.328564:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638932352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.328591:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2225 count 1 00000100:00100000:0.0:1788572217.328706:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449638932352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 143us (1588us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.328713:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00000100:00100000:0.0:1788572217.328744:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638931968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.328804:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.328839:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638931968 00000100:00100000:0.0:1788572217.328845:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638931968 00000100:00100000:0.0:1788572217.328880:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949 00000100:00100000:0.0:1788572217.328886:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638931968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.329147:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2222 count 1 00000100:00100000:0.0:1788572217.329194:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638931968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 308us (390us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.329201:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949 00000100:00100000:2.0:1788572217.329390:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638931712:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.329424:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.329451:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638932224:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.329472:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.329494:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572217.329499:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638932096:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.329520:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.329548:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638931712 00000100:00100000:2.0:1788572217.329552:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638931712 00000100:00100000:2.0:1788572217.329576:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638932224 00000100:00100000:2.0:1788572217.329579:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638932224 00000100:00100000:2.0:1788572217.329594:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638932096 00000100:00100000:2.0:1788572217.329597:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638932096 00000100:00100000:2.0:1788572217.329619:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:2.0:1788572217.329626:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638931712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.329640:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2221 count 1 00000100:00100000:2.0:1788572217.329706:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449638931712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 80us (280us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.329712:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00000100:00100000:2.0:1788572217.329725:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951 00000100:00100000:2.0:1788572217.329731:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638932224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.329742:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2224 count 1 00000100:00100000:2.0:1788572217.329778:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638932224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48us (305us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.329783:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951 00000100:00100000:2.0:1788572217.329793:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952 00000100:00100000:2.0:1788572217.329799:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638932096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.329808:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2223 count 1 00000100:00100000:2.0:1788572217.329846:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638932096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 47us (325us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.329852:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952 00000004:00080000:2.0:1788572217.329880:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0a80, transno 0 00000004:00080000:2.0:1788572217.329887:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db0a80/1, rc -2, transno 0 00000004:00080000:0.0:1788572217.329985:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3480, transno 0 00000004:00080000:0.0:1788572217.329989:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3480/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.329995:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638931968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.330159:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638932480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.330189:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.330214:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638932480 00000100:00100000:0.0:1788572217.330219:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638932480 00000100:00100000:2.0:1788572217.330382:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638932096:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.330396:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 0 00000004:00080000:2.0:1788572217.330400:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3800/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.330408:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638931712:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.330415:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3b80, transno 0 00000004:00080000:2.0:1788572217.330418:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3b80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.330422:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638932224:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.330441:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638932736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.330465:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.330489:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572217.330495:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638932608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.330515:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.331114:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638927488:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.331149:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490e00, transno 0 00000004:00080000:3.0:1788572217.331153:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490e00/1, rc -2, transno 0 00000100:00100000:3.0:1788572217.331157:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638931584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.332039:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638932736 00000100:00100000:0.0:1788572217.332048:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638932736 00000100:00100000:0.0:1788572217.332079:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638932608 00000100:00100000:0.0:1788572217.332082:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638932608 00000100:00100000:0.0:1788572217.332102:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953 00000100:00100000:0.0:1788572217.332110:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638932480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.332138:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2224 count 1 00000100:00100000:0.0:1788572217.332247:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449638932480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 137us (2057us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572217.332255:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953 00000100:00100000:2.0:1788572217.332362:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2954 00000100:00100000:2.0:1788572217.332371:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638932736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.332385:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2227 count 1 00000100:00100000:2.0:1788572217.332441:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449638932736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 72us (1974us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.332447:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2954 00000100:00100000:2.0:1788572217.332529:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955 00000100:00100000:2.0:1788572217.332536:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638932608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.332546:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2226 count 1 00000100:00100000:2.0:1788572217.332584:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638932608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (2068us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.332590:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955 00000004:00080000:2.0:1788572217.332620:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db1f80, transno 0 00000004:00080000:2.0:1788572217.332626:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db1f80/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.332632:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638932608:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.332642:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b29500, transno 0 00000004:00080000:2.0:1788572217.332645:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634b29500/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.332660:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638932736:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.332874:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 22 changes, 3 in progress, 3 in flight, 5 done 00000100:00100000:1.0:1788572217.333366:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638929920:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.333411:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2df80, transno 0 00000004:00080000:1.0:1788572217.333416:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2df80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.333419:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638930432:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.333423:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638933120:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.333428:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493b80, transno 0 00000004:00080000:1.0:1788572217.333430:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493b80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.333433:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638930944:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.333440:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637671500, transno 0 00000004:00080000:1.0:1788572217.333442:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637671500/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.333445:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638931456:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.333453:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f100, transno 0 00000004:00080000:1.0:1788572217.333456:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2f100/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.333459:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638929792:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.333463:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572217.333467:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c000, transno 0 00000004:00080000:1.0:1788572217.333469:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2c000/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.333472:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638930304:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.333479:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db2680, transno 0 00000004:00080000:1.0:1788572217.333482:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db2680/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.333485:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638930816:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.333492:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637671f80, transno 0 00000004:00080000:1.0:1788572217.333494:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637671f80/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.333497:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638931328:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572217.333504:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670700, transno 0 00000004:00080000:1.0:1788572217.333506:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637670700/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.333509:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638931840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.333523:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638933120 00000100:00100000:1.0:1788572217.333526:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638932864:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.333527:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638933120 00000100:00100000:1.0:1788572217.333551:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.333559:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638932864 00000100:00100000:0.0:1788572217.333562:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638932864 00000004:00080000:1.0:1788572217.333575:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db1880, transno 0 00000004:00080000:1.0:1788572217.333578:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db1880/1, rc -2, transno 0 00000100:00100000:0.0:1788572217.333580:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956 00000100:00100000:1.0:1788572217.333582:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638932352:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572217.333586:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449638933120:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.333588:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572217.333592:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638932992:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.333602:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2230 count 1 00000100:00100000:1.0:1788572217.333611:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1788572217.333631:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572217.333639:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb3124b/0xdb7edb52b831ed49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.333666:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b6:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:0.0:1788572217.333670:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572217.333676:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edb3124b/0xdb7edb52b831ed49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.333694:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edb3124b/0xdb7edb52b831ed49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.333704:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb3124b/0xdb7edb52b831ed49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.333711:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edb3124b/0xdb7edb52b831ed49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.333735:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572217.333884:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638932992 00000100:00100000:2.0:1788572217.333888:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638932992 00000100:00100000:2.0:1788572217.333923:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:2.0:1788572217.333930:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638932864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.333940:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2228 count 1 00002000:00010000:2.0:1788572217.333959:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.333964:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.333972:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b4:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.333975:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.333979:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.333987:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.333994:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334001:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334035:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572217.334045:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572217.334051:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edb3124b/0xdb7edb52b831ed49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334059:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.334064:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb3124b/0xdb7edb52b831ed49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334072:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb3124b/0xdb7edb52b831ed49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334089:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edb3124b/0xdb7edb52b831ed49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334097:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edb3124b/0xdb7edb52b831ed49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334118:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.334121:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334127:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.334130:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334136:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334150:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334156:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044c14fa6/0xdb7edb52b831ed50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334166:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.334168:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.334169:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572217.334254:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638932864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 323us (701us total) trans 8589935541 rc 0/0 00000100:00100000:2.0:1788572217.334261:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:2.0:1788572217.334397:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958 00000100:00100000:2.0:1788572217.334404:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449638932992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.334417:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2229 count 1 00002000:00010000:2.0:1788572217.334431:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.334436:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334444:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b5:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.334447:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.334450:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334459:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334467:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334473:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334488:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.334495:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.334500:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334506:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.334509:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334515:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334526:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334533:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035d3dfd7/0xdb7edb52b831ed57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.334546:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.334548:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.334550:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572217.334609:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572217.334612:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638932992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 208us (998us total) trans 8589935542 rc 0/0 00000100:00100000:2.0:1788572217.334617:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958 00000004:00080000:1.0:1788572217.334633:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634b29f80/2, rc 0, transno 8589935542 00000100:00100000:1.0:1788572217.334638:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638932992:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572217.334660:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634b29500/2, rc 0, transno 8589935541 00000100:00100000:1.0:1788572217.334664:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638932864:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572217.334712:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 25 changes, 1 in progress, 1 in flight, 6 done 00000004:00080000:1.0:1788572217.334995:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 19 changes, 3 in progress, 1 in flight, 3 done 00000004:00080000:1.0:1788572217.335078:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57c700, transno 0 00000004:00080000:1.0:1788572217.335083:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57c700/1, rc -2, transno 0 00000100:00100000:1.0:1788572217.335087:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638932480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572217.335104:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638933504:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.335134:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.335154:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638934016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.335172:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.335187:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788572217.335192:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638933376:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.335211:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.335225:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638933888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572217.335258:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.335509:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449638933120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1921us (2043us total) trans 8589935540 rc 0/0 00000100:00100000:0.0:1788572217.335518:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956 00000100:00100000:0.0:1788572217.335537:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638933504 00000100:00100000:0.0:1788572217.335541:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638933504 00000100:00100000:0.0:1788572217.335570:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638934016 00000100:00100000:0.0:1788572217.335572:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638934016 00000100:00100000:0.0:1788572217.335587:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638933376 00000100:00100000:0.0:1788572217.335589:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638933376 00000100:00100000:0.0:1788572217.335601:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638933888 00000100:00100000:0.0:1788572217.335603:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638933888 00000100:00100000:0.0:1788572217.335617:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:0.0:1788572217.335623:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3653:x1875449638933504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572217.335643:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2232 count 1 00002000:00010000:0.0:1788572217.335680:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572217.335686:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085c805f4/0xdb7edb52b831ed5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.335699:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b8:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:0.0:1788572217.335702:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572217.335708:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085c805f4/0xdb7edb52b831ed5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.335719:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085c805f4/0xdb7edb52b831ed5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.335728:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085c805f4/0xdb7edb52b831ed5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.335736:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085c805f4/0xdb7edb52b831ed5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.335754:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572217.335876:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3653:x1875449638933504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 252us (741us total) trans 8589935543 rc 0/0 00000100:00100000:0.0:1788572217.335882:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000100:00100000:1.0:1788572217.335985:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960 00000100:00100000:1.0:1788572217.335994:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3653:x1875449638934016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.336024:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2236 count 1 00002000:00010000:1.0:1788572217.336039:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572217.336045:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ed65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336054:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8bc:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:1.0:1788572217.336057:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572217.336061:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ed65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336072:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ed65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336080:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ed65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336087:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ed65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336101:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572217.336176:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+13:3653:x1875449638934016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 184us (1002us total) trans 8589935544 rc 0/0 00000100:00100000:1.0:1788572217.336182:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960 00000100:00100000:1.0:1788572217.336195:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961 00000100:00100000:1.0:1788572217.336201:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3653:x1875449638933376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.336212:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2231 count 1 00002000:00010000:1.0:1788572217.336226:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572217.336241:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a68627f/0xdb7edb52b831ed6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336249:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b7:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:1.0:1788572217.336252:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572217.336257:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a68627f/0xdb7edb52b831ed6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336382:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a68627f/0xdb7edb52b831ed6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336391:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a68627f/0xdb7edb52b831ed6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336398:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a68627f/0xdb7edb52b831ed6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336419:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572217.336483:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+13:3653:x1875449638933376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 281us (1270us total) trans 8589935545 rc 0/0 00000100:00100000:1.0:1788572217.336489:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961 00000100:00100000:1.0:1788572217.336501:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962 00000100:00100000:1.0:1788572217.336507:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3653:x1875449638933888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572217.336519:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2235 count 1 00002000:00010000:1.0:1788572217.336533:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572217.336538:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c6e3fb/0xdb7edb52b831ed73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336547:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8bb:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:1.0:1788572217.336550:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572217.336554:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c6e3fb/0xdb7edb52b831ed73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336569:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7c6e3fb/0xdb7edb52b831ed73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336577:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c6e3fb/0xdb7edb52b831ed73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336584:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c6e3fb/0xdb7edb52b831ed73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.336598:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788572217.336669:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+13:3653:x1875449638933888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 161us (1409us total) trans 8589935546 rc 0/0 00000100:00100000:1.0:1788572217.336675:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962 00010000:00010000:0.0:1788572217.336767:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572217.336774:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085c805f4/0xdb7edb52b831ed5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.336782:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.336787:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085c805f4/0xdb7edb52b831ed5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.336802:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085c805f4/0xdb7edb52b831ed5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.336818:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085c805f4/0xdb7edb52b831ed5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.336825:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085c805f4/0xdb7edb52b831ed5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.336848:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572217.336852:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ed65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.336859:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad52800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.336862:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ed65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.336869:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ed65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.336879:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ed65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.336886:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ed65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.336979:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572217.336983:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a68627f/0xdb7edb52b831ed6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.336990:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad53400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.336993:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a68627f/0xdb7edb52b831ed6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.337001:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a68627f/0xdb7edb52b831ed6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.337036:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a68627f/0xdb7edb52b831ed6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.337043:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a68627f/0xdb7edb52b831ed6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.337055:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572217.337058:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7c6e3fb/0xdb7edb52b831ed73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.337065:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad52e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.337069:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c6e3fb/0xdb7edb52b831ed73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.337082:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c6e3fb/0xdb7edb52b831ed73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.337092:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7c6e3fb/0xdb7edb52b831ed73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.337098:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7c6e3fb/0xdb7edb52b831ed73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.337109:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572217.337111:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572217.337112:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572217.337120:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572217.337190:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13b80/2, rc 0, transno 8589935545 00000100:00100000:0.0:1788572217.337205:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638933376:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.337217:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11500/2, rc 0, transno 8589935546 00000100:00100000:0.0:1788572217.337220:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638933888:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.337227:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10380/2, rc 0, transno 8589935543 00000100:00100000:0.0:1788572217.337406:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638933504:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572217.337421:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12300/2, rc 0, transno 8589935544 00000100:00100000:0.0:1788572217.337425:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638934016:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572217.337518:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634b28380/2, rc 0, transno 8589935540 00000100:00100000:3.0:1788572217.337567:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638933120:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.337580:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638933632:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572217.337615:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.337644:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638933632 00000100:00100000:3.0:1788572217.337662:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638933632 00000100:00100000:3.0:1788572217.337700:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963 00000100:00100000:3.0:1788572217.337707:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3650:x1875449638933632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572217.337723:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2233 count 1 00002000:00010000:3.0:1788572217.337744:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572217.337750:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079d9f991/0xdb7edb52b831ed7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.337759:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b9:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:3.0:1788572217.337763:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572217.337767:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079d9f991/0xdb7edb52b831ed7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.337777:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079d9f991/0xdb7edb52b831ed7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.337785:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079d9f991/0xdb7edb52b831ed7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.337793:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079d9f991/0xdb7edb52b831ed7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.337807:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572217.338137:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3650:x1875449638933632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 429us (520us total) trans 8589935547 rc 0/0 00000100:00100000:3.0:1788572217.338144:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963 00010000:00010000:3.0:1788572217.338165:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572217.338171:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079d9f991/0xdb7edb52b831ed7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.338183:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f4600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572217.338186:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079d9f991/0xdb7edb52b831ed7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.338195:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079d9f991/0xdb7edb52b831ed7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.338207:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079d9f991/0xdb7edb52b831ed7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.338215:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079d9f991/0xdb7edb52b831ed7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.338340:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572217.338343:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572217.338345:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572217.338372:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10000/2, rc 0, transno 8589935547 00010000:00010000:2.0:1788572217.338429:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.338435:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572217.338448:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638933248:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.338479:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.338519:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638933760:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572217.338540:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.338711:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638934272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.338733:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.338748:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638934784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.338764:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.338778:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788572217.338783:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638934144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.338801:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.338815:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638934656:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572217.338832:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572217.338855:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638933248 00000100:00100000:2.0:1788572217.338860:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638933248 00000100:00100000:2.0:1788572217.338885:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638933760 00000100:00100000:2.0:1788572217.338888:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638933760 00000100:00100000:2.0:1788572217.338915:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638934272 00000100:00100000:2.0:1788572217.338918:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638934272 00000100:00100000:2.0:1788572217.338932:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638934784 00000100:00100000:2.0:1788572217.338935:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638934784 00000100:00100000:2.0:1788572217.338946:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638934144 00000100:00100000:2.0:1788572217.338948:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638934144 00000100:00100000:2.0:1788572217.338957:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638934656 00000100:00100000:2.0:1788572217.338959:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638934656 00000100:00100000:2.0:1788572217.338971:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2964 00000100:00100000:2.0:1788572217.338976:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449638933248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.338993:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2225 count 1 00000100:00100000:2.0:1788572217.339082:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449638933248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 105us (601us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572217.339088:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2964 00000100:00100000:2.0:1788572217.339102:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965 00000100:00100000:2.0:1788572217.339107:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3651:x1875449638933760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572217.339118:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2234 count 1 00002000:00010000:2.0:1788572217.339138:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.339144:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339154:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8ba:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.339158:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.339164:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339174:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339183:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339191:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339207:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.339217:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.339220:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339227:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.339241:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339250:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339262:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339390:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4a74a7f/0xdb7edb52b831ed81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339406:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.339409:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.339411:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572217.339424:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966 00000100:00100000:2.0:1788572217.339432:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3651:x1875449638934272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.339445:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2227 count 1 00002000:00010000:2.0:1788572217.339461:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.339466:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339475:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b3:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.339479:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.339482:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339491:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339499:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339505:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339516:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572217.339619:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449638934272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 187us (884us total) trans 4294968241 rc 0/0 00000100:00100000:2.0:1788572217.339626:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966 00000100:00100000:2.0:1788572217.339639:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967 00000100:00100000:2.0:1788572217.339645:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3651:x1875449638934784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.339673:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2231 count 1 00002000:00010000:2.0:1788572217.339687:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.339692:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339699:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b7:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.339702:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.339705:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339714:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339721:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339728:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339748:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572217.339809:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449638934784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 164us (1043us total) trans 4294968242 rc 0/0 00000100:00100000:2.0:1788572217.339816:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967 00000100:00100000:2.0:1788572217.339828:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:2.0:1788572217.339834:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3651:x1875449638934144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.339845:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2226 count 1 00002000:00010000:2.0:1788572217.339860:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.339864:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339874:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b2:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.339877:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.339881:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.339889:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340031:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572217.340037:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340049:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.340051:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340058:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340071:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340078:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066a6ba11/0xdb7edb52b831ed88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340092:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572217.340095:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340102:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.340105:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340113:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340123:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed8f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340131:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a0f5e21/0xdb7edb52b831ed8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340142:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572217.340143:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572217.340145:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572217.340159:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:0.0:1788572217.340168:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3651:x1875449638934656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.340181:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2230 count 1 00002000:00010000:0.0:1788572217.340196:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572217.340201:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004cf957d/0xdb7edb52b831ed9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340210:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b6:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:0.0:1788572217.340212:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572217.340216:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004cf957d/0xdb7edb52b831ed9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340225:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004cf957d/0xdb7edb52b831ed9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340233:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004cf957d/0xdb7edb52b831ed9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340240:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004cf957d/0xdb7edb52b831ed9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340256:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572217.340394:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449638934656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 227us (1559us total) trans 4294968243 rc 0/0 00000100:00100000:0.0:1788572217.340401:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00100000:0.0:1788572217.340441:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638934528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.340473:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.340498:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638934528 00000100:00100000:0.0:1788572217.340503:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638934528 00000100:00100000:0.0:1788572217.340532:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970 00000100:00100000:0.0:1788572217.340538:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3653:x1875449638934528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.340550:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2229 count 1 00002000:00010000:0.0:1788572217.340564:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572217.340569:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f87927a/0xdb7edb52b831eda4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340576:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b5:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:0.0:1788572217.340579:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572217.340583:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f87927a/0xdb7edb52b831eda4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340592:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f87927a/0xdb7edb52b831eda4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340601:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f87927a/0xdb7edb52b831eda4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340611:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f87927a/0xdb7edb52b831eda4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340624:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572217.340701:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3653:x1875449638934528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 162us (227us total) trans 4294968244 rc 0/0 00000100:00100000:0.0:1788572217.340707:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970 00000004:00080000:0.0:1788572217.340746:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490e00/2, rc 0, transno 4294968244 00000100:00100000:0.0:1788572217.340757:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638934528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.340767:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788572217.340773:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638934400:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.340794:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572217.340812:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638934400 00000100:00100000:0.0:1788572217.340816:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638934400 00000100:00100000:0.0:1788572217.340836:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971 00000100:00100000:0.0:1788572217.340843:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+11:3653:x1875449638934400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572217.340854:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2228 count 1 00002000:00010000:0.0:1788572217.340868:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572217.340873:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ec7c20/0xdb7edb52b831edab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.340881:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b4:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:0.0:1788572217.340884:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572217.340887:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ec7c20/0xdb7edb52b831edab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341075:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341084:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341098:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788572217.341165:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3651:x1875449638934144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1331us (2362us total) trans 4294968245 rc 0/0 00000100:00100000:2.0:1788572217.341171:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00010000:00010000:2.0:1788572217.341189:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572217.341194:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004cf957d/0xdb7edb52b831ed9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341201:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.341205:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004cf957d/0xdb7edb52b831ed9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341213:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004cf957d/0xdb7edb52b831ed9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341236:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004cf957d/0xdb7edb52b831ed9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341244:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004cf957d/0xdb7edb52b831ed9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.341375:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5ec7c20/0xdb7edb52b831edab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.341385:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ec7c20/0xdb7edb52b831edab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.341391:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ec7c20/0xdb7edb52b831edab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.341405:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788572217.341413:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572217.341417:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f87927a/0xdb7edb52b831eda4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.341423:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.341426:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f87927a/0xdb7edb52b831eda4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.341434:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f87927a/0xdb7edb52b831eda4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.341444:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f87927a/0xdb7edb52b831eda4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.341451:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f87927a/0xdb7edb52b831eda4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341641:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572217.341647:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341663:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.341667:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341675:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341686:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341693:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d354fa08/0xdb7edb52b831ed96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341706:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.341708:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5ec7c20/0xdb7edb52b831edab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341714:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.341717:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ec7c20/0xdb7edb52b831edab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341723:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ec7c20/0xdb7edb52b831edab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341732:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5ec7c20/0xdb7edb52b831edab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.341739:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5ec7c20/0xdb7edb52b831edab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.341772:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572217.341774:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572217.341776:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572217.341859:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+12:3653:x1875449638934400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1016us (1063us total) trans 4294968246 rc 0/0 00000100:00100000:0.0:1788572217.341866:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971 00000004:00080000:0.0:1788572217.341971:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493b80/2, rc 0, transno 4294968246 00000100:00100000:0.0:1788572217.341976:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638934400:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.341984:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638934912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.342058:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572217.342429:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.342431:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.342433:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.342439:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.342444:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572217.342530:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3651:x1875449638933760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3422us (3988us total) trans 8589935548 rc 0/0 00000100:00100000:2.0:1788572217.342537:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965 00000100:00100000:2.0:1788572217.342552:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638934912 00000100:00100000:2.0:1788572217.342557:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638934912 00000100:00100000:2.0:1788572217.342593:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972 00000100:00100000:2.0:1788572217.342599:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3653:x1875449638934912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572217.342619:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2232 count 1 00002000:00010000:2.0:1788572217.342638:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572217.342644:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831edb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.342665:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b8:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:2.0:1788572217.342669:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572217.342675:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831edb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.342686:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831edb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.342695:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831edb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.342702:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831edb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.342714:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572217.342768:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3653:x1875449638934912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 169us (710us total) trans 4294968247 rc 0/0 00000100:00100000:2.0:1788572217.342774:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972 00000004:00080000:2.0:1788572217.342807:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490a80/2, rc 0, transno 4294968245 00000100:00100000:2.0:1788572217.342813:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638934144:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.342821:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57c700/2, rc 0, transno 4294968243 00000100:00100000:2.0:1788572217.342825:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638934656:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.342833:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493800/2, rc 0, transno 4294968241 00000100:00100000:2.0:1788572217.342836:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638934272:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.342844:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57ce00/2, rc 0, transno 4294968242 00000100:00100000:2.0:1788572217.342847:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638934784:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.342855:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493100, transno 0 00000004:00080000:2.0:1788572217.342857:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493100/1, rc -2, transno 0 00000100:00100000:2.0:1788572217.342860:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638933248:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572217.342869:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11f80/2, rc 0, transno 8589935548 00000100:00100000:2.0:1788572217.342876:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638933760:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572217.343111:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572217.343117:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831edb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.343125:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572217.343130:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831edb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.343139:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831edb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.343151:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831edb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.343159:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007efde0cc/0xdb7edb52b831edb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572217.343176:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572217.343177:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572217.343179:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572217.343200:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57f480/2, rc 0, transno 4294968247 00000100:00100000:0.0:1788572217.343205:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638934912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.343463:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638935040:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572217.343499:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572217.343566:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638935040 00000100:00100000:1.0:1788572217.343572:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638935040 00000100:00100000:1.0:1788572217.343613:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2973 00000100:00100000:1.0:1788572217.343620:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+13:3653:x1875449638935040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572217.343637:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2233 count 1 00002000:00010000:1.0:1788572217.343669:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572217.343676:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001615a74d/0xdb7edb52b831edb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.343686:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b9:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:1.0:1788572217.343689:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572217.343695:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001615a74d/0xdb7edb52b831edb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.343706:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001615a74d/0xdb7edb52b831edb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.343715:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001615a74d/0xdb7edb52b831edb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.343722:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001615a74d/0xdb7edb52b831edb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572217.343741:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572217.343852:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572217.343857:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001615a74d/0xdb7edb52b831edb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.343864:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad53200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572217.343868:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001615a74d/0xdb7edb52b831edb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.343876:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001615a74d/0xdb7edb52b831edb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.343887:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001615a74d/0xdb7edb52b831edb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.343910:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001615a74d/0xdb7edb52b831edb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.343925:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.343927:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572217.343928:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572217.344122:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638933632:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572217.344138:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572217.344153:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638935168:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.344183:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.344207:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638935168 00000100:00100000:3.0:1788572217.344211:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638935168 00000100:00100000:3.0:1788572217.344252:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974 00000100:00100000:3.0:1788572217.344259:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3650:x1875449638935168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.344282:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2234 count 1 00002000:00010000:3.0:1788572217.344301:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572217.344307:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831edc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344316:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8ba:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:3.0:1788572217.344320:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572217.344324:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831edc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344334:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831edc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344342:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831edc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344349:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831edc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344364:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572217.344437:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3650:x1875449638935168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 179us (253us total) trans 4294968249 rc 0/0 00000100:00100000:3.0:1788572217.344444:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974 00010000:00010000:3.0:1788572217.344462:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572217.344466:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831edc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344478:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f4e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572217.344481:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831edc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344489:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831edc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344501:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831edc0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344508:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831edc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344521:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572217.344523:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572217.344525:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572217.344549:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db1f80/2, rc 0, transno 4294968249 00000100:00100000:3.0:1788572217.344555:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638935168:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.344563:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572217.344567:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638935296:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.344590:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.344631:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638935424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572217.344662:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572217.344694:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638935296 00000100:00100000:3.0:1788572217.344698:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638935296 00000100:00100000:3.0:1788572217.344718:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638935424 00000100:00100000:3.0:1788572217.344722:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638935424 00000100:00100000:3.0:1788572217.344742:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975 00000100:00100000:3.0:1788572217.344748:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3650:x1875449638935296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.344760:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2235 count 1 00002000:00010000:3.0:1788572217.344775:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572217.344780:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344788:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8bb:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:3.0:1788572217.344791:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572217.344796:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344805:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344813:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344820:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344833:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572217.344910:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3650:x1875449638935296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 162us (318us total) trans 4294968250 rc 0/0 00000100:00100000:3.0:1788572217.344917:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975 00000100:00100000:3.0:1788572217.344929:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976 00000100:00100000:3.0:1788572217.344935:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3652:x1875449638935424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572217.344946:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2236 count 1 00002000:00010000:3.0:1788572217.344959:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572217.344964:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344972:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8bc:0x0].0x0 since=4134s v=(0 0) 00010000:00010000:3.0:1788572217.344975:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572217.344980:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344989:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.344998:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345034:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345047:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572217.345108:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3652:x1875449638935424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 173us (445us total) trans 4294968251 rc 0/0 00000100:00100000:3.0:1788572217.345114:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976 00000004:00080000:3.0:1788572217.345142:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db0000/2, rc 0, transno 4294968250 00000100:00100000:3.0:1788572217.345147:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638935296:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572217.345163:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db0a80/2, rc 0, transno 4294968251 00000100:00100000:3.0:1788572217.345167:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638935424:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572217.345196:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572217.345202:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345209:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f5200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572217.345213:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345220:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345232:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edc7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345239:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345265:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572217.345269:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345276:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f5e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572217.345279:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345290:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345300:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345307:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572217.345319:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572217.345320:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572217.345322:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572217.345831:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+17:3653:x1875449638935040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2208us (2327us total) trans 4294968248 rc 0/0 00000100:00100000:1.0:1788572217.345839:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2973 00000004:00080000:0.0:1788572217.345984:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3b80/2, rc 0, transno 4294968248 00000100:00100000:0.0:1788572217.345991:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638935040:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572217.346037:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572217.409753:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572217.409903:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615202304 00000100:00100000:2.0:1788572217.409912:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615202304 00000100:00100000:2.0:1788572217.409972:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11055 00000100:00100000:2.0:1788572217.409983:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:86348:x1875449615202304:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788572217.410042:0:95742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572217.410132:0:95742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831edd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb45a5c expref: -99 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.410354:0:95742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831eddc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.410368:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831eddc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.410378:0:95742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831eddc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572217.410439:0:95742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1788572217.410443:0:95742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572217.410491:0:95742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831eddc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.410531:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b2800/0xdb7edb52b831edd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a5c expref: 8 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.410555:0:95742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3800/0xdb7edb52b831eddc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a5c expref: 7 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572217.410561:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194000) 00010000:00010000:2.0:1788572217.410564:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572217.410569:0:95742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e6416b3800, rc 0) 00000100:00100000:2.0:1788572217.410706:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+7:86348:x1875449615202304:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 724us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572217.410713:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11055 00000100:00100000:2.0:1788572217.424153:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572217.424673:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615202432 00000100:00100000:3.0:1788572217.424684:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615202432 00000100:00100000:3.0:1788572217.424872:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11056 00000100:00100000:3.0:1788572217.424885:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:86348:x1875449615202432:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:3.0:1788572217.424931:0:6551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445969920 avail 1299730432 00000100:00100000:3.0:1788572217.425041:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:86348:x1875449615202432:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 159us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572217.425049:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11056 00000100:00100000:3.0:1788572217.428797:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572217.428879:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615202560 00000100:00100000:0.0:1788572217.428888:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615202560 00000100:00100000:0.0:1788572217.428961:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11057 00000100:00100000:0.0:1788572217.428974:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:86348:x1875449615202560:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572217.429064:0:6550:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572217.429134:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:86348:x1875449615202560:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 163us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572217.429141:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11057 00000100:00080000:2.0:1788572217.429208:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572217.434746:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572217.434853:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615202688 00000100:00100000:2.0:1788572217.434862:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615202688 00000100:00100000:2.0:1788572217.434937:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2766 00000100:00100000:2.0:1788572217.434957:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+10:86348:x1875449615202688:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:2.0:1788572217.434981:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923480576 avail 3691958272 00000100:00100000:2.0:1788572217.435074:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+10:86348:x1875449615202688:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 118us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572217.435081:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2766 00000100:00080000:3.0:1788572217.435140:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572217.441198:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572217.441404:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615202816 00000100:00100000:3.0:1788572217.441415:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615202816 00000100:00080000:2.0:1788572217.441545:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572217.441659:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2767 00000100:00100000:3.0:1788572217.441671:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+9:86348:x1875449615202816:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:3.0:1788572217.441702:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572217.441789:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+9:86348:x1875449615202816:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 115us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572217.441797:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2767 00010000:00010000:2.0:1788572218.051984:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572218.373229:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572218.373264:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449638935552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572218.373334:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572218.373510:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638935552 00000100:00100000:2.0:1788572218.373519:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638935552 00000100:00100000:2.0:1788572218.373591:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768 00000100:00100000:2.0:1788572218.373601:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449638935552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572218.373627:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923480576 avail 3691958272 00000100:00100000:2.0:1788572218.373686:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449638935552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572218.373693:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768 00000100:00080000:3.0:1788572218.373753:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572218.373792:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449638935552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572218.884226:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449638935680:0@lo:400:kworker.0 00000100:00100000:3.0:1788572218.884315:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572218.884397:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449638936192:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.884412:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449638936064:0@lo:400:kworker.0 00000100:00100000:3.0:1788572218.884430:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572218.884490:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638936192 00000100:00100000:1.0:1788572218.884500:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638936192 00000100:00100000:1.0:1788572218.884562:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4379 00000100:00100000:1.0:1788572218.884572:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449638936192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.884635:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449638935936:0@lo:400:kworker.0 00000100:00080000:2.0:1788572218.887316:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572218.887337:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638935680 00000100:00100000:2.0:1788572218.887344:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638935680 00000100:00100000:2.0:1788572218.887393:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788572218.887401:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449638935680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.888072:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572218.888113:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449638936448:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.888141:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572218.888163:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638936960:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.888187:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572218.888240:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638935808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.888267:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572218.888286:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638936320:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.888316:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572218.888336:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638936832:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.888355:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572218.888375:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572218.888381:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638937216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572218.888579:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572218.889521:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638935936 00000100:00100000:0.0:1788572218.889535:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638935936 00000100:00100000:0.0:1788572218.889608:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638936448 00000100:00100000:0.0:1788572218.889611:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638936448 00000100:00100000:0.0:1788572218.889756:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4380 00000100:00100000:0.0:1788572218.889772:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449638935936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.889865:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449638935936:12345-0@lo:400:kworker.0 Request processed in 100us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572218.889873:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4380 00000100:00100000:0.0:1788572218.889899:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4381 00000100:00100000:0.0:1788572218.889906:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449638936448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.889944:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449638936448:12345-0@lo:400:kworker.0 Request processed in 38us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572218.889950:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4381 00000100:00100000:0.0:1788572218.890049:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572218.890074:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449638936576:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.890098:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572218.890110:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449638937088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.890129:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572218.890151:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638936064 00000100:00100000:0.0:1788572218.890154:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638936064 00000100:00100000:0.0:1788572218.890172:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638936576 00000100:00100000:0.0:1788572218.890174:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638936576 00000100:00100000:0.0:1788572218.890185:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638937088 00000100:00100000:0.0:1788572218.890187:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638937088 00000100:00100000:0.0:1788572218.890197:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4382 00000100:00100000:0.0:1788572218.890203:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449638936064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.890875:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449638936064:12345-0@lo:400:kworker.0 Request processed in 669us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572218.890887:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4382 00000100:00100000:0.0:1788572218.890907:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4383 00000100:00100000:0.0:1788572218.890919:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449638936576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.891038:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449638936576:12345-0@lo:400:kworker.0 Request processed in 124us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572218.891044:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4383 00000100:00100000:0.0:1788572218.891055:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4384 00000100:00100000:0.0:1788572218.891061:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449638937088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.891083:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449638937088:12345-0@lo:400:kworker.0 Request processed in 23us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572218.891089:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4384 00000100:00100000:0.0:1788572218.891135:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449638936064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.891149:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449638936576:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.891158:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503933100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449638937088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.891190:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449638935936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.891200:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449638936448:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.892536:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638936960 00000100:00100000:0.0:1788572218.893301:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638936960 00000100:00100000:0.0:1788572218.893369:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638936320 00000100:00100000:0.0:1788572218.893373:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638936320 00000100:00100000:0.0:1788572218.893398:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638936832 00000100:00100000:0.0:1788572218.893401:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638936832 00000100:00100000:0.0:1788572218.894327:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3594 00000100:00100000:0.0:1788572218.894346:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:3652:x1875449638936960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.894446:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:3652:x1875449638936960:12345-0@lo:400:kworker.0 Request processed in 108us (6257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572218.894458:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3594 00000100:00100000:0.0:1788572218.894491:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3595 00000100:00100000:0.0:1788572218.894500:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449638936320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.895029:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449638936320:12345-0@lo:400:kworker.0 Request processed in 503us (6684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572218.895037:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3595 00000100:00100000:0.0:1788572218.895051:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3596 00000100:00100000:0.0:1788572218.895059:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+15:3651:x1875449638936832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.895097:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+15:3651:x1875449638936832:12345-0@lo:400:kworker.0 Request processed in 40us (6741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572218.895108:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3596 00000100:00100000:1.0:1788572218.895892:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449638936192:12345-0@lo:400:kworker.0 Request processed in 11315us (11455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572218.895905:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4379 00000100:00100000:2.0:1788572218.895920:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449638935680:12345-0@lo:400:kworker.0 Request processed in 8515us (11603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572218.895934:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788572218.896063:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638936320:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.896078:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638936832:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.896130:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638936960:0@lo:400:kworker.0 00000100:00100000:2.0:1788572218.896137:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638935808 00000100:00100000:2.0:1788572218.896146:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638935808 00000100:00100000:0.0:1788572218.896188:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638937216 00000100:00100000:0.0:1788572218.896193:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638937216 00000100:00100000:0.0:1788572218.896250:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:0.0:1788572218.896257:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638937216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572218.896292:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572218.896324:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:2.0:1788572218.896336:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449638935808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.896341:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638937216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (7759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572218.896348:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:0.0:1788572218.896382:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638937216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572218.896385:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449638935808:12345-0@lo:400:kworker.0 Request processed in 51us (8115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572218.896395:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00100000:0.0:1788572218.896398:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638935808:0@lo:400:kworker.0 00000100:00080000:2.0:1788572218.896421:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572218.896427:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572218.896430:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572218.896620:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449638936192:0@lo:400:kworker.0 00000100:00100000:3.0:1788572218.896646:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638936704:0@lo:400:kworker.0 00000100:00100000:3.0:1788572218.896680:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572218.896712:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449638935680:0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.898359:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638936704 00000100:00100000:0.0:1788572218.898370:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638936704 00000100:00100000:0.0:1788572218.898427:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:0.0:1788572218.898436:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638936704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572218.900465:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638936704:12345-0@lo:400:kworker.0 Request processed in 2021us (3775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572218.900478:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:2.0:1788572218.900695:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638936704:0@lo:400:kworker.0 00010000:00010000:1.0:1788572219.078781:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572219.304281:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572219.304325:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572219.304355:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572219.304382:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572219.304411:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572219.304444:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615203456 00000100:00100000:1.0:1788572219.304455:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615203456 00000100:00100000:1.0:1788572219.304510:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615203328 00000100:00100000:1.0:1788572219.304514:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615203328 00000100:00100000:1.0:1788572219.304538:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3597 00000100:00100000:1.0:1788572219.304550:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2386:x1875449615203456:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572219.304643:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2386:x1875449615203456:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 94us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572219.304650:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3597 00000100:00100000:1.0:1788572219.304678:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3598 00000100:00100000:1.0:1788572219.304685:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2386:x1875449615203328:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572219.304710:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2386:x1875449615203328:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572219.304716:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3598 00000100:00100000:1.0:1788572219.304740:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615203200 00000100:00100000:1.0:1788572219.304744:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615203200 00000100:00100000:1.0:1788572219.304778:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615203072 00000100:00100000:1.0:1788572219.304781:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615203072 00000100:00100000:1.0:1788572219.304808:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4385 00000100:00100000:1.0:1788572219.304815:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615203200:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572219.304841:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615203200:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572219.304850:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4385 00000100:00100000:1.0:1788572219.304862:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4386 00000100:00100000:1.0:1788572219.304867:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2386:x1875449615203072:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572219.304886:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2386:x1875449615203072:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 19us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572219.304892:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4386 00000100:00100000:3.0:1788572219.305221:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615202944 00000100:00100000:3.0:1788572219.305227:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615202944 00000100:00100000:3.0:1788572219.305274:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:3.0:1788572219.305281:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615202944:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572219.305317:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615202944:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 37us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572219.305328:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00080000:2.0:1788572219.305687:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572219.305692:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572219.305695:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572219.305698:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572219.398246:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572219.398272:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638937344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572219.398347:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572219.398484:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638937344 00000100:00100000:2.0:1788572219.398494:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638937344 00000100:00100000:2.0:1788572219.398552:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769 00000100:00100000:2.0:1788572219.398562:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449638937344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572219.398591:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572219.398660:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449638937344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572219.398668:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769 00000100:00100000:2.0:1788572219.398715:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638937344:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572220.103670:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572221.153894:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572222.147450:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572222.467215:0:112001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 4139488208255ns, next at 4140488205060ns, rc = 0 00000004:00080000:2.0:1788572222.467786:0:111999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4139488780465ns, next at 4140488778334ns, rc = 0 00000100:00100000:3.0:1788572222.468453:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638937728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572222.468529:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572222.468827:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638937728 00000100:00100000:2.0:1788572222.468839:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638937728 00000100:00100000:2.0:1788572222.468910:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000100:00100000:2.0:1788572222.468921:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3650:x1875449638937728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572222.468955:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923480576 avail 3691958272 00000100:00100000:2.0:1788572222.469037:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3650:x1875449638937728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572222.469044:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770 00000100:00100000:0.0:1788572222.469193:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638937472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572222.469230:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572222.469271:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572222.469278:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449638937600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572222.469306:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572222.469356:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638937600 00000100:00100000:0.0:1788572222.469360:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638937600 00000100:00100000:0.0:1788572222.469397:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:0.0:1788572222.469405:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449638937600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572222.469431:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445969920 avail 1299730432 00000100:00100000:0.0:1788572222.469467:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449638937600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572222.469473:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:0.0:1788572222.469518:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449638937600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572222.469607:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638937472 00000100:00100000:2.0:1788572222.469612:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638937472 00000100:00100000:2.0:1788572222.469652:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771 00000100:00100000:2.0:1788572222.469660:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+17:3652:x1875449638937472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572222.469681:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572222.469717:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+17:3652:x1875449638937472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572222.469723:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771 00000100:00080000:3.0:1788572222.470235:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572222.470240:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572222.470290:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638937728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572222.471388:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638937472:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788572222.472245:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788572222.472269:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:2.0:1788572222.473045:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638938112:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572222.473124:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572222.473160:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638938624:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572222.473183:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572222.473205:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788572222.473211:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638937984:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572222.473231:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572222.473245:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638938496:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572222.473262:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572222.473535:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638937856:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572222.473579:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572222.473609:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638938368:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572222.473630:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572222.473650:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788572222.473655:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638938240:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572222.473677:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572222.473693:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638938752:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572222.473712:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572222.473742:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638938112 00000100:00100000:0.0:1788572222.473750:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638938112 00000100:00100000:0.0:1788572222.473797:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638938624 00000100:00100000:0.0:1788572222.473800:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638938624 00000100:00100000:0.0:1788572222.473817:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638937984 00000100:00100000:0.0:1788572222.473821:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638937984 00000100:00100000:0.0:1788572222.473834:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638938496 00000100:00100000:0.0:1788572222.473837:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638938496 00000100:00100000:0.0:1788572222.473849:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638937856 00000100:00100000:0.0:1788572222.473852:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638937856 00000100:00100000:0.0:1788572222.473865:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638938368 00000100:00100000:0.0:1788572222.473868:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638938368 00000100:00100000:0.0:1788572222.474077:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638938240 00000100:00100000:0.0:1788572222.474081:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638938240 00000100:00100000:0.0:1788572222.474101:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638938752 00000100:00100000:0.0:1788572222.474104:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638938752 00000100:00100000:0.0:1788572222.474123:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977 00000100:00100000:0.0:1788572222.474131:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3653:x1875449638938112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572222.474158:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2239 count 1 00002000:00010000:0.0:1788572222.474194:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572222.474202:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc7247d/0xdb7edb52b831ede3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.474219:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8bf:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:0.0:1788572222.474224:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572222.474230:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc7247d/0xdb7edb52b831ede3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.474244:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc7247d/0xdb7edb52b831ede3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.474254:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc7247d/0xdb7edb52b831ede3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.474262:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc7247d/0xdb7edb52b831ede3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.474280:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572222.474853:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978 00000100:00100000:1.0:1788572222.474866:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+24:3653:x1875449638938624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572222.474896:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2243 count 1 00002000:00010000:1.0:1788572222.474917:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572222.474923:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a68627f/0xdb7edb52b831edea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.474933:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c3:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:1.0:1788572222.474936:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572222.474941:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a68627f/0xdb7edb52b831edea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.474952:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a68627f/0xdb7edb52b831edea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.474967:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a68627f/0xdb7edb52b831edea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.474975:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a68627f/0xdb7edb52b831edea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.474994:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572222.475173:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979 00000100:00100000:2.0:1788572222.475184:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+24:3653:x1875449638937984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572222.475201:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2238 count 1 00002000:00010000:2.0:1788572222.475219:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572222.475224:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831edf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.475233:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8be:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:2.0:1788572222.475235:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572222.475240:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831edf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.475250:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831edf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.475264:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831edf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.475282:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831edf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.475296:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788572222.475557:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980 00000100:00100000:3.0:1788572222.475568:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3653:x1875449638938496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572222.475589:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2242 count 1 00002000:00010000:3.0:1788572222.475606:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572222.475611:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.475618:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c2:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:3.0:1788572222.475621:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572222.475626:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.475635:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.475643:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.475655:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.475669:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1788572222.479086:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3653:x1875449638938496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3510us (5811us total) trans 4294968252 rc 0/0 00000100:00100000:3.0:1788572222.479101:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980 00000100:00100000:3.0:1788572222.479139:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2981 00000100:00100000:3.0:1788572222.479151:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449638937856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572222.479185:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2237 count 1 00002000:00010000:3.0:1788572222.479218:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572222.479225:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.479241:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8bd:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:3.0:1788572222.479245:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572222.479251:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.479265:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481026:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481048:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481093:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1788572222.481316:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3651:x1875449638937856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2158us (7734us total) trans 4294968256 rc 0/0 00000100:00100000:3.0:1788572222.481329:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2981 00000100:00100000:3.0:1788572222.481370:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2982 00000100:00100000:3.0:1788572222.481380:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449638938368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572222.481405:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2241 count 1 00002000:00010000:3.0:1788572222.481435:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572222.481440:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831ee06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481453:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c1:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:3.0:1788572222.481458:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572222.481464:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831ee06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481477:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831ee06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481485:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831ee06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481496:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831ee06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481504:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1788572222.481565:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3651:x1875449638938368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 188us (7933us total) trans 4294968257 rc 0/0 00000100:00100000:3.0:1788572222.481583:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2982 00000100:00100000:3.0:1788572222.481596:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2983 00000100:00100000:3.0:1788572222.481603:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449638938240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572222.481618:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2240 count 1 00002000:00010000:3.0:1788572222.481634:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572222.481638:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079d9f991/0xdb7edb52b831ee0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481647:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c0:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:3.0:1788572222.481650:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572222.481654:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079d9f991/0xdb7edb52b831ee0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481662:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079d9f991/0xdb7edb52b831ee0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481670:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079d9f991/0xdb7edb52b831ee0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481682:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079d9f991/0xdb7edb52b831ee0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.481690:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:3.0:1788572222.481751:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3651:x1875449638938240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 149us (8072us total) trans 4294968258 rc 0/0 00000100:00100000:3.0:1788572222.481757:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2983 00000100:00100000:3.0:1788572222.481770:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984 00000100:00100000:3.0:1788572222.481777:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449638938752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572222.481790:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2244 count 1 00002000:00010000:3.0:1788572222.481805:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572222.481810:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d486b3/0xdb7edb52b831ee14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482032:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c4:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:3.0:1788572222.482035:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572222.482040:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d486b3/0xdb7edb52b831ee14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482049:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8d486b3/0xdb7edb52b831ee14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482058:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d486b3/0xdb7edb52b831ee14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482081:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d486b3/0xdb7edb52b831ee14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482089:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:3.0:1788572222.482154:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3651:x1875449638938752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 377us (8440us total) trans 4294968259 rc 0/0 00000100:00100000:3.0:1788572222.482161:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984 00010000:00010000:3.0:1788572222.482198:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788572222.482206:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc7247d/0xdb7edb52b831ede3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482215:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641376000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572222.482219:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc7247d/0xdb7edb52b831ede3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482229:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc7247d/0xdb7edb52b831ede3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482246:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc7247d/0xdb7edb52b831ede3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482254:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc7247d/0xdb7edb52b831ede3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482277:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788572222.482281:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a68627f/0xdb7edb52b831edea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482287:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad53400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572222.482290:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a68627f/0xdb7edb52b831edea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482297:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a68627f/0xdb7edb52b831edea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482306:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a68627f/0xdb7edb52b831edea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482313:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a68627f/0xdb7edb52b831edea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482327:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788572222.482331:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831edf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482337:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572222.482340:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831edf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482512:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831edf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482530:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831edf1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482537:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3c64d7d/0xdb7edb52b831edf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482551:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572222.482555:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482562:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f5200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572222.482565:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482582:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482592:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edf8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482608:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057f36ddf/0xdb7edb52b831edf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482622:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572222.482626:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482633:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f5e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572222.482636:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482644:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482654:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482661:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a126efc8/0xdb7edb52b831edff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482672:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572222.482676:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831ee06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482683:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f4e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572222.482686:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831ee06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482694:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831ee06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482703:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831ee06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482711:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d7b6230/0xdb7edb52b831ee06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482722:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572222.482725:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079d9f991/0xdb7edb52b831ee0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482730:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f4600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572222.482732:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079d9f991/0xdb7edb52b831ee0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482739:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079d9f991/0xdb7edb52b831ee0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482747:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079d9f991/0xdb7edb52b831ee0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482753:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079d9f991/0xdb7edb52b831ee0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482763:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572222.482766:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8d486b3/0xdb7edb52b831ee14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482771:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f5600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572222.482774:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d486b3/0xdb7edb52b831ee14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482781:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d486b3/0xdb7edb52b831ee14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482788:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8d486b3/0xdb7edb52b831ee14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482795:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8d486b3/0xdb7edb52b831ee14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.482805:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572222.482806:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572222.482808:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572222.482835:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572222.482873:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638938880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572222.482926:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572222.482966:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638939392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572222.482988:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572222.487176:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778ea00/2, rc 0, transno 4294968258 00000100:00100000:3.0:1788572222.487222:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638938240:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572222.487265:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778dc00/2, rc 0, transno 4294968259 00000100:00100000:3.0:1788572222.487269:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638938752:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572222.489534:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778ca80/2, rc 0, transno 4294968256 00000100:00100000:3.0:1788572222.489545:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638937856:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572222.489557:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778c700/2, rc 0, transno 4294968257 00000100:00100000:3.0:1788572222.489561:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638938368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572222.489590:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788572222.489605:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638939264:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572222.489681:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572222.489728:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638939776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572222.489748:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572222.489796:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638938880 00000100:00100000:3.0:1788572222.489803:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638938880 00000100:00100000:2.0:1788572222.494661:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638939904:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572222.494741:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572222.494790:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572222.494796:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638940288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572222.494832:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572222.494867:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638939392 00000100:00100000:2.0:1788572222.494874:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638939392 00000100:00100000:2.0:1788572222.494924:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638939264 00000100:00100000:2.0:1788572222.494928:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638939264 00000100:00100000:2.0:1788572222.494939:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638939776 00000100:00100000:2.0:1788572222.494941:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638939776 00000100:00100000:2.0:1788572222.494949:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638939904 00000100:00100000:2.0:1788572222.494951:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638939904 00000100:00100000:2.0:1788572222.494960:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638940288 00000100:00100000:2.0:1788572222.494962:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638940288 00000100:00100000:2.0:1788572222.494974:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985 00000100:00100000:2.0:1788572222.494982:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3651:x1875449638939392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572222.495025:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2241 count 1 00002000:00010000:2.0:1788572222.495061:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572222.495080:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ee1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495099:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c1:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:2.0:1788572222.495104:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572222.495111:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ee1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495126:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ee1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495137:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ee1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495146:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ee1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495166:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572222.495343:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3651:x1875449638939392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 360us (12351us total) trans 8589935549 rc 0/0 00000100:00100000:2.0:1788572222.495359:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985 00000100:00100000:2.0:1788572222.495377:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986 00000100:00100000:2.0:1788572222.495383:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3651:x1875449638939264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572222.495398:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2240 count 1 00002000:00010000:2.0:1788572222.495413:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572222.495417:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831ee22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495430:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c0:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:2.0:1788572222.495433:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572222.495437:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831ee22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495445:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831ee22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495452:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831ee22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495459:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831ee22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495473:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572222.495533:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3651:x1875449638939264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 150us (5851us total) trans 8589935550 rc 0/0 00000100:00100000:2.0:1788572222.495538:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986 00000100:00100000:2.0:1788572222.495550:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987 00000100:00100000:2.0:1788572222.495556:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3651:x1875449638939776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572222.495568:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2244 count 1 00002000:00010000:2.0:1788572222.495593:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572222.495598:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831ee29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495610:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c4:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:2.0:1788572222.495613:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572222.495616:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831ee29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495624:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831ee29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495632:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831ee29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495640:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831ee29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495648:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788572222.495716:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3651:x1875449638939776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 160us (5966us total) trans 8589935551 rc 0/0 00000100:00100000:2.0:1788572222.495723:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987 00000100:00100000:2.0:1788572222.495735:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988 00000100:00100000:2.0:1788572222.495742:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3651:x1875449638939904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572222.495754:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2245 count 1 00002000:00010000:2.0:1788572222.495771:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572222.495775:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ee30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495787:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c5:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:2.0:1788572222.495790:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572222.495794:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ee30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495804:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ee30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495811:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ee30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495819:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ee30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.495827:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1788572222.496387:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989 00000100:00100000:2.0:1788572222.496399:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3651:x1875449638940288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572222.496416:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2248 count 1 00002000:00010000:2.0:1788572222.496433:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572222.496438:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ee37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496448:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c8:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:2.0:1788572222.496451:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572222.496454:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ee37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496464:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ee37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496473:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ee37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496480:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ee37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496488:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788572222.496511:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788572222.496519:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ee1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496526:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572222.496531:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ee1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496541:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ee1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496560:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ee1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496579:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5affd11/0xdb7edb52b831ee1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496613:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572222.496617:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831ee22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496623:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572222.496627:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831ee22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496634:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831ee22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496643:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831ee22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496651:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030983a4c/0xdb7edb52b831ee22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496663:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572222.496667:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831ee29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496673:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572222.496676:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831ee29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496689:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831ee29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496699:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831ee29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496707:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070b1f926/0xdb7edb52b831ee29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496716:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572222.496720:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ee30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496725:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572222.496728:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ee30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496735:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ee30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496743:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ee30 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496750:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006535072/0xdb7edb52b831ee30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496769:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572222.496772:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ee37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496779:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572222.496782:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ee37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496789:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ee37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496800:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ee37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496806:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018288988/0xdb7edb52b831ee37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.496818:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572222.496820:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572222.496822:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572222.496829:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572222.496886:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637672680/2, rc 0, transno 8589935550 00000100:00100000:2.0:1788572222.496912:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638939264:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572222.496927:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13100/2, rc 0, transno 8589935551 00000100:00100000:2.0:1788572222.496931:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638939776:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572222.496941:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637673480/2, rc 0, transno 8589935549 00000100:00100000:2.0:1788572222.496944:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638939392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572222.497062:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638940416:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572222.497113:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572222.497191:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+29:3653:x1875449638937984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22010us (23959us total) trans 4294968253 rc 0/0 00000100:00100000:2.0:1788572222.497201:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979 00000100:00100000:2.0:1788572222.497223:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638940416 00000100:00100000:2.0:1788572222.497230:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638940416 00000100:00100000:2.0:1788572222.497256:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990 00000100:00100000:2.0:1788572222.497262:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+19:3651:x1875449638940416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572222.497277:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2245 count 1 00002000:00010000:2.0:1788572222.497298:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572222.497303:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ee3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.497314:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c5:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:2.0:1788572222.497317:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572222.497321:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ee3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.497330:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ee3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.497338:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ee3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.497349:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ee3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.497364:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572222.497372:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572222.497376:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ee3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.497382:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572222.497386:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ee3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.497394:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ee3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.497404:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ee3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.497411:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abf3aeb2/0xdb7edb52b831ee3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.497423:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572222.497425:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572222.497426:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572222.497500:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638939136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572222.497531:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572222.497550:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638939648:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572222.497627:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638939136 00000100:00100000:3.0:1788572222.497633:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638939136 00000100:00100000:3.0:1788572222.497653:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991 00000100:00100000:3.0:1788572222.497659:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+20:3653:x1875449638939136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572222.497671:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2239 count 1 00002000:00010000:3.0:1788572222.497689:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572222.497694:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ac774dc/0xdb7edb52b831ee45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.497703:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8bf:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:3.0:1788572222.497706:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572222.497709:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac774dc/0xdb7edb52b831ee45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.497720:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ac774dc/0xdb7edb52b831ee45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.497733:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ac774dc/0xdb7edb52b831ee45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.497740:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ac774dc/0xdb7edb52b831ee45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.497755:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572222.497781:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572222.497786:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ac774dc/0xdb7edb52b831ee45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.497792:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f4000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572222.497795:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac774dc/0xdb7edb52b831ee45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.497803:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac774dc/0xdb7edb52b831ee45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.497814:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ac774dc/0xdb7edb52b831ee45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.497820:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ac774dc/0xdb7edb52b831ee45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.497835:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572222.497837:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572222.497839:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572222.497869:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992 00000100:00100000:3.0:1788572222.497877:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3651:x1875449638938880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572222.499154:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2237 count 1 00002000:00010000:3.0:1788572222.499181:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572222.499188:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fbc7bf8/0xdb7edb52b831ee4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.499201:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8bd:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:3.0:1788572222.499204:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572222.499210:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fbc7bf8/0xdb7edb52b831ee4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.499221:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fbc7bf8/0xdb7edb52b831ee4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.499231:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fbc7bf8/0xdb7edb52b831ee4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.499239:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fbc7bf8/0xdb7edb52b831ee4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.499258:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572222.499320:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572222.499326:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fbc7bf8/0xdb7edb52b831ee4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.499339:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f4400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572222.499353:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fbc7bf8/0xdb7edb52b831ee4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.499362:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fbc7bf8/0xdb7edb52b831ee4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.499376:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fbc7bf8/0xdb7edb52b831ee4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.499384:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fbc7bf8/0xdb7edb52b831ee4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572222.499405:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572222.499407:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572222.499409:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572222.499507:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638939008:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572222.499595:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572222.499608:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572222.499620:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572222.507624:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3653:x1875449638938112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 33481us (34487us total) trans 4294968254 rc 0/0 00000100:00100000:0.0:1788572222.507643:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977 00000100:00100000:1.0:1788572222.507857:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+27:3653:x1875449638938624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32995us (34672us total) trans 4294968255 rc 0/0 00000100:00100000:1.0:1788572222.507865:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978 00000100:00100000:2.0:1788572222.512637:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572222.512713:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638940160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572222.512777:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572222.512797:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638940672:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572222.512830:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572222.512876:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778ce00/2, rc 0, transno 4294968253 00000100:00100000:2.0:1788572222.512887:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638937984:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572222.512899:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778e300/2, rc 0, transno 4294968252 00000100:00100000:2.0:1788572222.512903:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638938496:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572222.512911:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778c380/2, rc 0, transno 4294968254 00000100:00100000:2.0:1788572222.512915:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638938112:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572222.512924:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778f100/2, rc 0, transno 4294968255 00000100:00100000:2.0:1788572222.512927:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638938624:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572222.513257:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638939648 00000100:00100000:2.0:1788572222.513266:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638939648 00000100:00100000:2.0:1788572222.513320:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638940160 00000100:00100000:2.0:1788572222.513324:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638940160 00000100:00100000:2.0:1788572222.513341:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638940672 00000100:00100000:2.0:1788572222.513344:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638940672 00000100:00100000:2.0:1788572222.513365:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993 00000100:00100000:2.0:1788572222.513374:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50384e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3653:x1875449638939648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572222.513408:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2243 count 1 00002000:00010000:2.0:1788572222.513448:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572222.513458:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0da613/0xdb7edb52b831ee53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.513475:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c3:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:2.0:1788572222.513480:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572222.513486:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c0da613/0xdb7edb52b831ee53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.513503:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c0da613/0xdb7edb52b831ee53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.513514:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c0da613/0xdb7edb52b831ee53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.513522:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c0da613/0xdb7edb52b831ee53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.513543:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572222.513711:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50384e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3653:x1875449638939648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 336us (16139us total) trans 8589935552 rc 0/0 00000100:00100000:2.0:1788572222.513719:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993 00000100:00100000:2.0:1788572222.513735:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2994 00000100:00100000:2.0:1788572222.513742:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50384df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3653:x1875449638940160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572222.513755:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2247 count 1 00002000:00010000:2.0:1788572222.513773:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572222.513778:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ee5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.513791:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c7:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:2.0:1788572222.513794:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572222.513798:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ee5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.513807:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ee5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.513815:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ee5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.513823:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ee5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572222.513838:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572222.513994:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3651:x1875449638938880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16117us (31067us total) trans 8589935553 rc 0/0 00000100:00100000:1.0:1788572222.514025:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992 00000100:00100000:1.0:1788572222.514042:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995 00000100:00100000:1.0:1788572222.514049:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3653:x1875449638940672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572222.514061:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2247 count 1 00002000:00010000:1.0:1788572222.514077:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572222.514082:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ee61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514091:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c7:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:1.0:1788572222.514093:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572222.514097:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ee61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514112:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ee61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514120:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ee61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514126:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ee61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514141:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572222.514206:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3653:x1875449638940672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 158us (1375us total) trans 8589935554 rc 0/0 00000100:00100000:1.0:1788572222.514213:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995 00010000:00010000:1.0:1788572222.514231:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572222.514239:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c0da613/0xdb7edb52b831ee53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514247:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572222.514252:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0da613/0xdb7edb52b831ee53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514262:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c0da613/0xdb7edb52b831ee53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514280:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c0da613/0xdb7edb52b831ee53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514289:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c0da613/0xdb7edb52b831ee53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514308:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572222.514312:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ee5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514317:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b2400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572222.514321:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ee5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514327:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ee5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514337:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ee5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514345:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009be2e958/0xdb7edb52b831ee5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514358:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572222.514360:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ee61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514365:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad52800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572222.514369:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ee61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514375:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ee61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514383:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ee61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514389:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4c17c8e/0xdb7edb52b831ee61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514399:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572222.514401:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572222.514403:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572222.514435:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637670700/2, rc 0, transno 8589935553 00000100:00100000:1.0:1788572222.514447:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638938880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572222.514512:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638940800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572222.514543:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572222.514592:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638940800 00000100:00100000:1.0:1788572222.514597:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638940800 00000100:00100000:1.0:1788572222.514629:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996 00000100:00100000:1.0:1788572222.514635:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+23:3650:x1875449638940800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572222.514649:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2248 count 1 00002000:00010000:1.0:1788572222.514665:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572222.514670:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061381a3b/0xdb7edb52b831ee68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514679:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c8:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:1.0:1788572222.514682:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572222.514686:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061381a3b/0xdb7edb52b831ee68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514696:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061381a3b/0xdb7edb52b831ee68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514704:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061381a3b/0xdb7edb52b831ee68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514711:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061381a3b/0xdb7edb52b831ee68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.514726:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572222.514800:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+24:3650:x1875449638940800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 165us (256us total) trans 8589935555 rc 0/0 00000100:00100000:1.0:1788572222.514805:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996 00000004:00080000:1.0:1788572222.514832:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503930380/2, rc 0, transno 8589935555 00000100:00100000:1.0:1788572222.514840:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638940800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572222.514893:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572222.514900:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638940928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572222.514923:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572222.514992:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638940928 00000100:00100000:1.0:1788572222.514997:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638940928 00000100:00100000:1.0:1788572222.515045:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997 00000100:00100000:1.0:1788572222.515051:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3650:x1875449638940928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572222.515064:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2249 count 1 00002000:00010000:1.0:1788572222.515079:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572222.515084:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c41db40b/0xdb7edb52b831ee6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515092:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c9:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:1.0:1788572222.515095:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572222.515100:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c41db40b/0xdb7edb52b831ee6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515108:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c41db40b/0xdb7edb52b831ee6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515116:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c41db40b/0xdb7edb52b831ee6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515122:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c41db40b/0xdb7edb52b831ee6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515135:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572222.515204:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3650:x1875449638940928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 153us (279us total) trans 8589935556 rc 0/0 00000100:00100000:1.0:1788572222.515210:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997 00000100:00100000:1.0:1788572222.515289:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+25:3653:x1875449638939136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17629us (17756us total) trans 8589935557 rc 0/0 00000100:00100000:1.0:1788572222.515300:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991 00000100:00100000:1.0:1788572222.515333:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572222.515356:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638939520:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572222.515379:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572222.515395:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638940032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572222.515416:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572222.515433:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638940544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572222.515451:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572222.515478:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638939008 00000100:00100000:1.0:1788572222.515482:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638939008 00000100:00100000:1.0:1788572222.515500:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638939520 00000100:00100000:1.0:1788572222.515503:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638939520 00000100:00100000:1.0:1788572222.515516:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638940032 00000100:00100000:1.0:1788572222.515519:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638940032 00000100:00100000:1.0:1788572222.515535:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638940544 00000100:00100000:1.0:1788572222.515538:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638940544 00000100:00100000:1.0:1788572222.515552:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998 00000100:00100000:1.0:1788572222.515558:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+27:3652:x1875449638939008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572222.515583:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2238 count 1 00002000:00010000:1.0:1788572222.515602:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572222.515609:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4335637/0xdb7edb52b831ee76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515618:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8be:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:1.0:1788572222.515621:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572222.515625:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4335637/0xdb7edb52b831ee76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515641:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4335637/0xdb7edb52b831ee76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515649:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4335637/0xdb7edb52b831ee76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515657:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4335637/0xdb7edb52b831ee76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515670:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572222.515740:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+28:3652:x1875449638939008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 182us (405us total) trans 8589935558 rc 0/0 00000100:00100000:1.0:1788572222.515747:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998 00000100:00100000:1.0:1788572222.515759:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:1.0:1788572222.515765:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+27:3652:x1875449638939520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572222.515776:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2242 count 1 00002000:00010000:1.0:1788572222.515791:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572222.515795:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c2b0a3/0xdb7edb52b831ee7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515803:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c2:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:1.0:1788572222.515806:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572222.515809:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046c2b0a3/0xdb7edb52b831ee7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515824:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046c2b0a3/0xdb7edb52b831ee7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515832:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c2b0a3/0xdb7edb52b831ee7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515839:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046c2b0a3/0xdb7edb52b831ee7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515848:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788572222.515904:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+28:3652:x1875449638939520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 139us (524us total) trans 8589935559 rc 0/0 00000100:00100000:1.0:1788572222.515910:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00100000:1.0:1788572222.515924:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000 00000100:00100000:1.0:1788572222.515929:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+28:3652:x1875449638940032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572222.515942:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2246 count 1 00002000:00010000:1.0:1788572222.515958:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572222.515962:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003119b197/0xdb7edb52b831ee84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515970:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c6:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:1.0:1788572222.515973:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572222.515977:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003119b197/0xdb7edb52b831ee84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515991:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003119b197/0xdb7edb52b831ee84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.515998:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003119b197/0xdb7edb52b831ee84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.516031:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003119b197/0xdb7edb52b831ee84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572222.516040:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1788572222.516209:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001 00000100:00100000:0.0:1788572222.516220:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3652:x1875449638940544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572222.516234:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2246 count 1 00002000:00010000:0.0:1788572222.516250:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572222.516255:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad011f27/0xdb7edb52b831ee8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516263:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c6:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:0.0:1788572222.516266:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572222.516269:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad011f27/0xdb7edb52b831ee8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516279:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad011f27/0xdb7edb52b831ee8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516286:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad011f27/0xdb7edb52b831ee8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516297:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad011f27/0xdb7edb52b831ee8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516305:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1788572222.516375:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3652:x1875449638940544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 158us (922us total) trans 8589935560 rc 0/0 00000100:00100000:0.0:1788572222.516381:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001 00000004:00080000:0.0:1788572222.516463:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503933800/2, rc 0, transno 8589935556 00000100:00100000:0.0:1788572222.516469:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638940928:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572222.516484:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788572222.516490:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061381a3b/0xdb7edb52b831ee68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516497:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad53600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572222.516501:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061381a3b/0xdb7edb52b831ee68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516510:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061381a3b/0xdb7edb52b831ee68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516525:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061381a3b/0xdb7edb52b831ee68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516533:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061381a3b/0xdb7edb52b831ee68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516559:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572222.516563:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c41db40b/0xdb7edb52b831ee6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516578:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad52000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572222.516580:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c41db40b/0xdb7edb52b831ee6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516587:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c41db40b/0xdb7edb52b831ee6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516601:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c41db40b/0xdb7edb52b831ee6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516609:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c41db40b/0xdb7edb52b831ee6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516628:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572222.516631:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4335637/0xdb7edb52b831ee76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516637:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad53c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572222.516641:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4335637/0xdb7edb52b831ee76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516654:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4335637/0xdb7edb52b831ee76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516663:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4335637/0xdb7edb52b831ee76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516669:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4335637/0xdb7edb52b831ee76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516681:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572222.516684:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046c2b0a3/0xdb7edb52b831ee7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516689:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad52c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572222.516691:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c2b0a3/0xdb7edb52b831ee7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516698:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c2b0a3/0xdb7edb52b831ee7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516706:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046c2b0a3/0xdb7edb52b831ee7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516712:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046c2b0a3/0xdb7edb52b831ee7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516727:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572222.516730:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003119b197/0xdb7edb52b831ee84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516735:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad52a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572222.516738:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003119b197/0xdb7edb52b831ee84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516745:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003119b197/0xdb7edb52b831ee84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516754:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003119b197/0xdb7edb52b831ee84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516760:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003119b197/0xdb7edb52b831ee84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516771:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572222.516774:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad011f27/0xdb7edb52b831ee8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516781:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572222.516784:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad011f27/0xdb7edb52b831ee8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516794:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad011f27/0xdb7edb52b831ee8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516803:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad011f27/0xdb7edb52b831ee8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516809:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad011f27/0xdb7edb52b831ee8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.516822:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572222.516824:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572222.516826:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572222.516862:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572222.516885:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637670e00/2, rc 0, transno 8589935558 00000100:00100000:0.0:1788572222.516890:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638939008:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572222.516900:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637670000/2, rc 0, transno 8589935559 00000100:00100000:0.0:1788572222.516903:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638939520:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572222.516911:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637794e00/2, rc 0, transno 8589935560 00000100:00100000:0.0:1788572222.516913:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638940544:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572222.516948:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572222.516964:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572222.516980:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572222.522254:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637670a80/2, rc 0, transno 8589935557 00000100:00100000:0.0:1788572222.522285:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638939136:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572222.522307:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637671500/2, rc 0, transno 8589935552 00000100:00100000:0.0:1788572222.522321:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638939648:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572222.522334:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637795180/2, rc 0, transno 8589935554 00000100:00100000:0.0:1788572222.522337:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638940672:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572222.528679:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572222.528707:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638941056:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572222.528779:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572222.528963:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+28:3651:x1875449638940416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31699us (31849us total) trans 8589935561 rc 0/0 00000100:00100000:2.0:1788572222.528972:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990 00000004:00080000:2.0:1788572222.529045:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637794000/2, rc 0, transno 8589935561 00000100:00100000:2.0:1788572222.529051:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638940416:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572222.530107:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638941056 00000100:00100000:0.0:1788572222.530121:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638941056 00000100:00100000:0.0:1788572222.530181:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002 00000100:00100000:0.0:1788572222.530191:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3653:x1875449638941056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572222.530230:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2249 count 1 00002000:00010000:0.0:1788572222.530279:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572222.530289:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d4409d6/0xdb7edb52b831ee92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.530304:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c9:0x0].0x0 since=4139s v=(0 0) 00010000:00010000:0.0:1788572222.530317:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572222.530324:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d4409d6/0xdb7edb52b831ee92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.530338:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d4409d6/0xdb7edb52b831ee92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.530463:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d4409d6/0xdb7edb52b831ee92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.530472:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d4409d6/0xdb7edb52b831ee92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.530496:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572222.530549:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572222.530558:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d4409d6/0xdb7edb52b831ee92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.530567:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641377600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572222.530581:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d4409d6/0xdb7edb52b831ee92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.530591:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d4409d6/0xdb7edb52b831ee92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.530610:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d4409d6/0xdb7edb52b831ee92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.530618:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d4409d6/0xdb7edb52b831ee92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572222.530641:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572222.530643:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572222.530645:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788572222.537990:0:16234:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589935551 is committed 00000100:00100000:0.0:1788572222.548520:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3653:x1875449638941056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18320us (19731us total) trans 4294968260 rc 0/0 00000100:00100000:0.0:1788572222.548535:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002 00000004:00080000:2.0:1788572222.548725:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e635f80/2, rc 0, transno 4294968260 00000100:00100000:2.0:1788572222.548734:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638941056:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572222.550367:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50384df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3653:x1875449638940160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36616us (37579us total) trans 4294968261 rc 0/0 00000100:00100000:3.0:1788572222.550383:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2994 00000004:00080000:2.0:1788572222.550952:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641194e00/2, rc 0, transno 4294968261 00000100:00100000:2.0:1788572222.550961:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638940160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572222.551547:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3651:x1875449638940288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 55147us (56711us total) trans 4294968262 rc 0/0 00000100:00100000:0.0:1788572222.551557:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989 00000004:00080000:2.0:1788572222.551674:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641195500/2, rc 0, transno 4294968262 00000100:00100000:2.0:1788572222.551681:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638940288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572222.552274:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+31:3652:x1875449638940032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36342us (36853us total) trans 4294968263 rc 0/0 00000100:00100000:1.0:1788572222.552284:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000 00000100:00100000:2.0:1788572222.552598:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3651:x1875449638939904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 56854us (57855us total) trans 4294968264 rc 0/0 00000100:00100000:2.0:1788572222.552608:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988 00000004:00080000:0.0:1788572222.552621:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778d180/2, rc 0, transno 4294968263 00000100:00100000:0.0:1788572222.552646:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638940032:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572222.552696:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778fb80/2, rc 0, transno 4294968264 00000100:00100000:1.0:1788572222.552702:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638939904:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788572222.553254:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968259 is committed 00010000:00010000:0.0:1788572223.171162:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572223.493316:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638941184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572223.493420:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572223.493481:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638941184 00000100:00100000:2.0:1788572223.493492:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638941184 00000100:00100000:2.0:1788572223.493626:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772 00000100:00100000:2.0:1788572223.493641:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449638941184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572223.493676:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923480576 avail 3691958272 00000100:00100000:2.0:1788572223.493740:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449638941184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572223.493748:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772 00000100:00100000:2.0:1788572223.493807:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638941184:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572223.496804:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788572223.834671:0:112571:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:0.0:1788572224.006329:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449638941312:0@lo:400:kworker.0 00000100:00100000:0.0:1788572224.006447:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572224.006532:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449638941824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572224.006646:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449638941568:0@lo:400:kworker.0 00000100:00100000:3.0:1788572224.006720:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572224.006765:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449638942080:0@lo:400:kworker.0 00000100:00100000:0.0:1788572224.006776:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572224.006806:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572224.006827:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449638942336:0@lo:400:kworker.0 00000100:00100000:3.0:1788572224.006848:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638942592:0@lo:400:kworker.0 00000100:00100000:0.0:1788572224.006874:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572224.006897:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572224.006912:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449638942848:0@lo:400:kworker.0 00000100:00100000:3.0:1788572224.006939:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572224.006951:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449638941696:0@lo:400:kworker.0 00000100:00100000:0.0:1788572224.006958:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572224.007028:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638941312 00000100:00100000:2.0:1788572224.007043:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638941312 00000100:00100000:3.0:1788572224.007055:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572224.007097:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449638942208:0@lo:400:kworker.0 00000100:00100000:0.0:1788572224.007104:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638941568 00000100:00100000:0.0:1788572224.007112:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638941568 00000100:00100000:2.0:1788572224.007127:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788572224.007137:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572224.007144:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449638941312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572224.007214:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638941440:0@lo:400:kworker.0 00000100:00100000:2.0:1788572224.007251:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449638941312:12345-0@lo:400:kworker.0 Request processed in 110us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572224.007261:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788572224.007268:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572224.007304:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449638941952:0@lo:400:kworker.0 00000100:00100000:2.0:1788572224.007376:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638941440 00000100:00100000:2.0:1788572224.007382:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638941440 00000100:00100000:2.0:1788572224.007427:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:2.0:1788572224.007435:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449638941440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572224.007708:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449638941440:12345-0@lo:400:kworker.0 Request processed in 275us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572224.007715:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000100:00100000:2.0:1788572224.009054:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638942080 00000100:00100000:2.0:1788572224.009067:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638942080 00000100:00100000:2.0:1788572224.009139:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638942592 00000100:00100000:2.0:1788572224.009143:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638942592 00000100:00100000:2.0:1788572224.009166:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638941696 00000100:00100000:2.0:1788572224.009169:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638941696 00000100:00100000:2.0:1788572224.009189:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3599 00000100:00100000:2.0:1788572224.009199:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449638942080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572224.009281:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449638942080:12345-0@lo:400:kworker.0 Request processed in 83us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572224.009289:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3599 00000100:00100000:2.0:1788572224.009303:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3600 00000100:00100000:2.0:1788572224.009310:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+15:3652:x1875449638942592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572224.009340:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+15:3652:x1875449638942592:12345-0@lo:400:kworker.0 Request processed in 31us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572224.009346:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3600 00000100:00100000:2.0:1788572224.009357:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3601 00000100:00100000:2.0:1788572224.009363:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449638941696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572224.009394:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449638941696:12345-0@lo:400:kworker.0 Request processed in 32us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572224.009400:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3601 00000100:00080000:2.0:1788572224.009604:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572224.009608:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572224.012659:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638941824 00000100:00100000:0.0:1788572224.012680:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638941824 00000100:00100000:2.0:1788572224.012691:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638942336 00000100:00100000:2.0:1788572224.012697:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638942336 00000100:00100000:0.0:1788572224.012752:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638942848 00000100:00100000:0.0:1788572224.012756:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638942848 00000100:00100000:0.0:1788572224.012773:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638942208 00000100:00100000:0.0:1788572224.012775:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638942208 00000100:00100000:3.0:1788572224.016818:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638942720:0@lo:400:kworker.0 00000100:00100000:3.0:1788572224.016949:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572224.017070:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449638942080:0@lo:400:kworker.0 00000100:00100000:3.0:1788572224.017086:0:3652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935551 gen 2 00000004:00080000:3.0:1788572224.017108:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b28380, transno 8589935540 00000004:00080000:3.0:1788572224.017131:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b29500, transno 8589935541 00000004:00080000:3.0:1788572224.017134:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b29f80, transno 8589935542 00000004:00080000:3.0:1788572224.017137:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10380, transno 8589935543 00000004:00080000:3.0:1788572224.017140:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12300, transno 8589935544 00000004:00080000:3.0:1788572224.017143:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13b80, transno 8589935545 00000004:00080000:3.0:1788572224.017145:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 8589935546 00000004:00080000:3.0:1788572224.017148:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10000, transno 8589935547 00000004:00080000:3.0:1788572224.017151:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 8589935548 00000004:00080000:3.0:1788572224.017153:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637673480, transno 8589935549 00000004:00080000:3.0:1788572224.017156:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637672680, transno 8589935550 00000004:00080000:3.0:1788572224.017158:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13100, transno 8589935551 00000100:00100000:3.0:1788572224.020265:0:3652:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e637671500 x1875449638939648/t8589935552(8589935552) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572238 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572224.020303:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638942592:0@lo:400:kworker.0 00000100:00100000:3.0:1788572224.020412:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449638941696:0@lo:400:kworker.0 00000100:00100000:3.0:1788572224.021235:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638942720 00000100:00100000:3.0:1788572224.021248:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638942720 00000100:00100000:1.0:1788572224.021371:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4387 00000004:00080000:1.0:1788572224.021635:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 10 in progress, 0 in flight, 12 done 00000100:00100000:1.0:1788572224.021665:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4388 00000100:00100000:1.0:1788572224.021678:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449638941824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572224.021808:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449638941824:12345-0@lo:400:kworker.0 Request processed in 134us (15033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572224.021817:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4388 00000100:00100000:1.0:1788572224.021851:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4389 00000100:00100000:1.0:1788572224.021860:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449638942848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572224.021893:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449638942848:12345-0@lo:400:kworker.0 Request processed in 35us (14940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572224.021900:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4389 00000100:00100000:1.0:1788572224.021957:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572224.022040:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638942464:0@lo:400:kworker.0 00000100:00100000:1.0:1788572224.022104:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572224.022151:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638942976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572224.022560:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572224.022620:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638941440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572224.022656:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638941952 00000100:00100000:1.0:1788572224.022663:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638941952 00000100:00100000:2.0:1788572224.022842:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4390 00000100:00100000:2.0:1788572224.023977:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449638942336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572224.024108:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449638942336:12345-0@lo:400:kworker.0 Request processed in 1254us (17237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572224.024117:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4390 00000100:00080000:2.0:1788572224.024159:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572224.024164:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572224.024167:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572224.028797:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638942464 00000100:00100000:0.0:1788572224.028814:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638942464 00000100:00100000:2.0:1788572224.029372:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449638941824:0@lo:400:kworker.0 00000100:00100000:2.0:1788572224.029391:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449638942336:0@lo:400:kworker.0 00000100:00100000:2.0:1788572224.031289:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449638942848:0@lo:400:kworker.0 00000100:00100000:2.0:1788572224.031358:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449638941312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572224.033665:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3602 00000100:00100000:3.0:1788572224.033691:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638942720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572224.033833:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449638942720:12345-0@lo:400:kworker.0 Request processed in 150us (16885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572224.033842:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3602 00000100:00100000:3.0:1788572224.033920:0:3652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968259 gen 2 00000004:00080000:3.0:1788572224.033946:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493800, transno 4294968241 00000004:00080000:3.0:1788572224.033959:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57ce00, transno 4294968242 00000004:00080000:3.0:1788572224.033963:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57c700, transno 4294968243 00000004:00080000:3.0:1788572224.033966:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490e00, transno 4294968244 00000004:00080000:3.0:1788572224.033969:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490a80, transno 4294968245 00000004:00080000:3.0:1788572224.033973:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493b80, transno 4294968246 00000004:00080000:3.0:1788572224.033976:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57f480, transno 4294968247 00000004:00080000:3.0:1788572224.033979:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3b80, transno 4294968248 00000004:00080000:3.0:1788572224.033982:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db1f80, transno 4294968249 00000004:00080000:3.0:1788572224.033985:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0000, transno 4294968250 00000004:00080000:3.0:1788572224.033987:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0a80, transno 4294968251 00000004:00080000:3.0:1788572224.033990:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778e300, transno 4294968252 00000004:00080000:3.0:1788572224.033993:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778ce00, transno 4294968253 00000004:00080000:3.0:1788572224.033995:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778c380, transno 4294968254 00000004:00080000:3.0:1788572224.033999:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778f100, transno 4294968255 00000004:00080000:3.0:1788572224.034024:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778ca80, transno 4294968256 00000004:00080000:3.0:1788572224.034028:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778c700, transno 4294968257 00000004:00080000:3.0:1788572224.034031:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778ea00, transno 4294968258 00000004:00080000:3.0:1788572224.034034:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778dc00, transno 4294968259 00000100:00100000:0.0:1788572224.035223:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638942976 00000100:00100000:0.0:1788572224.035244:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638942976 00000100:00100000:0.0:1788572224.035292:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:0.0:1788572224.035317:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638942464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572224.035430:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449638942464:12345-0@lo:400:kworker.0 Request processed in 129us (13325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572224.035437:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:0.0:1788572224.035456:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:0.0:1788572224.035463:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638942976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572224.035490:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572224.035516:0:3652:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e61e635f80 x1875449638941056/t4294968260(4294968260) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572238 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572224.035534:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638942976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (12970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572224.035564:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638942720:0@lo:400:kworker.0 00000100:00100000:0.0:1788572224.035578:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00100000:1.0:1788572224.035813:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4391 00000100:00100000:1.0:1788572224.035827:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449638941952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572224.035903:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449638941952:12345-0@lo:400:kworker.0 Request processed in 82us (13946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572224.035911:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4391 00000100:00100000:1.0:1788572224.035989:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638942976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572224.036043:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449638941952:0@lo:400:kworker.0 00000100:00100000:1.0:1788572224.036558:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638942464:0@lo:400:kworker.0 00000100:00100000:1.0:1788572224.036610:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449638941568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572224.036689:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449638941568:12345-0@lo:400:kworker.0 Request processed in 15306us (29969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572224.036699:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4387 00000100:00100000:1.0:1788572224.036730:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4392 00000100:00100000:1.0:1788572224.036742:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449638942208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572224.036780:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449638942208:12345-0@lo:400:kworker.0 Request processed in 43us (29645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572224.036787:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4392 00000004:00080000:3.0:1788572224.036867:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 5 in progress, 0 in flight, 19 done 00000100:00100000:3.0:1788572224.036906:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449638942208:0@lo:400:kworker.0 00000100:00100000:3.0:1788572224.036924:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449638941568:0@lo:400:kworker.0 00010000:00010000:0.0:1788572224.195171:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572224.416628:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572224.416696:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572224.416736:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572224.416767:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572224.416812:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572224.416851:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615203712 00000100:00100000:1.0:1788572224.416874:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615203712 00000100:00100000:1.0:1788572224.416946:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615203840 00000100:00100000:1.0:1788572224.416949:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615203840 00000100:00100000:1.0:1788572224.416980:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4393 00000100:00100000:1.0:1788572224.416992:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2383:x1875449615203712:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572224.417136:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2383:x1875449615203712:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 145us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572224.417144:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4393 00000100:00100000:1.0:1788572224.417163:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4394 00000100:00100000:1.0:1788572224.417170:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449615203840:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572224.417200:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449615203840:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 31us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572224.417206:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4394 00000100:00100000:0.0:1788572224.417510:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615203968 00000100:00100000:0.0:1788572224.417517:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615203968 00000100:00100000:0.0:1788572224.417584:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615204096 00000100:00100000:0.0:1788572224.417588:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615204096 00000100:00100000:0.0:1788572224.417615:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3603 00000100:00100000:0.0:1788572224.417621:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2383:x1875449615203968:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572224.417662:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2383:x1875449615203968:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 41us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572224.417668:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3603 00000100:00100000:0.0:1788572224.417682:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3604 00000100:00100000:0.0:1788572224.417689:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2383:x1875449615204096:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572224.417714:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2383:x1875449615204096:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572224.417724:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3604 00000100:00080000:0.0:1788572224.417746:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572224.417751:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572224.417753:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572224.417756:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572224.418930:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615203584 00000100:00100000:3.0:1788572224.418942:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615203584 00000100:00100000:3.0:1788572224.419337:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00100000:3.0:1788572224.419351:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449615203584:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572224.419430:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449615203584:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 82us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572224.419437:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00100000:1.0:1788572224.515387:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572224.515418:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638943104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572224.515519:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572224.515586:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638943104 00000100:00100000:0.0:1788572224.515595:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638943104 00000100:00100000:0.0:1788572224.515651:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773 00000100:00100000:0.0:1788572224.515662:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449638943104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572224.515694:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572224.515751:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449638943104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572224.515758:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773 00000100:00100000:1.0:1788572224.516718:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638943104:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788572225.219239:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788572225.626309:0:112619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1788572226.243215:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572227.268256:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572227.587257:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572227.587282:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638943232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572227.587367:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572227.587437:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638943232 00000100:00100000:3.0:1788572227.587445:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638943232 00000100:00100000:3.0:1788572227.587534:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774 00000100:00100000:3.0:1788572227.587546:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3652:x1875449638943232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572227.587575:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923480576 avail 3691958272 00000100:00100000:3.0:1788572227.587635:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:3652:x1875449638943232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572227.587644:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774 00000100:00100000:3.0:1788572227.587689:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638943232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572227.587740:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638943360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572227.587773:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572227.587810:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638943360 00000100:00100000:3.0:1788572227.587814:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638943360 00000100:00100000:3.0:1788572227.587841:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775 00000100:00100000:3.0:1788572227.587848:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449638943360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572227.587867:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788572227.587884:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572227.587889:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572227.587903:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449638943360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572227.587909:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775 00000100:00100000:3.0:1788572227.587943:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638943360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572227.588844:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638943488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572227.588889:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572227.589056:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638943488 00000100:00100000:0.0:1788572227.589061:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638943488 00000100:00100000:0.0:1788572227.589114:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:0.0:1788572227.589123:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449638943488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572227.589150:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445969920 avail 1299730432 00000100:00100000:0.0:1788572227.589188:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449638943488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572227.589194:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:1.0:1788572227.589388:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449638943488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572227.602578:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572227.602689:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615204224 00000100:00100000:0.0:1788572227.602702:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615204224 00000100:00100000:0.0:1788572227.602800:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11058 00000100:00100000:0.0:1788572227.602813:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:86816:x1875449615204224:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572227.602849:0:6551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445969920 avail 1299730432 00000100:00100000:0.0:1788572227.602930:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:86816:x1875449615204224:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 121us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572227.602938:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11058 00000100:00080000:2.0:1788572227.603132:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572227.618841:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572227.619037:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615204352 00000100:00100000:1.0:1788572227.619048:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615204352 00000100:00100000:1.0:1788572227.619139:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 11059 00000100:00100000:1.0:1788572227.619151:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:86816:x1875449615204352:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:1.0:1788572227.619191:0:9276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572227.619285:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:86816:x1875449615204352:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 136us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572227.619293:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 11059 00000100:00080000:2.0:1788572227.620436:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572227.625694:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572227.625987:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615204480 00000100:00100000:2.0:1788572227.626001:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615204480 00000100:00100000:2.0:1788572227.626122:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2776 00000100:00100000:2.0:1788572227.626133:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+10:86816:x1875449615204480:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:2.0:1788572227.626160:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923480576 avail 3691958272 00000100:00100000:2.0:1788572227.626238:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+10:86816:x1875449615204480:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 106us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572227.626260:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2776 00000100:00080000:0.0:1788572227.626488:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572227.631153:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572227.637478:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615204608 00000100:00100000:0.0:1788572227.637509:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615204608 00000100:00100000:0.0:1788572227.637674:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2777 00000100:00100000:0.0:1788572227.637686:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+9:86816:x1875449615204608:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:0.0:1788572227.637716:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572227.637809:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+9:86816:x1875449615204608:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 125us (6668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572227.637817:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2777 00000100:00080000:2.0:1788572227.637882:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788572228.121044:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968264 is committed 00000001:00080000:2.0:1788572228.127924:0:16234:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589935561 is committed 00010000:00010000:0.0:1788572228.291322:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572228.611277:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572228.611313:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638943616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572228.611419:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572228.611497:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638943616 00000100:00100000:2.0:1788572228.611506:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638943616 00000100:00100000:2.0:1788572228.611593:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:2.0:1788572228.611604:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449638943616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572228.611637:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923480576 avail 3691958272 00000100:00100000:2.0:1788572228.611695:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449638943616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572228.611703:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00080000:2.0:1788572228.611729:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572228.611778:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638943616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572229.123421:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449638944128:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.123522:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.123584:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449638944640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.123611:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.123629:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638945152:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.123650:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.123674:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788572229.123680:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449638943744:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.123709:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.123746:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449638944256:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.123770:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.123788:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449638944768:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.123810:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.123825:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449638945280:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.123849:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.123873:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638943872:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.123899:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.123915:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449638944384:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.123938:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.123955:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638944896:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.123977:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.123994:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572229.124000:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449638944000:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.124052:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.124067:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638944512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.124087:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.124101:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638945024:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.124121:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.124230:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638944640 00000100:00100000:1.0:1788572229.124237:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638944640 00000100:00100000:1.0:1788572229.124282:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638944256 00000100:00100000:1.0:1788572229.124286:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638944256 00000100:00100000:1.0:1788572229.124302:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638944768 00000100:00100000:1.0:1788572229.124305:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638944768 00000100:00100000:1.0:1788572229.124318:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638945280 00000100:00100000:1.0:1788572229.124320:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638945280 00000100:00100000:1.0:1788572229.124331:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638944384 00000100:00100000:1.0:1788572229.124333:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638944384 00000100:00100000:1.0:1788572229.124345:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638944000 00000100:00100000:1.0:1788572229.124347:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638944000 00000100:00100000:1.0:1788572229.124361:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4395 00000100:00100000:1.0:1788572229.124368:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449638944640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.124422:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449638944640:12345-0@lo:400:kworker.0 Request processed in 53us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572229.124430:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4395 00000100:00100000:1.0:1788572229.124449:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4396 00000100:00100000:1.0:1788572229.124456:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449638944256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.124498:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449638944256:12345-0@lo:400:kworker.0 Request processed in 42us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572229.124504:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4396 00000100:00100000:1.0:1788572229.124516:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4397 00000100:00100000:1.0:1788572229.124522:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449638944768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.124550:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449638944768:12345-0@lo:400:kworker.0 Request processed in 28us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572229.124556:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4397 00000100:00100000:1.0:1788572229.124569:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4398 00000100:00100000:1.0:1788572229.124575:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449638945280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.124601:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449638945280:12345-0@lo:400:kworker.0 Request processed in 26us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572229.124607:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4398 00000100:00100000:1.0:1788572229.124618:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4399 00000100:00100000:1.0:1788572229.124623:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449638944384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.124654:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449638944384:12345-0@lo:400:kworker.0 Request processed in 30us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572229.124660:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4399 00000100:00100000:1.0:1788572229.124672:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4400 00000100:00100000:1.0:1788572229.124678:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449638944000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.124705:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449638944000:12345-0@lo:400:kworker.0 Request processed in 27us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572229.124711:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4400 00000100:00100000:1.0:1788572229.124731:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638943744 00000100:00100000:1.0:1788572229.124735:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638943744 00000100:00100000:1.0:1788572229.124759:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788572229.124766:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449638943744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.124796:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449638943744:12345-0@lo:400:kworker.0 Request processed in 31us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572229.124803:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788572229.125029:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449638944000:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.125045:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449638944384:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.125080:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449638943744:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.125089:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449638944256:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.125100:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449638944768:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.125109:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449638945280:0@lo:400:kworker.0 00000100:00100000:1.0:1788572229.125117:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449638944640:0@lo:400:kworker.0 00000100:00100000:3.0:1788572229.125337:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638944128 00000100:00100000:3.0:1788572229.125342:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638944128 00000100:00100000:3.0:1788572229.125379:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638945152 00000100:00100000:3.0:1788572229.125383:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638945152 00000100:00100000:3.0:1788572229.125404:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638944512 00000100:00100000:3.0:1788572229.125407:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638944512 00000100:00100000:3.0:1788572229.125423:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638945024 00000100:00100000:3.0:1788572229.125426:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638945024 00000100:00100000:3.0:1788572229.125445:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3605 00000100:00100000:3.0:1788572229.125452:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449638944128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572229.125512:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449638944128:12345-0@lo:400:kworker.0 Request processed in 60us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572229.125520:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3605 00000100:00100000:3.0:1788572229.125533:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3606 00000100:00100000:3.0:1788572229.125539:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638945152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572229.125571:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449638945152:12345-0@lo:400:kworker.0 Request processed in 32us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572229.125576:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3606 00000100:00100000:3.0:1788572229.125588:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3607 00000100:00100000:3.0:1788572229.125593:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449638944512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572229.125627:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449638944512:12345-0@lo:400:kworker.0 Request processed in 34us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572229.125633:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3607 00000100:00100000:3.0:1788572229.125642:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3608 00000100:00100000:3.0:1788572229.125648:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638945024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572229.125675:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638945024:12345-0@lo:400:kworker.0 Request processed in 27us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572229.125681:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3608 00000100:00100000:3.0:1788572229.125710:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449638944128:0@lo:400:kworker.0 00000100:00100000:3.0:1788572229.125720:0:3652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968264 gen 2 00000004:00080000:3.0:1788572229.125726:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e635f80, transno 4294968260 00000004:00080000:3.0:1788572229.125736:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641194e00, transno 4294968261 00000004:00080000:3.0:1788572229.125739:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641195500, transno 4294968262 00000004:00080000:3.0:1788572229.125743:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778d180, transno 4294968263 00000004:00080000:3.0:1788572229.125745:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778fb80, transno 4294968264 00000100:00100000:3.0:1788572229.125749:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638945152:0@lo:400:kworker.0 00000100:00100000:3.0:1788572229.125783:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638944512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572229.125793:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935561 gen 2 00000004:00080000:3.0:1788572229.125796:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637671500, transno 8589935552 00000004:00080000:3.0:1788572229.125804:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670700, transno 8589935553 00000004:00080000:3.0:1788572229.125807:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637795180, transno 8589935554 00000004:00080000:3.0:1788572229.125810:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503930380, transno 8589935555 00000004:00080000:3.0:1788572229.125812:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503933800, transno 8589935556 00000004:00080000:3.0:1788572229.125815:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670a80, transno 8589935557 00000004:00080000:3.0:1788572229.125817:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670e00, transno 8589935558 00000004:00080000:3.0:1788572229.125820:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670000, transno 8589935559 00000004:00080000:3.0:1788572229.125822:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637794e00, transno 8589935560 00000004:00080000:3.0:1788572229.125825:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637794000, transno 8589935561 00000100:00100000:3.0:1788572229.125829:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638945024:0@lo:400:kworker.0 00000004:00080000:3.0:1788572229.125970:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 5 done 00000004:00080000:3.0:1788572229.126074:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 10 done 00000100:00100000:0.0:1788572229.126325:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638943872 00000100:00100000:0.0:1788572229.126332:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638943872 00000100:00100000:0.0:1788572229.126374:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638944896 00000100:00100000:0.0:1788572229.126377:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638944896 00000100:00100000:0.0:1788572229.126399:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:0.0:1788572229.126406:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449638943872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572229.126462:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449638943872:12345-0@lo:400:kworker.0 Request processed in 57us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572229.126469:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:0.0:1788572229.126496:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:0.0:1788572229.126502:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638944896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572229.126536:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638944896:12345-0@lo:400:kworker.0 Request processed in 34us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572229.126543:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:0.0:1788572229.126584:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638943872:0@lo:400:kworker.0 00000100:00100000:0.0:1788572229.126596:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638944896:0@lo:400:kworker.0 00000100:00080000:2.0:1788572229.126742:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572229.126747:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572229.126750:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572229.126752:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572229.126774:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572229.126788:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638945408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572229.126829:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572229.127581:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638945408 00000100:00100000:3.0:1788572229.127589:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638945408 00000100:00100000:3.0:1788572229.127634:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:3.0:1788572229.127641:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638945408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572229.127669:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572229.127716:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449638945408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572229.127723:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1788572229.128086:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638945408:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788572229.315627:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572229.543466:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572229.543561:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572229.543602:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572229.543626:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572229.543674:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615205120 00000100:00100000:3.0:1788572229.543686:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615205120 00000100:00100000:3.0:1788572229.543767:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3609 00000100:00100000:3.0:1788572229.543777:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2384:x1875449615205120:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572229.543857:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2384:x1875449615205120:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 81us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572229.543864:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3609 00000100:00080000:3.0:1788572229.543888:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572229.544041:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615204736 00000100:00100000:3.0:1788572229.544045:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615204736 00000100:00100000:3.0:1788572229.544073:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 79 00000100:00100000:3.0:1788572229.544080:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449615204736:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572229.544120:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449615204736:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 40us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572229.544127:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 79 00000100:00100000:2.0:1788572229.550043:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572229.550212:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615205248 00000100:00100000:3.0:1788572229.550222:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615205248 00000100:00100000:3.0:1788572229.550296:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3610 00000100:00100000:3.0:1788572229.550307:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2384:x1875449615205248:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572229.550382:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2384:x1875449615205248:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 77us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572229.550389:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3610 00000100:00080000:2.0:1788572229.552940:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572229.554841:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615204864 00000100:00100000:1.0:1788572229.554859:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615204864 00000100:00100000:1.0:1788572229.554964:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615204992 00000100:00100000:1.0:1788572229.554969:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615204992 00000100:00100000:1.0:1788572229.555021:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4401 00000100:00100000:1.0:1788572229.555034:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2384:x1875449615204864:12345-192.168.202.13@tcp:400:kworker.0 00000100:00080000:2.0:1788572229.555200:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572229.555205:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572229.555290:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2384:x1875449615204864:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 257us (11837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572229.555299:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4401 00000100:00100000:1.0:1788572229.555319:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4402 00000100:00100000:1.0:1788572229.555326:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449615204992:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572229.555354:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449615204992:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (11727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572229.555361:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4402 00000100:00100000:0.0:1788572229.635888:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572229.635913:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638945536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572229.635998:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572229.636368:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638945536 00000100:00100000:1.0:1788572229.636378:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638945536 00000100:00100000:1.0:1788572229.636436:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779 00000100:00100000:1.0:1788572229.636447:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449638945536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572229.636491:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572229.636544:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449638945536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572229.636551:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779 00000100:00100000:0.0:1788572229.636931:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638945536:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788572230.339117:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572238.533471:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572238.851446:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638983680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572238.851533:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572238.851639:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638983680 00000100:00100000:3.0:1788572238.851648:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638983680 00000100:00100000:3.0:1788572238.851735:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786 00000100:00100000:3.0:1788572238.851755:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449638983680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572238.851778:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923480576 avail 3691958272 00000100:00100000:3.0:1788572238.851835:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449638983680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572238.851846:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786 00000100:00080000:0.0:1788572238.852230:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572238.852268:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638983680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572239.363449:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638983808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572239.363526:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572239.363657:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638983808 00000100:00100000:2.0:1788572239.363667:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638983808 00000100:00100000:2.0:1788572239.363736:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1788572239.363746:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638983808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572239.363779:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572239.363835:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449638983808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572239.363842:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:1.0:1788572239.364060:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638983808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572239.366162:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449638984192:0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.366222:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572239.366259:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638984704:0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.366280:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572239.366293:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638985216:0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.366311:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572239.366335:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572239.366341:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638984064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.366365:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572239.366395:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449638984576:0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.366417:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572239.366432:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638985088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.366452:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572239.366480:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638984704 00000100:00100000:0.0:1788572239.366486:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638984704 00000100:00100000:0.0:1788572239.366537:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638985216 00000100:00100000:0.0:1788572239.366540:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638985216 00000100:00100000:0.0:1788572239.366561:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638985088 00000100:00100000:0.0:1788572239.366564:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638985088 00000100:00100000:0.0:1788572239.366585:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3617 00000100:00100000:0.0:1788572239.366593:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449638984704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.366642:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449638984704:12345-0@lo:400:kworker.0 Request processed in 50us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572239.366649:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3617 00000100:00100000:0.0:1788572239.366664:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3618 00000100:00100000:0.0:1788572239.366670:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+143:3653:x1875449638985216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.366707:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+143:3653:x1875449638985216:12345-0@lo:400:kworker.0 Request processed in 37us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572239.366713:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3618 00000100:00100000:0.0:1788572239.366723:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3619 00000100:00100000:0.0:1788572239.366729:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+143:3653:x1875449638985088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.366753:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+143:3653:x1875449638985088:12345-0@lo:400:kworker.0 Request processed in 24us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572239.366761:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3619 00000100:00080000:0.0:1788572239.366789:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572239.366792:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572239.366818:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638985088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.366828:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638984704:0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.366837:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638985216:0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367144:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638984064 00000100:00100000:2.0:1788572239.367149:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638984064 00000100:00100000:2.0:1788572239.367187:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:2.0:1788572239.367194:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449638984064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367239:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449638984064:12345-0@lo:400:kworker.0 Request processed in 46us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572239.367245:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:2.0:1788572239.367263:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638984192 00000100:00100000:2.0:1788572239.367267:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638984192 00000100:00100000:2.0:1788572239.367286:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638984576 00000100:00100000:2.0:1788572239.367288:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638984576 00000100:00100000:2.0:1788572239.367311:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4410 00000100:00100000:2.0:1788572239.367316:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449638984192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367346:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449638984192:12345-0@lo:400:kworker.0 Request processed in 30us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572239.367352:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4410 00000100:00100000:2.0:1788572239.367363:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4411 00000100:00100000:2.0:1788572239.367369:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449638984576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367409:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449638984576:12345-0@lo:400:kworker.0 Request processed in 40us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572239.367415:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4411 00000100:00080000:2.0:1788572239.367432:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572239.367444:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638984320:0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367473:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572239.367491:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449638984832:0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367512:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572239.367528:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449638985344:0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367546:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572239.367562:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572239.367568:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449638983936:0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367594:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572239.367614:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449638984448:0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367633:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572239.367649:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449638984960:0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367668:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572239.367699:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638984832 00000100:00100000:2.0:1788572239.367702:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638984832 00000100:00100000:2.0:1788572239.367724:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638985344 00000100:00100000:2.0:1788572239.367727:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638985344 00000100:00100000:2.0:1788572239.367736:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638984448 00000100:00100000:2.0:1788572239.367738:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638984448 00000100:00100000:2.0:1788572239.367749:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638984960 00000100:00100000:2.0:1788572239.367751:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638984960 00000100:00100000:2.0:1788572239.367764:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4412 00000100:00100000:2.0:1788572239.367769:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449638984832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367801:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449638984832:12345-0@lo:400:kworker.0 Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572239.367806:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4412 00000100:00100000:2.0:1788572239.367817:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4413 00000100:00100000:2.0:1788572239.367822:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449638985344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367843:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449638985344:12345-0@lo:400:kworker.0 Request processed in 22us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572239.367849:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4413 00000100:00100000:2.0:1788572239.367857:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4414 00000100:00100000:2.0:1788572239.367862:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449638984448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367885:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449638984448:12345-0@lo:400:kworker.0 Request processed in 22us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572239.367891:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4414 00000100:00100000:2.0:1788572239.367900:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4415 00000100:00100000:2.0:1788572239.367905:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449638984960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367928:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449638984960:12345-0@lo:400:kworker.0 Request processed in 23us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572239.367933:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4415 00000100:00080000:2.0:1788572239.367946:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572239.367948:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572239.367966:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449638984448:0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367976:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449638984960:0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367984:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449638984832:0@lo:400:kworker.0 00000100:00100000:2.0:1788572239.367991:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449638985344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572239.368369:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638984320 00000100:00100000:1.0:1788572239.368374:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638984320 00000100:00100000:1.0:1788572239.368415:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3620 00000100:00100000:1.0:1788572239.368421:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449638984320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572239.368464:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449638984320:12345-0@lo:400:kworker.0 Request processed in 43us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572239.368469:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3620 00000100:00100000:1.0:1788572239.368502:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638984320:0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.368600:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449638984064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.368613:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449638984576:0@lo:400:kworker.0 00000100:00100000:0.0:1788572239.368623:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449638984192:0@lo:400:kworker.0 00000100:00100000:3.0:1788572239.369349:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638983936 00000100:00100000:3.0:1788572239.369356:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638983936 00000100:00100000:3.0:1788572239.369411:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788572239.369419:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449638983936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572239.369481:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449638983936:12345-0@lo:400:kworker.0 Request processed in 63us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572239.369488:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788572239.370244:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449638983936:0@lo:400:kworker.0 00010000:00010000:3.0:1788572239.556114:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572239.776306:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572239.777231:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615410560 00000100:00100000:1.0:1788572239.777243:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615410560 00000100:00100000:1.0:1788572239.777294:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 83 00000100:00100000:1.0:1788572239.777301:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449615410560:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572239.777373:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449615410560:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 71us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572239.777408:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 83 00000100:00100000:3.0:1788572239.781482:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572239.781523:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572239.781557:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572239.781590:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572239.781626:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615410944 00000100:00100000:0.0:1788572239.781627:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615411072 00000100:00100000:0.0:1788572239.781636:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615411072 00000100:00100000:3.0:1788572239.781644:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615410944 00000100:00100000:2.0:1788572239.781653:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615410688 00000100:00100000:2.0:1788572239.781659:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615410688 00000100:00100000:0.0:1788572239.781756:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3621 00000100:00100000:0.0:1788572239.781765:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2383:x1875449615411072:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572239.781826:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2383:x1875449615411072:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 63us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572239.781833:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3621 00000100:00100000:1.0:1788572239.782865:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615410816 00000100:00100000:1.0:1788572239.782874:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615410816 00000100:00080000:0.0:1788572239.783990:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572239.783998:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572239.784014:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572239.784018:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572239.784214:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4416 00000100:00100000:2.0:1788572239.784225:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+126:2383:x1875449615410688:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572239.784302:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+126:2383:x1875449615410688:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 79us (2840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572239.784311:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4416 00000100:00100000:0.0:1788572239.784863:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3622 00000100:00100000:0.0:1788572239.784877:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2383:x1875449615410944:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572239.784922:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2383:x1875449615410944:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 49us (3397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572239.784929:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3622 00000100:00100000:1.0:1788572239.786111:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4417 00000100:00100000:1.0:1788572239.786121:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449615410816:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572239.786183:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449615410816:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 63us (4625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572239.786194:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4417 00000100:00100000:0.0:1788572239.879243:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572239.879268:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638985472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572239.879350:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572239.879566:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638985472 00000100:00100000:1.0:1788572239.879575:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638985472 00000100:00100000:1.0:1788572239.879635:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787 00000100:00100000:1.0:1788572239.879645:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449638985472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572239.879674:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572239.879727:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449638985472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572239.879734:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787 00000100:00100000:0.0:1788572239.879819:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449638985472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572239.892622:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572239.892725:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615411200 00000100:00100000:0.0:1788572239.892736:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615411200 00000100:00100000:0.0:1788572239.892805:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12259 00000100:00100000:0.0:1788572239.892815:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+126:85409:x1875449615411200:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:0.0:1788572239.892834:0:9276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572239.892856:0:9276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b8326377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4703c expref: -99 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.892920:0:9276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b832637e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.892934:0:9276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b832637e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.892946:0:9276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b832637e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572239.893037:0:9276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1788572239.893041:0:9276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572239.893079:0:9276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b832637e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.893102:0:9276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b8326377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4703c expref: 128 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.893119:0:9276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b832637e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4703c expref: 127 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.893127:0:9276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63acd5f00) 00010000:00010000:0.0:1788572239.893130:0:9276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572239.893134:0:9276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63a972c00, rc 0) 00000100:00100000:0.0:1788572239.893195:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+127:85409:x1875449615411200:12345-192.168.202.13@tcp:101:bash.0 Request processed in 382us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572239.893203:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12259 00000100:00100000:3.0:1788572239.900135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572239.902313:0:6554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615411328 00000100:00100000:0.0:1788572239.902330:0:6554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615411328 00000100:00100000:0.0:1788572239.902413:0:6554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2447 00000100:00100000:0.0:1788572239.902425:0:6554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+127:85409:x1875449615411328:12345-192.168.202.13@tcp:37:bash.0 00000100:00100000:0.0:1788572239.910421:0:6554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+127:85409:x1875449615411328:12345-192.168.202.13@tcp:37:bash.0 Request processed in 7988us (10285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572239.910436:0:6554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2447 00000100:00100000:2.0:1788572239.934566:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572239.934755:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615411456 00000100:00100000:0.0:1788572239.934765:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615411456 00000100:00100000:0.0:1788572239.934824:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12260 00000100:00100000:0.0:1788572239.934834:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+127:87034:x1875449615411456:12345-192.168.202.13@tcp:101:checkstat.0 00010000:00010000:0.0:1788572239.934855:0:95742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572239.934877:0:95742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b8326385 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb47043 expref: -99 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.934946:0:95742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b832638c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.934962:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b832638c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.934974:0:95742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b832638c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.934989:0:95742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b8326393 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c5389bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935033:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b8326393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c5389bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935042:0:95742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b8326393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c5389bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935102:0:95742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b832638c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935110:0:95742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b832638c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935117:0:95742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b832638c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935122:0:95742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572239.935125:0:95742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b832638c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935135:0:95742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b832638c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935146:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63acd5f00) 00010000:00010000:0.0:1788572239.935150:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572239.935155:0:95742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b832638c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935161:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972000/0xdb7edb52b832638c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935175:0:95742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b8326393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c5389bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935181:0:95742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b8326393 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c5389bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935187:0:95742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b8326393 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c5389bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935192:0:95742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572239.935194:0:95742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b8326393 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c5389bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935201:0:95742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b8326393 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c5389bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935208:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c5389bd (ffff94e63acd5800) 00010000:00010000:0.0:1788572239.935211:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572239.935214:0:95742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b8326393 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c5389bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935223:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972800/0xdb7edb52b8326393 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c5389bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935255:0:95742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b8326385 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47043 expref: 128 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935266:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63acd5f00) 00010000:00010000:0.0:1788572239.935268:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572239.935272:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973600/0xdb7edb52b8326385 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47043 expref: 128 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572239.935282:0:95742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63a973600, rc 0) 00000100:00100000:0.0:1788572239.935932:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+127:87034:x1875449615411456:12345-192.168.202.13@tcp:101:checkstat.0 Request processed in 1097us (1373us total) trans 0 rc 301/301 00000100:00100000:0.0:1788572239.935941:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12260 00010000:00010000:2.0:1788572240.579337:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572240.903484:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000004:00080000:3.0:1788572240.903518:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000001:00080000:3.0:1788572240.903562:0:111978:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 219043332496 is committed 00000004:00080000:3.0:1788572240.903588:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000004:00080000:3.0:1788572240.903592:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000004:00080000:3.0:1788572240.903668:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000004:00080000:3.0:1788572240.903676:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000100:00100000:1.0:1788572240.903875:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638985984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.903975:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.904041:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638986496:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.904064:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.904088:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572240.904093:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638985856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.904111:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.904125:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638986368:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.904142:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.904411:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638985728:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572240.904442:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.904472:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638986240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572240.904491:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.904514:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788572240.904521:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638985600:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572240.904541:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.904555:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638986112:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572240.904586:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.904732:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638985984 00000100:00100000:1.0:1788572240.904741:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638985984 00000100:00100000:1.0:1788572240.904793:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638986496 00000100:00100000:1.0:1788572240.904796:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638986496 00000100:00100000:1.0:1788572240.904810:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638985856 00000100:00100000:1.0:1788572240.904813:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638985856 00000100:00100000:1.0:1788572240.904825:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638986368 00000100:00100000:1.0:1788572240.904828:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638986368 00000100:00100000:1.0:1788572240.904843:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638985728 00000100:00100000:1.0:1788572240.904846:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638985728 00000100:00100000:1.0:1788572240.904859:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638986240 00000100:00100000:1.0:1788572240.904862:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638986240 00000100:00100000:1.0:1788572240.904874:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638985600 00000100:00100000:1.0:1788572240.904876:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638985600 00000100:00100000:1.0:1788572240.904887:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638986112 00000100:00100000:1.0:1788572240.904889:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638986112 00000100:00100000:1.0:1788572240.904903:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3279 00000100:00100000:1.0:1788572240.904910:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:3651:x1875449638985984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.904935:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2391 count 1 00002000:00010000:1.0:1788572240.904972:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x957:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.904979:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000974323e1/0xdb7edb52b832639a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.904996:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x957:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.905001:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x957:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.905028:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000974323e1/0xdb7edb52b832639a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905044:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000974323e1/0xdb7edb52b832639a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905053:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000974323e1/0xdb7edb52b832639a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905073:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000974323e1/0xdb7edb52b832639a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905089:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572240.905243:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:3651:x1875449638985984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 332us (1267us total) trans 8589935700 rc 0/0 00000100:00100000:1.0:1788572240.905251:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3279 00000100:00100000:1.0:1788572240.905268:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280 00000100:00100000:1.0:1788572240.905275:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:3651:x1875449638986496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.905287:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2395 count 1 00002000:00010000:1.0:1788572240.905301:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x95b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.905307:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83263a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905315:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95b:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.905318:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.905323:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83263a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905333:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83263a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905341:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83263a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905349:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83263a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905361:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572240.905431:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:3651:x1875449638986496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 156us (1365us total) trans 8589935701 rc 0/0 00000100:00100000:1.0:1788572240.905440:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280 00000100:00100000:1.0:1788572240.905452:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3281 00000100:00100000:1.0:1788572240.905458:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:3651:x1875449638985856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.905469:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2390 count 1 00002000:00010000:1.0:1788572240.905483:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x956:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.905487:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83263a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905495:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x956:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.905498:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x956:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.905502:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83263a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905522:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83263a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905530:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83263a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905536:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83263a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905548:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572240.905606:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:3651:x1875449638985856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 147us (1492us total) trans 8589935702 rc 0/0 00000100:00100000:1.0:1788572240.905613:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3281 00000100:00100000:1.0:1788572240.905625:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3282 00000100:00100000:1.0:1788572240.905631:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:3651:x1875449638986368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.905642:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2394 count 1 00002000:00010000:1.0:1788572240.905657:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x95a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.905662:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8d3d852/0xdb7edb52b83263af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905670:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95a:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.905673:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.905677:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d3d852/0xdb7edb52b83263af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905686:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8d3d852/0xdb7edb52b83263af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905693:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8d3d852/0xdb7edb52b83263af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905699:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d3d852/0xdb7edb52b83263af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905714:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788572240.905768:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:3651:x1875449638986368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 137us (1625us total) trans 8589935703 rc 0/0 00000100:00100000:1.0:1788572240.905775:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3282 00000100:00100000:1.0:1788572240.905786:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3283 00000100:00100000:1.0:1788572240.905792:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:3653:x1875449638985728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.905803:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2389 count 1 00002000:00010000:1.0:1788572240.905816:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x955:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.905821:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83263b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905828:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x955:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.905831:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x955:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.905834:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83263b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905843:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83263b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905849:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83263b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905855:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83263b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905865:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1788572240.905926:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:3653:x1875449638985728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 133us (1482us total) trans 8589935704 rc 0/0 00000100:00100000:1.0:1788572240.905931:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3283 00000100:00100000:1.0:1788572240.905942:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3284 00000100:00100000:1.0:1788572240.905948:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:3653:x1875449638986240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.905958:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2393 count 1 00002000:00010000:1.0:1788572240.905973:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x959:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.905977:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83263bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.905986:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x959:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.905989:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x959:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.905993:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83263bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906000:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83263bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906033:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83263bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906040:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83263bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906048:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1788572240.906102:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:3653:x1875449638986240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 154us (1609us total) trans 8589935705 rc 0/0 00000100:00100000:1.0:1788572240.906108:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3284 00000100:00100000:1.0:1788572240.906120:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3285 00000100:00100000:1.0:1788572240.906125:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:3653:x1875449638985600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.906134:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2388 count 1 00002000:00010000:1.0:1788572240.906149:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x954:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.906154:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007432844c/0xdb7edb52b83263c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906162:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x954:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.906164:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x954:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.906167:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007432844c/0xdb7edb52b83263c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906176:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007432844c/0xdb7edb52b83263c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906183:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007432844c/0xdb7edb52b83263c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906191:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007432844c/0xdb7edb52b83263c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906200:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1788572240.906254:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:3653:x1875449638985600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 129us (1712us total) trans 8589935706 rc 0/0 00000100:00100000:1.0:1788572240.906260:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3285 00000100:00100000:1.0:1788572240.906272:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3286 00000100:00100000:1.0:1788572240.906278:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+150:3653:x1875449638986112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.906289:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2392 count 1 00002000:00010000:1.0:1788572240.906302:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x958:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.906306:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83263cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906317:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x958:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.906320:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x958:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.906323:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83263cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906331:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83263cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906337:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83263cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906343:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83263cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906350:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:1.0:1788572240.906441:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+151:3653:x1875449638986112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 162us (1853us total) trans 8589935707 rc 0/0 00000100:00100000:1.0:1788572240.906447:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3286 00010000:00010000:1.0:1788572240.906472:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788572240.906479:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000974323e1/0xdb7edb52b832639a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906488:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.906492:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000974323e1/0xdb7edb52b832639a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906507:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000974323e1/0xdb7edb52b832639a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906524:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000974323e1/0xdb7edb52b832639a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906531:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000974323e1/0xdb7edb52b832639a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906551:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788572240.906555:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83263a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906562:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.906565:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83263a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906572:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83263a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906581:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83263a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906588:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83263a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906605:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788572240.906609:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83263a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906615:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.906618:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83263a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906625:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83263a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906634:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83263a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906640:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83263a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906652:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788572240.906655:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8d3d852/0xdb7edb52b83263af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906661:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.906664:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8d3d852/0xdb7edb52b83263af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906676:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8d3d852/0xdb7edb52b83263af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906685:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8d3d852/0xdb7edb52b83263af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906692:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8d3d852/0xdb7edb52b83263af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906703:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788572240.906707:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83263b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906712:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.906715:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83263b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906722:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83263b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906730:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83263b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906736:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83263b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906751:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572240.906754:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83263bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906759:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.906762:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83263bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906769:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83263bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906777:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83263bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906783:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83263bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906794:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572240.906797:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007432844c/0xdb7edb52b83263c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906802:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.906804:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007432844c/0xdb7edb52b83263c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906815:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007432844c/0xdb7edb52b83263c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906822:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007432844c/0xdb7edb52b83263c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906827:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007432844c/0xdb7edb52b83263c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906837:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572240.906840:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83263cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906845:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.906848:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83263cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906854:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83263cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906863:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83263cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906869:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83263cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.906883:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.906884:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.906886:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572240.906930:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc3b480/2, rc 0, transno 8589935702 00000100:00100000:1.0:1788572240.906957:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638985856:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572240.906971:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc39c00/2, rc 0, transno 8589935703 00000100:00100000:1.0:1788572240.906975:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638986368:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572240.906984:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc3ad80/2, rc 0, transno 8589935700 00000100:00100000:1.0:1788572240.906988:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638985984:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572240.906996:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc3b800/2, rc 0, transno 8589935701 00000100:00100000:1.0:1788572240.906998:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638986496:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.907145:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638987008:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.907190:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.907213:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572240.907218:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638986880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.907236:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.907259:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638986752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.907282:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572240.907306:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc39f80/2, rc 0, transno 8589935706 00000100:00100000:1.0:1788572240.907313:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638985600:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572240.907322:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc39500/2, rc 0, transno 8589935707 00000100:00100000:1.0:1788572240.907325:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638986112:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572240.907336:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc38380/2, rc 0, transno 8589935704 00000100:00100000:1.0:1788572240.907340:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638985728:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572240.907347:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc38e00/2, rc 0, transno 8589935705 00000100:00100000:1.0:1788572240.907350:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638986240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.907357:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572240.907361:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638986624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.907398:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.907423:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638987008 00000100:00100000:1.0:1788572240.907429:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638987008 00000100:00100000:2.0:1788572240.907453:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638986880 00000100:00100000:1.0:1788572240.907454:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638986752 00000100:00100000:1.0:1788572240.907456:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638986752 00000100:00100000:2.0:1788572240.907456:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638986880 00000100:00100000:1.0:1788572240.907463:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638986624 00000100:00100000:1.0:1788572240.907466:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638986624 00000100:00100000:2.0:1788572240.907472:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3287 00000100:00100000:2.0:1788572240.907478:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+154:3651:x1875449638987008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572240.907497:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2399 count 1 00002000:00010000:2.0:1788572240.907528:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x95f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.907534:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b83263d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.907543:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95f:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:2.0:1788572240.907546:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.907552:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b83263d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.907562:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b83263d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.907570:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b83263d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.907577:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b83263d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.907592:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572240.907942:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+155:3651:x1875449638987008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 463us (750us total) trans 8589935708 rc 0/0 00010000:00010000:0.0:1788572240.908177:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116600/0xdb7edb52b8324cb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f1fd8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908187:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116600/0xdb7edb52b8324cb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f1fd8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908194:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116600/0xdb7edb52b8324cb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f1fd8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908200:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641116600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908205:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116600/0xdb7edb52b8324cb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f1fd8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908217:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116600/0xdb7edb52b8324cb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f1fd8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908231:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f1fd8ec (ffff94e613194200) 00010000:00010000:0.0:1788572240.908235:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908239:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116600/0xdb7edb52b8324cb7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f1fd8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908246:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116600/0xdb7edb52b8324cb7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f1fd8ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908272:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b8324e54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6ce42d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908279:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b8324e54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6ce42d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908285:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b8324e54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6ce42d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908290:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8da00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908293:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b8324e54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6ce42d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908299:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b8324e54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6ce42d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908306:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6ce42d65 (ffff94e611827700) 00010000:00010000:0.0:1788572240.908308:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908310:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b8324e54 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6ce42d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908316:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8da00/0xdb7edb52b8324e54 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6ce42d65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908329:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbba00/0xdb7edb52b8325117 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe25f660e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908334:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbba00/0xdb7edb52b8325117 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe25f660e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908338:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbba00/0xdb7edb52b8325117 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe25f660e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908343:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63abbba00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908345:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbba00/0xdb7edb52b8325117 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe25f660e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908351:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbba00/0xdb7edb52b8325117 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe25f660e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908357:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe25f660e (ffff94e60fc41300) 00010000:00010000:0.0:1788572240.908359:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908361:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbba00/0xdb7edb52b8325117 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe25f660e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908376:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbba00/0xdb7edb52b8325117 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe25f660e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908392:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b8325412 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8dc66f87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908398:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b8325412 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8dc66f87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908405:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b8325412 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8dc66f87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908410:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908413:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b8325412 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8dc66f87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908419:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b8325412 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8dc66f87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908427:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8dc66f87 (ffff94e611827100) 00010000:00010000:0.0:1788572240.908429:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908432:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b8325412 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8dc66f87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908437:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5000/0xdb7edb52b8325412 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8dc66f87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908451:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b8325458 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe6dc788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908457:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b8325458 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe6dc788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908463:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b8325458 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe6dc788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908468:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908471:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b8325458 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe6dc788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908480:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b8325458 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe6dc788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908487:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe6dc788 (ffff94e64217c800) 00010000:00010000:0.0:1788572240.908489:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908491:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b8325458 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe6dc788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908496:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560000/0xdb7edb52b8325458 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe6dc788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908519:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbe00/0xdb7edb52b832549e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7712141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908526:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbe00/0xdb7edb52b832549e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7712141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908531:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbe00/0xdb7edb52b832549e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7712141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908536:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63abbbe00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908539:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbe00/0xdb7edb52b832549e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7712141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908544:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbe00/0xdb7edb52b832549e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7712141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908552:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7712141 (ffff94e633d91a00) 00010000:00010000:0.0:1788572240.908554:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908557:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbe00/0xdb7edb52b832549e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7712141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908563:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbe00/0xdb7edb52b832549e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7712141 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908578:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b83254e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c4969aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908583:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b83254e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c4969aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908589:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b83254e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c4969aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908593:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908596:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b83254e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c4969aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908602:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b83254e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c4969aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908609:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6c4969aa (ffff94e64217cb00) 00010000:00010000:0.0:1788572240.908611:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908613:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b83254e4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6c4969aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908619:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561c00/0xdb7edb52b83254e4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6c4969aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908633:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832552a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32836363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908638:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832552a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32836363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908645:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832552a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32836363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908650:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0da00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908652:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832552a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32836363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908657:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832552a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32836363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908664:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x32836363 (ffff94e63ab9c800) 00010000:00010000:0.0:1788572240.908666:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908668:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832552a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x32836363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908673:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832552a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x32836363 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908684:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b8325570 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xecb45c34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908691:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b8325570 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xecb45c34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908696:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b8325570 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xecb45c34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908700:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908703:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b8325570 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xecb45c34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908712:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b8325570 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xecb45c34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908719:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xecb45c34 (ffff94e611827a00) 00010000:00010000:0.0:1788572240.908721:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908723:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b8325570 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xecb45c34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908729:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5a00/0xdb7edb52b8325570 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xecb45c34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908742:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b83255b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3467b5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908747:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b83255b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3467b5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908753:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b83255b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3467b5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908757:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0ce00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908760:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b83255b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3467b5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908765:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b83255b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3467b5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908772:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3467b5ed (ffff94e63ab9cf00) 00010000:00010000:0.0:1788572240.908774:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908777:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b83255b6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3467b5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908783:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0ce00/0xdb7edb52b83255b6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3467b5ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908796:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b83255fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9086fdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908801:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b83255fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9086fdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908807:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b83255fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9086fdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908811:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908814:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b83255fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9086fdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908820:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b83255fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9086fdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908827:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9086fdc5 (ffff94e63ab9c100) 00010000:00010000:0.0:1788572240.908830:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908833:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b83255fc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9086fdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908838:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d200/0xdb7edb52b83255fc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9086fdc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908850:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b8325642 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe09f523e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908856:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b8325642 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe09f523e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908862:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b8325642 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe09f523e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908867:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908869:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b8325642 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe09f523e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908875:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b8325642 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe09f523e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908883:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe09f523e (ffff94e611827d00) 00010000:00010000:0.0:1788572240.908885:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908888:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b8325642 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe09f523e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908893:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4800/0xdb7edb52b8325642 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe09f523e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908905:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b8325688 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa59d2ae7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908911:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b8325688 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa59d2ae7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908917:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b8325688 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa59d2ae7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908921:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908924:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b8325688 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa59d2ae7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908932:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b8325688 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa59d2ae7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908939:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa59d2ae7 (ffff94e63ab9c500) 00010000:00010000:0.0:1788572240.908941:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908943:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b8325688 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa59d2ae7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908948:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c800/0xdb7edb52b8325688 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa59d2ae7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908960:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b83256ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x267d9460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908966:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b83256ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x267d9460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908971:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b83256ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x267d9460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908975:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.908978:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b83256ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x267d9460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908983:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b83256ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x267d9460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908989:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x267d9460 (ffff94e63ab9cb00) 00010000:00010000:0.0:1788572240.908992:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.908994:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b83256ce lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x267d9460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.908999:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b83256ce lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x267d9460 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909054:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb200/0xdb7edb52b8325714 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1924ec61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909060:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb200/0xdb7edb52b8325714 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1924ec61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909064:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb200/0xdb7edb52b8325714 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1924ec61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909070:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63abbb200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909072:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb200/0xdb7edb52b8325714 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1924ec61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909079:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb200/0xdb7edb52b8325714 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1924ec61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909086:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1924ec61 (ffff94e633d91c00) 00010000:00010000:0.0:1788572240.909088:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909090:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb200/0xdb7edb52b8325714 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1924ec61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909095:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb200/0xdb7edb52b8325714 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1924ec61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909108:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb600/0xdb7edb52b832575a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa0aee61a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909114:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb600/0xdb7edb52b832575a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa0aee61a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909119:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb600/0xdb7edb52b832575a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa0aee61a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909124:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63abbb600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909126:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb600/0xdb7edb52b832575a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa0aee61a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909131:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb600/0xdb7edb52b832575a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa0aee61a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909138:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa0aee61a (ffff94e633d91900) 00010000:00010000:0.0:1788572240.909141:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909143:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb600/0xdb7edb52b832575a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa0aee61a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909148:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb600/0xdb7edb52b832575a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa0aee61a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909161:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b83257a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x162633c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909166:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b83257a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x162633c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909172:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b83257a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x162633c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909176:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909179:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b83257a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x162633c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909187:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b83257a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x162633c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909195:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x162633c3 (ffff94e604ddbe00) 00010000:00010000:0.0:1788572240.909197:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909200:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b83257a0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x162633c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909206:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b83257a0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x162633c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909218:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52800/0xdb7edb52b83257e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb5ea883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909224:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52800/0xdb7edb52b83257e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb5ea883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909230:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52800/0xdb7edb52b83257e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb5ea883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909235:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909237:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52800/0xdb7edb52b83257e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb5ea883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909243:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52800/0xdb7edb52b83257e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb5ea883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909251:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb5ea883c (ffff94e604ddb700) 00010000:00010000:0.0:1788572240.909254:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909257:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52800/0xdb7edb52b83257e6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb5ea883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909263:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52800/0xdb7edb52b83257e6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb5ea883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909275:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b832582c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9e11010d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909281:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b832582c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9e11010d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909287:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b832582c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9e11010d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909292:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0dc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909294:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b832582c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9e11010d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909300:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b832582c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9e11010d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909307:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9e11010d (ffff94e63ab9c600) 00010000:00010000:0.0:1788572240.909309:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909311:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b832582c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9e11010d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909316:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0dc00/0xdb7edb52b832582c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9e11010d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909328:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb000/0xdb7edb52b8325872 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2a185ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909334:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb000/0xdb7edb52b8325872 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2a185ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909340:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb000/0xdb7edb52b8325872 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2a185ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909345:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63abbb000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909348:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb000/0xdb7edb52b8325872 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2a185ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909354:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb000/0xdb7edb52b8325872 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2a185ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909360:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2a185ac6 (ffff94e633d91000) 00010000:00010000:0.0:1788572240.909362:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909365:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb000/0xdb7edb52b8325872 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2a185ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909382:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbb000/0xdb7edb52b8325872 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2a185ac6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909396:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52200/0xdb7edb52b83258b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc06db4aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909402:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52200/0xdb7edb52b83258b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc06db4aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909407:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52200/0xdb7edb52b83258b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc06db4aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909413:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909416:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52200/0xdb7edb52b83258b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc06db4aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909425:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52200/0xdb7edb52b83258b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc06db4aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909432:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc06db4aa (ffff94e604ddb900) 00010000:00010000:0.0:1788572240.909434:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909437:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52200/0xdb7edb52b83258b8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc06db4aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909443:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52200/0xdb7edb52b83258b8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc06db4aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909455:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b83258fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x70d10e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909461:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b83258fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x70d10e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909466:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b83258fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x70d10e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909471:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909473:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b83258fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x70d10e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909479:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b83258fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x70d10e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909487:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x70d10e63 (ffff94e611827400) 00010000:00010000:0.0:1788572240.909489:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909491:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b83258fe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x70d10e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909497:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4e00/0xdb7edb52b83258fe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x70d10e63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909510:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b8325944 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35cee70c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909516:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b8325944 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35cee70c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909521:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b8325944 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35cee70c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909527:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909529:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b8325944 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35cee70c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909535:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b8325944 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x35cee70c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909542:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35cee70c (ffff94e611827f00) 00010000:00010000:0.0:1788572240.909545:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909547:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b8325944 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x35cee70c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909553:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4600/0xdb7edb52b8325944 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x35cee70c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909566:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b832598a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf55f5085 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909572:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b832598a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf55f5085 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909578:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b832598a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf55f5085 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909583:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909586:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b832598a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf55f5085 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909592:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b832598a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf55f5085 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909599:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf55f5085 (ffff94e611827300) 00010000:00010000:0.0:1788572240.909601:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909604:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b832598a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf55f5085 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909610:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4a00/0xdb7edb52b832598a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf55f5085 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909622:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba000/0xdb7edb52b83259d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae5aa886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909627:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba000/0xdb7edb52b83259d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae5aa886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909633:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba000/0xdb7edb52b83259d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae5aa886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909638:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63abba000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909640:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba000/0xdb7edb52b83259d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae5aa886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909650:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba000/0xdb7edb52b83259d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae5aa886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909657:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae5aa886 (ffff94e633d91100) 00010000:00010000:0.0:1788572240.909659:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909662:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba000/0xdb7edb52b83259d0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae5aa886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909668:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba000/0xdb7edb52b83259d0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae5aa886 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909682:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8325a16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38befcff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909688:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8325a16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38befcff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909694:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8325a16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38befcff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909698:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0de00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909701:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8325a16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38befcff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909707:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8325a16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38befcff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909714:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x38befcff (ffff94e63ab9ce00) 00010000:00010000:0.0:1788572240.909717:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909720:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8325a16 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x38befcff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909726:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8325a16 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x38befcff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909739:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b8325a5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13b8eaa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909745:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b8325a5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13b8eaa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909751:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b8325a5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13b8eaa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909756:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909758:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b8325a5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13b8eaa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909765:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b8325a5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13b8eaa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909772:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x13b8eaa8 (ffff94e611827600) 00010000:00010000:0.0:1788572240.909774:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909777:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b8325a5c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x13b8eaa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909783:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5e00/0xdb7edb52b8325a5c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x13b8eaa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909796:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b8325aa2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x461c4461 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909802:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b8325aa2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x461c4461 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909810:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b8325aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x461c4461 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909815:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909818:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b8325aa2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x461c4461 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909824:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b8325aa2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x461c4461 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909832:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x461c4461 (ffff94e611827e00) 00010000:00010000:0.0:1788572240.909834:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909837:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b8325aa2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x461c4461 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909842:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5400/0xdb7edb52b8325aa2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x461c4461 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909855:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b8325ae8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c4d3d32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909862:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b8325ae8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c4d3d32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909868:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b8325ae8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c4d3d32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909873:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909876:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b8325ae8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c4d3d32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909885:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b8325ae8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6c4d3d32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909893:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6c4d3d32 (ffff94e611827000) 00010000:00010000:0.0:1788572240.909895:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909898:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b8325ae8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6c4d3d32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909904:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5c00/0xdb7edb52b8325ae8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6c4d3d32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909916:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbac00/0xdb7edb52b8325b2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25b591ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909923:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbac00/0xdb7edb52b8325b2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25b591ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909928:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbac00/0xdb7edb52b8325b2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25b591ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909933:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63abbac00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909936:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbac00/0xdb7edb52b8325b2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25b591ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909942:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbac00/0xdb7edb52b8325b2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25b591ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909949:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25b591ab (ffff94e633d91700) 00010000:00010000:0.0:1788572240.909952:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.909955:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbac00/0xdb7edb52b8325b2e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25b591ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909961:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbac00/0xdb7edb52b8325b2e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25b591ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909974:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b8325b74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x312a1889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909981:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b8325b74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x312a1889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909986:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b8325b74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x312a1889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.909991:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.909994:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b8325b74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x312a1889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910000:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b8325b74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x312a1889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910040:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x312a1889 (ffff94e611827800) 00010000:00010000:0.0:1788572240.910043:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910046:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b8325b74 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x312a1889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910052:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5600/0xdb7edb52b8325b74 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x312a1889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910066:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b8325bba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb78d7242 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910073:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b8325bba lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb78d7242 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910079:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b8325bba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb78d7242 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910084:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910087:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b8325bba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb78d7242 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910093:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b8325bba lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb78d7242 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910101:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb78d7242 (ffff94e611827c00) 00010000:00010000:0.0:1788572240.910103:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910106:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b8325bba lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb78d7242 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910111:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4c00/0xdb7edb52b8325bba lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb78d7242 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910124:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53000/0xdb7edb52b8325c00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x755caaeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910130:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53000/0xdb7edb52b8325c00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x755caaeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910136:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53000/0xdb7edb52b8325c00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x755caaeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910141:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa53000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910144:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53000/0xdb7edb52b8325c00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x755caaeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910154:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53000/0xdb7edb52b8325c00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x755caaeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910162:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x755caaeb (ffff94e604ddb300) 00010000:00010000:0.0:1788572240.910164:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910167:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53000/0xdb7edb52b8325c00 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x755caaeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910173:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53000/0xdb7edb52b8325c00 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x755caaeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910186:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b8325c46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88ed1464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910192:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b8325c46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88ed1464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910198:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b8325c46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88ed1464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910203:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d5800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910206:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b8325c46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88ed1464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910212:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b8325c46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x88ed1464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910218:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x88ed1464 (ffff94e611827200) 00010000:00010000:0.0:1788572240.910221:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910223:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b8325c46 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x88ed1464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910230:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d5800/0xdb7edb52b8325c46 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x88ed1464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910243:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b8325c8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f170c65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910249:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b8325c8c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f170c65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910255:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b8325c8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f170c65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910260:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910263:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b8325c8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f170c65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910269:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b8325c8c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f170c65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910278:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f170c65 (ffff94e63ab9c700) 00010000:00010000:0.0:1788572240.910280:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910283:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b8325c8c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1f170c65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910289:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b8325c8c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1f170c65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910302:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52c00/0xdb7edb52b8325cd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17b60de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910308:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52c00/0xdb7edb52b8325cd2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17b60de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910314:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52c00/0xdb7edb52b8325cd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17b60de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910320:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910322:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52c00/0xdb7edb52b8325cd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17b60de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910328:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52c00/0xdb7edb52b8325cd2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x17b60de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910335:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x17b60de (ffff94e604ddb000) 00010000:00010000:0.0:1788572240.910338:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910340:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52c00/0xdb7edb52b8325cd2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x17b60de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910345:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52c00/0xdb7edb52b8325cd2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x17b60de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910357:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba400/0xdb7edb52b8325d18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa746ae87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910364:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba400/0xdb7edb52b8325d18 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa746ae87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910382:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba400/0xdb7edb52b8325d18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa746ae87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910388:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63abba400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910390:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba400/0xdb7edb52b8325d18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa746ae87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910400:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba400/0xdb7edb52b8325d18 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa746ae87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910409:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa746ae87 (ffff94e633d91e00) 00010000:00010000:0.0:1788572240.910411:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910414:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba400/0xdb7edb52b8325d18 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa746ae87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910420:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba400/0xdb7edb52b8325d18 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa746ae87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910435:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b8325d5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2daa0840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910441:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b8325d5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2daa0840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910447:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b8325d5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2daa0840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910452:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910455:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b8325d5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2daa0840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910462:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b8325d5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2daa0840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910468:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2daa0840 (ffff94e63ab9ca00) 00010000:00010000:0.0:1788572240.910471:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910473:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b8325d5e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2daa0840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910480:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d800/0xdb7edb52b8325d5e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2daa0840 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910493:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52600/0xdb7edb52b8325da4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd348a111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910499:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52600/0xdb7edb52b8325da4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd348a111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910505:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52600/0xdb7edb52b8325da4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd348a111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910510:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910513:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52600/0xdb7edb52b8325da4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd348a111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910518:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52600/0xdb7edb52b8325da4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd348a111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910525:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd348a111 (ffff94e604ddb400) 00010000:00010000:0.0:1788572240.910527:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910529:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52600/0xdb7edb52b8325da4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd348a111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910535:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52600/0xdb7edb52b8325da4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd348a111 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910548:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53200/0xdb7edb52b8325dea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1afbfaca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910555:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53200/0xdb7edb52b8325dea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1afbfaca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910561:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53200/0xdb7edb52b8325dea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1afbfaca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910566:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa53200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910568:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53200/0xdb7edb52b8325dea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1afbfaca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910574:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53200/0xdb7edb52b8325dea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1afbfaca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910581:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1afbfaca (ffff94e604ddb500) 00010000:00010000:0.0:1788572240.910583:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910585:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53200/0xdb7edb52b8325dea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1afbfaca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910590:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa53200/0xdb7edb52b8325dea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1afbfaca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910602:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbae00/0xdb7edb52b8325e30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x62162c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910608:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbae00/0xdb7edb52b8325e30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x62162c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910613:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbae00/0xdb7edb52b8325e30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x62162c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910617:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63abbae00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910620:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbae00/0xdb7edb52b8325e30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x62162c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910629:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbae00/0xdb7edb52b8325e30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x62162c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910636:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x62162c79 (ffff94e633d91800) 00010000:00010000:0.0:1788572240.910638:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910640:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbae00/0xdb7edb52b8325e30 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x62162c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910646:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbae00/0xdb7edb52b8325e30 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x62162c79 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910659:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b8325e76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3fda80f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910665:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b8325e76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3fda80f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910671:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b8325e76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3fda80f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910676:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8c000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910679:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b8325e76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3fda80f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910684:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b8325e76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3fda80f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910691:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3fda80f2 (ffff94e633d91200) 00010000:00010000:0.0:1788572240.910694:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910696:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b8325e76 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3fda80f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910702:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63af8c000/0xdb7edb52b8325e76 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3fda80f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910714:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b8325ebc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x975ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910720:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b8325ebc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x975ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910725:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b8325ebc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x975ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910731:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910733:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b8325ebc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x975ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910739:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b8325ebc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x975ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910746:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x975ce9b (ffff94e633d91500) 00010000:00010000:0.0:1788572240.910748:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910751:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b8325ebc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x975ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910757:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b8325ebc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x975ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910769:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b8325f02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3d92854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910775:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b8325f02 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3d92854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910781:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b8325f02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3d92854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910786:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910789:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b8325f02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3d92854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910795:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b8325f02 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3d92854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910802:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe3d92854 (ffff94e604ddba00) 00010000:00010000:0.0:1788572240.910804:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910807:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b8325f02 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe3d92854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910812:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b8325f02 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe3d92854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910826:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b8325f48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc032055 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910832:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b8325f48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc032055 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910838:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b8325f48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc032055 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910843:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910846:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b8325f48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc032055 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910855:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b8325f48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc032055 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910863:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc032055 (ffff94e604ddb600) 00010000:00010000:0.0:1788572240.910865:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910868:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b8325f48 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc032055 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910874:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9000/0xdb7edb52b8325f48 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc032055 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910888:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8325f8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x326774ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910895:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8325f8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x326774ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910901:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8325f8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x326774ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910905:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910908:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8325f8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x326774ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910914:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8325f8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x326774ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910921:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x326774ce (ffff94e633d91300) 00010000:00010000:0.0:1788572240.910924:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910927:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8325f8e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x326774ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910933:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8325f8e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x326774ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910946:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b8325fd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x84284277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910952:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b8325fd4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x84284277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910958:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b8325fd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x84284277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910963:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.910966:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b8325fd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x84284277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910972:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b8325fd4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x84284277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910979:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x84284277 (ffff94e63ab9cd00) 00010000:00010000:0.0:1788572240.910981:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.910984:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b8325fd4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x84284277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.910990:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c000/0xdb7edb52b8325fd4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x84284277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911033:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b832601a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93c96f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911040:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b832601a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93c96f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911047:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b832601a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93c96f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911052:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.911055:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b832601a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93c96f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911061:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b832601a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93c96f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911069:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf93c96f0 (ffff94e633d91d00) 00010000:00010000:0.0:1788572240.911071:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.911074:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b832601a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf93c96f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911080:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b832601a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf93c96f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911092:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b8326060 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b6c9501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911099:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b8326060 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b6c9501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911104:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b8326060 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b6c9501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911109:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.911112:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b8326060 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b6c9501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911122:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b8326060 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b6c9501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911129:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b6c9501 (ffff94e63ab9c300) 00010000:00010000:0.0:1788572240.911131:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.911134:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b8326060 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5b6c9501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911140:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0d400/0xdb7edb52b8326060 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5b6c9501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911153:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b83260a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe153897a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911159:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b83260a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe153897a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911165:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b83260a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe153897a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911170:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.911172:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b83260a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe153897a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911179:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b83260a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe153897a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911186:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe153897a (ffff94e633d91600) 00010000:00010000:0.0:1788572240.911188:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.911191:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b83260a6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe153897a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911197:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b83260a6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe153897a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911210:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b83260ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x176ce79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911216:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b83260ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x176ce79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911222:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b83260ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x176ce79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911227:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.911230:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b83260ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x176ce79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911236:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b83260ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x176ce79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911243:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x176ce79c (ffff94e64217cc00) 00010000:00010000:0.0:1788572240.911245:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.911248:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b83260ec lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x176ce79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911254:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560200/0xdb7edb52b83260ec lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x176ce79c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911268:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b8326132 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf1d04155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911274:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b8326132 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf1d04155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911280:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b8326132 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf1d04155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911285:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.911288:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b8326132 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf1d04155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911294:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b8326132 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf1d04155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911301:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf1d04155 (ffff94e64217c600) 00010000:00010000:0.0:1788572240.911303:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.911306:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b8326132 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf1d04155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911312:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561a00/0xdb7edb52b8326132 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf1d04155 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911324:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b8326178 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x753309be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911330:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b8326178 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x753309be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911335:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b8326178 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x753309be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911340:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.911343:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b8326178 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x753309be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911353:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b8326178 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x753309be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.911359:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x753309be (ffff94e64217c700) 00010000:00010000:0.0:1788572240.911362:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.911364:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b8326178 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x753309be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572240.911880:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3288 00000100:00100000:1.0:1788572240.911899:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+155:3653:x1875449638986752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.911932:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2397 count 1 00002000:00010000:1.0:1788572240.911964:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x95d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.911971:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b83263d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.911987:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95d:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.911992:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.911998:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b83263d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.912031:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b83263d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.912045:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b83263d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.912052:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b83263d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.912066:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572240.912249:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+156:3653:x1875449638986752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 358us (4965us total) trans 8589935709 rc 0/0 00000100:00100000:1.0:1788572240.912257:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3288 00000100:00100000:1.0:1788572240.912279:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3289 00000100:00100000:1.0:1788572240.912286:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+155:3651:x1875449638986880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.912299:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2398 count 1 00002000:00010000:1.0:1788572240.912313:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x95e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.912318:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83263e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.912327:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95e:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.912330:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.912334:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83263e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.912344:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83263e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.912358:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83263e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.912366:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83263e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.916958:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572240.917200:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+156:3651:x1875449638986880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4909us (9956us total) trans 8589935710 rc 0/0 00000100:00100000:1.0:1788572240.917212:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3289 00000100:00100000:1.0:1788572240.917248:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3290 00000100:00100000:1.0:1788572240.917259:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+155:3653:x1875449638986624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.917287:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2396 count 1 00002000:00010000:1.0:1788572240.917317:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x95c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.917324:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83263e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.917338:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95c:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.917342:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x95c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.917349:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83263e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.917365:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83263e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.917447:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83263e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.917456:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83263e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.917466:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788572240.917620:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+156:3653:x1875449638986624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 364us (10221us total) trans 8589935711 rc 0/0 00000100:00100000:1.0:1788572240.917627:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3290 00000100:00100000:1.0:1788572240.917734:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638987392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.917772:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.917805:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638987904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.917826:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.917837:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638988416:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.917856:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.917873:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572240.917878:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638987520:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.917898:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.917908:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638988032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.917924:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.917931:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638988544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.917970:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.917990:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638987392 00000100:00100000:1.0:1788572240.917996:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638987392 00000100:00100000:1.0:1788572240.918043:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638987904 00000100:00100000:1.0:1788572240.918046:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638987904 00000100:00100000:1.0:1788572240.918056:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638988416 00000100:00100000:1.0:1788572240.918058:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638988416 00000100:00100000:1.0:1788572240.918066:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638987520 00000100:00100000:1.0:1788572240.918068:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638987520 00000100:00100000:1.0:1788572240.918075:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638988032 00000100:00100000:1.0:1788572240.918077:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638988032 00000100:00100000:1.0:1788572240.918084:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638988544 00000100:00100000:1.0:1788572240.918087:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638988544 00000100:00100000:1.0:1788572240.918096:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3291 00000100:00100000:1.0:1788572240.918102:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+146:3650:x1875449638987392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572240.918117:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2390 count 1 00002000:00010000:1.0:1788572240.918136:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x956:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.918142:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2dd571d/0xdb7edb52b83263ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.918153:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x956:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.918156:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x956:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.918160:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2dd571d/0xdb7edb52b83263ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.918170:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2dd571d/0xdb7edb52b83263ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.918178:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2dd571d/0xdb7edb52b83263ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.918189:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2dd571d/0xdb7edb52b83263ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.918197:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1788572240.918284:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+147:3650:x1875449638987392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 181us (511us total) trans 4294968403 rc 0/0 00000100:00100000:1.0:1788572240.918289:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3291 00000100:00100000:1.0:1788572240.918301:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3292 00000100:00100000:1.0:1788572240.918306:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+146:3650:x1875449638987904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572240.918316:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2394 count 1 00002000:00010000:1.0:1788572240.918328:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x95a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.918332:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12fc627/0xdb7edb52b83263f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.918339:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95a:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.918342:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.918346:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12fc627/0xdb7edb52b83263f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.918355:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d12fc627/0xdb7edb52b83263f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.918362:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d12fc627/0xdb7edb52b83263f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.918386:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d12fc627/0xdb7edb52b83263f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.918395:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1788572240.918459:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+147:3650:x1875449638987904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 152us (631us total) trans 4294968404 rc 0/0 00000100:00100000:1.0:1788572240.918466:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3292 00000100:00100000:1.0:1788572240.918478:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3293 00000100:00100000:1.0:1788572240.918484:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+157:3650:x1875449638988416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.918496:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2402 count 1 00000100:00100000:3.0:1788572240.920089:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3294 00000100:00100000:3.0:1788572240.920114:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+146:3650:x1875449638987520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572240.920141:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2391 count 1 00002000:00010000:3.0:1788572240.920167:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x957:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572240.920176:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002519cac2/0xdb7edb52b83263fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920189:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x957:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:3.0:1788572240.920194:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x957:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572240.920199:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002519cac2/0xdb7edb52b83263fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920212:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002519cac2/0xdb7edb52b83263fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920222:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002519cac2/0xdb7edb52b83263fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920230:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002519cac2/0xdb7edb52b83263fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920241:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:3.0:1788572240.920393:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+147:3650:x1875449638987520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 291us (2493us total) trans 4294968405 rc 0/0 00000100:00100000:3.0:1788572240.920401:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3294 00000100:00100000:3.0:1788572240.920428:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3295 00000100:00100000:3.0:1788572240.920435:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+146:3650:x1875449638988032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572240.920448:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2395 count 1 00002000:00010000:3.0:1788572240.920461:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x95b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572240.920466:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8326403 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920474:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95b:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:3.0:1788572240.920477:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572240.920484:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8326403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920493:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8326403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920500:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8326403 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920640:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8326403 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920652:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:3.0:1788572240.920721:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+147:3650:x1875449638988032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 286us (2795us total) trans 4294968406 rc 0/0 00000100:00100000:3.0:1788572240.920730:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3295 00000100:00100000:3.0:1788572240.920745:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3296 00000100:00100000:3.0:1788572240.920752:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+157:3650:x1875449638988544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572240.920766:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2403 count 1 00002000:00010000:3.0:1788572240.920782:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x963:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572240.920786:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007acd8aef/0xdb7edb52b832640a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920794:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x963:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:3.0:1788572240.920798:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x963:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572240.920802:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007acd8aef/0xdb7edb52b832640a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920812:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007acd8aef/0xdb7edb52b832640a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920818:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007acd8aef/0xdb7edb52b832640a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920824:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007acd8aef/0xdb7edb52b832640a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.920832:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:3.0:1788572240.920907:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+158:3650:x1875449638988544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 155us (2936us total) trans 8589935712 rc 0/0 00000100:00100000:3.0:1788572240.920913:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3296 00010000:00010000:3.0:1788572240.920975:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788572240.920982:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b83263d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921281:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560c00/0xdb7edb52b8326178 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x753309be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921314:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b83261be lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbeb28377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921320:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b83261be lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbeb28377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921326:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b83261be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbeb28377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921331:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.921335:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b83261be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbeb28377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921342:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b83261be lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbeb28377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921355:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbeb28377 (ffff94e63acd5900) 00010000:00010000:0.0:1788572240.921358:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.921363:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b83261be lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbeb28377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921381:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6013a1e00/0xdb7edb52b83261be lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbeb28377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921401:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b8326204 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x97645b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921407:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b8326204 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x97645b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921413:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b8326204 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x97645b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921418:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.921420:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b8326204 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x97645b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921426:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b8326204 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x97645b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921434:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x97645b78 (ffff94e64217c400) 00010000:00010000:0.0:1788572240.921436:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.921439:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b8326204 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x97645b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921444:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613560e00/0xdb7edb52b8326204 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x97645b78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921458:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b832624a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdc8aff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921463:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b832624a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdc8aff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921469:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b832624a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdc8aff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921474:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.921477:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b832624a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdc8aff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921483:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b832624a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcdc8aff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921490:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcdc8aff1 (ffff94e615913500) 00010000:00010000:0.0:1788572240.921492:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.921495:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b832624a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcdc8aff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921500:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e613561e00/0xdb7edb52b832624a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcdc8aff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921526:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b8326290 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb3ffd9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921533:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b8326290 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb3ffd9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921538:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b8326290 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb3ffd9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921542:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6377d4400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.921545:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b8326290 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb3ffd9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921556:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b8326290 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb3ffd9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921563:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb3ffd9a (ffff94e63acd5100) 00010000:00010000:0.0:1788572240.921565:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.921568:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b8326290 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdb3ffd9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921574:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6377d4400/0xdb7edb52b8326290 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdb3ffd9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921588:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b83262d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe42af213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921595:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b83262d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe42af213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921601:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b83262d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe42af213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921605:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.921608:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b83262d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe42af213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921614:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b83262d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe42af213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921620:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe42af213 (ffff94e615913900) 00010000:00010000:0.0:1788572240.921623:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.921625:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b83262d6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe42af213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921632:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c200/0xdb7edb52b83262d6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe42af213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921646:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b832631c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde45f024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921652:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b832631c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde45f024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921658:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b832631c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde45f024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921663:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.921665:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b832631c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde45f024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921671:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b832631c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde45f024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921677:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xde45f024 (ffff94e63acd5e00) 00010000:00010000:0.0:1788572240.921679:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.921681:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b832631c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xde45f024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921686:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972400/0xdb7edb52b832631c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xde45f024 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921697:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b8326362 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0aa449d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921703:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b8326362 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0aa449d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921709:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b8326362 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0aa449d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921714:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572240.921717:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b8326362 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0aa449d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921723:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b8326362 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0aa449d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921729:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc0aa449d (ffff94e63acd5000) 00010000:00010000:0.0:1788572240.921731:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572240.921733:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b8326362 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc0aa449d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921738:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973c00/0xdb7edb52b8326362 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc0aa449d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921778:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788572240.921783:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b83263d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921790:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.921793:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b83263d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921801:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b83263d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921817:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b83263d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921825:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b83263d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921842:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788572240.921846:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83263e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921852:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.921855:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83263e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921861:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83263e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921870:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83263e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921876:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83263e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921887:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788572240.921890:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83263e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921897:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.921899:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83263e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921906:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83263e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921915:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83263e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921922:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83263e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921933:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572240.921936:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2dd571d/0xdb7edb52b83263ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921942:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.921945:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2dd571d/0xdb7edb52b83263ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921951:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2dd571d/0xdb7edb52b83263ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921960:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2dd571d/0xdb7edb52b83263ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921967:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2dd571d/0xdb7edb52b83263ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x956:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921979:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572240.921983:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d12fc627/0xdb7edb52b83263f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.921989:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.921992:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12fc627/0xdb7edb52b83263f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922000:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d12fc627/0xdb7edb52b83263f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922033:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d12fc627/0xdb7edb52b83263f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922041:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d12fc627/0xdb7edb52b83263f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x95a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922054:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572240.922067:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002519cac2/0xdb7edb52b83263fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922073:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.922076:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002519cac2/0xdb7edb52b83263fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922083:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002519cac2/0xdb7edb52b83263fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922093:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002519cac2/0xdb7edb52b83263fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922100:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002519cac2/0xdb7edb52b83263fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x957:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922117:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572240.922120:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8326403 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922127:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.922130:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8326403 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922138:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8326403 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922147:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8326403 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922154:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8326403 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x95b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922168:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572240.922172:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007acd8aef/0xdb7edb52b832640a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922178:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.922180:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007acd8aef/0xdb7edb52b832640a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922187:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007acd8aef/0xdb7edb52b832640a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922197:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007acd8aef/0xdb7edb52b832640a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922204:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007acd8aef/0xdb7edb52b832640a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.922215:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572240.922217:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572240.922218:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572240.922518:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638987264:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572240.922573:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572240.922613:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638987776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572240.922632:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572240.922648:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638988288:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.922667:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572240.922706:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f3b80/2, rc 0, transno 8589935711 00000100:00100000:0.0:1788572240.922725:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638986624:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572240.922738:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f0700/2, rc 0, transno 8589935709 00000100:00100000:0.0:1788572240.922742:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638986752:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.922757:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572240.922763:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638987136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572240.922800:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572240.922822:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638987648:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572240.922844:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572240.922858:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638988160:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.922874:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572240.922898:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638987264 00000100:00100000:0.0:1788572240.922904:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638987264 00000100:00100000:0.0:1788572240.922994:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638987776 00000100:00100000:0.0:1788572240.922998:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638987776 00000100:00100000:0.0:1788572240.923037:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638988288 00000100:00100000:0.0:1788572240.923040:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638988288 00000100:00100000:0.0:1788572240.923053:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638987136 00000100:00100000:0.0:1788572240.923055:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638987136 00000100:00100000:0.0:1788572240.923067:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638987648 00000100:00100000:0.0:1788572240.923070:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638987648 00000100:00100000:0.0:1788572240.923082:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638988160 00000100:00100000:0.0:1788572240.923084:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638988160 00000100:00100000:0.0:1788572240.923100:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3297 00000100:00100000:0.0:1788572240.923109:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+150:3653:x1875449638987264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572240.923139:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2389 count 1 00002000:00010000:0.0:1788572240.923167:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x955:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.923175:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b8326411 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923189:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x955:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.923193:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x955:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.923199:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b8326411 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923211:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b8326411 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923219:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b8326411 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923228:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b8326411 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923245:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572240.923410:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+151:3653:x1875449638987264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 302us (836us total) trans 4294968407 rc 0/0 00000100:00100000:0.0:1788572240.923419:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3297 00000100:00100000:0.0:1788572240.923435:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3298 00000100:00100000:0.0:1788572240.923441:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+150:3653:x1875449638987776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572240.923453:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2393 count 1 00002000:00010000:0.0:1788572240.923468:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x959:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.923473:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b8326418 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923486:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x959:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.923489:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x959:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.923493:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b8326418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923502:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b8326418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923510:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b8326418 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923518:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b8326418 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923526:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572240.923587:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+151:3653:x1875449638987776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 146us (952us total) trans 4294968408 rc 0/0 00000100:00100000:0.0:1788572240.923593:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3298 00000100:00100000:0.0:1788572240.923606:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3299 00000100:00100000:0.0:1788572240.923612:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+159:3653:x1875449638988288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.923623:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2401 count 1 00002000:00010000:0.0:1788572240.923639:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x961:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.923643:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e27a5de9/0xdb7edb52b832641f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923655:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x961:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.923657:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x961:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.923661:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e27a5de9/0xdb7edb52b832641f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923670:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e27a5de9/0xdb7edb52b832641f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923677:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e27a5de9/0xdb7edb52b832641f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923685:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e27a5de9/0xdb7edb52b832641f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923694:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788572240.923768:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+160:3653:x1875449638988288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 156us (1099us total) trans 8589935713 rc 0/0 00000100:00100000:0.0:1788572240.923774:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3299 00000100:00100000:0.0:1788572240.923786:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3300 00000100:00100000:0.0:1788572240.923792:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61ea3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+150:3653:x1875449638987136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572240.923804:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2388 count 1 00002000:00010000:0.0:1788572240.923817:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x954:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.923821:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b8326426 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923832:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x954:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.923835:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x954:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.923839:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b8326426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923847:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b8326426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923854:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b8326426 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923861:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b8326426 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923868:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788572240.923926:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61ea3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+151:3653:x1875449638987136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 135us (1125us total) trans 4294968409 rc 0/0 00000100:00100000:0.0:1788572240.923932:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3300 00000100:00100000:0.0:1788572240.923944:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3301 00000100:00100000:0.0:1788572240.923949:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61ea3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+150:3653:x1875449638987648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572240.923960:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2392 count 1 00002000:00010000:0.0:1788572240.923972:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x958:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.923977:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd16d475/0xdb7edb52b832642d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.923990:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x958:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.923992:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x958:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.923996:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd16d475/0xdb7edb52b832642d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.924028:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd16d475/0xdb7edb52b832642d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.924037:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd16d475/0xdb7edb52b832642d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.924044:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd16d475/0xdb7edb52b832642d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.924054:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1788572240.924112:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61ea3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+151:3653:x1875449638987648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 162us (1266us total) trans 4294968410 rc 0/0 00000100:00100000:0.0:1788572240.924118:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3301 00000100:00100000:0.0:1788572240.924130:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3302 00000100:00100000:0.0:1788572240.924137:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61ea3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+159:3653:x1875449638988160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.924149:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2400 count 1 00002000:00010000:0.0:1788572240.924162:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x960:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.924166:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326434 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.924178:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x960:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.924181:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x960:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.924185:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.924193:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.924200:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326434 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.924206:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.924214:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1788572240.924268:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61ea3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+160:3653:x1875449638988160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 131us (1393us total) trans 8589935714 rc 0/0 00000100:00100000:0.0:1788572240.924273:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3302 00010000:00010000:0.0:1788572240.924326:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788572240.924333:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b8326411 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.924341:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.924345:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b8326411 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.924359:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b8326411 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.924407:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3287 00010000:00010000:2.0:1788572240.924560:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788572240.924567:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b8326418 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924574:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.924577:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b8326418 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924585:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b8326418 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924650:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b8326418 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924660:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b8326418 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x959:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924680:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572240.924684:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e27a5de9/0xdb7edb52b832641f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924690:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.924693:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e27a5de9/0xdb7edb52b832641f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924699:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e27a5de9/0xdb7edb52b832641f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924710:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e27a5de9/0xdb7edb52b832641f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924716:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e27a5de9/0xdb7edb52b832641f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924727:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572240.924730:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b8326426 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924736:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.924739:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b8326426 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924745:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b8326426 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924752:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b8326426 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924759:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b8326426 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x954:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924768:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572240.924771:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd16d475/0xdb7edb52b832642d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924776:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.924779:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd16d475/0xdb7edb52b832642d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924786:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd16d475/0xdb7edb52b832642d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924794:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd16d475/0xdb7edb52b832642d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924801:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd16d475/0xdb7edb52b832642d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x958:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924812:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572240.924815:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.924821:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.924824:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326434 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.924889:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572240.924893:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b83263d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.924901:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b83263d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.924912:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b83263d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.924919:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b83263d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788572240.925059:0:16234:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589935699 is committed 00010000:00010000:2.0:1788572240.925094:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326434 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.925107:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326434 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.925114:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326434 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.925126:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.925128:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.925130:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.925136:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572240.925174:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f0a80/2, rc 0, transno 8589935710 00000100:00100000:2.0:1788572240.925180:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638986880:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572240.925191:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f2300/2, rc 0, transno 8589935708 00000100:00100000:2.0:1788572240.925194:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638987008:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572240.925295:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572240.925311:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572240.925312:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572240.925314:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572240.925362:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618702300/2, rc 0, transno 4294968409 00000100:00100000:1.0:1788572240.925486:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638988672:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.925549:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.925581:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572240.925587:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638988800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.925717:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.925751:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638988672 00000100:00100000:1.0:1788572240.925757:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638988672 00000100:00100000:1.0:1788572240.925790:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638988800 00000100:00100000:1.0:1788572240.925793:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638988800 00000100:00100000:1.0:1788572240.925810:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3303 00000100:00100000:1.0:1788572240.925817:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3652:x1875449638988672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.925838:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2404 count 1 00002000:00010000:1.0:1788572240.925860:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x964:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.925867:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326442 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.925881:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x964:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.925886:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x964:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.925891:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326442 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.925901:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326442 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.925909:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326442 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.925915:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326442 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.925929:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572240.926074:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3652:x1875449638988672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 256us (524us total) trans 8589935715 rc 0/0 00000100:00100000:1.0:1788572240.926082:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3303 00000100:00100000:1.0:1788572240.926097:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3304 00000100:00100000:1.0:1788572240.926103:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3652:x1875449638988800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.926115:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2405 count 1 00002000:00010000:1.0:1788572240.926128:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x965:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.926133:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326449 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926144:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x965:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.926147:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x965:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.926151:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926160:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926169:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326449 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926176:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326449 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926189:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572240.926249:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3652:x1875449638988800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 146us (532us total) trans 8589935716 rc 0/0 00000100:00100000:1.0:1788572240.926255:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3304 00010000:00010000:1.0:1788572240.926272:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572240.926276:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326442 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926283:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.926286:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326442 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926301:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326442 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926313:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326442 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926320:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326442 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926339:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572240.926341:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326449 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926347:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.926350:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326449 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926356:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326449 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926364:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326449 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926382:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326449 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.926400:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.926402:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.926404:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572240.926427:0:3652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935699 gen 2 00000004:00080000:1.0:1788572240.926432:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634be8a80, transno 8589935562 00000004:00080000:1.0:1788572240.926440:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5180, transno 8589935563 00000004:00080000:1.0:1788572240.926443:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634beaa00, transno 8589935564 00000004:00080000:1.0:1788572240.926446:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4700, transno 8589935565 00000004:00080000:1.0:1788572240.926449:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5500, transno 8589935566 00000004:00080000:1.0:1788572240.926451:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634bea680, transno 8589935567 00000004:00080000:1.0:1788572240.926454:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4380, transno 8589935568 00000004:00080000:1.0:1788572240.926456:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac7800, transno 8589935569 00000004:00080000:1.0:1788572240.926459:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28bb80, transno 8589935570 00000004:00080000:1.0:1788572240.926461:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28a680, transno 8589935571 00000004:00080000:1.0:1788572240.926463:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b5880, transno 8589935572 00000004:00080000:1.0:1788572240.926466:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104000, transno 8589935573 00000004:00080000:1.0:1788572240.926469:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641105880, transno 8589935574 00000004:00080000:1.0:1788572240.926471:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641105500, transno 8589935575 00000004:00080000:1.0:1788572240.926474:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104a80, transno 8589935576 00000004:00080000:1.0:1788572240.926476:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641105180, transno 8589935577 00000004:00080000:1.0:1788572240.926478:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b2a300, transno 8589935578 00000004:00080000:1.0:1788572240.926480:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b2aa00, transno 8589935579 00000004:00080000:1.0:1788572240.926482:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b28e00, transno 8589935580 00000004:00080000:1.0:1788572240.926485:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670700, transno 8589935581 00000004:00080000:1.0:1788572240.926487:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637671500, transno 8589935582 00000004:00080000:1.0:1788572240.926489:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637671880, transno 8589935583 00000004:00080000:1.0:1788572240.926491:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670380, transno 8589935584 00000004:00080000:1.0:1788572240.926493:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637673800, transno 8589935585 00000004:00080000:1.0:1788572240.926495:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637673b80, transno 8589935586 00000004:00080000:1.0:1788572240.926498:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641106300, transno 8589935587 00000004:00080000:1.0:1788572240.926500:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104380, transno 8589935588 00000004:00080000:1.0:1788572240.926502:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641107800, transno 8589935589 00000004:00080000:1.0:1788572240.926505:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349e8e00, transno 8589935590 00000004:00080000:1.0:1788572240.926950:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641107100, transno 8589935591 00000004:00080000:1.0:1788572240.926953:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641106680, transno 8589935592 00000004:00080000:1.0:1788572240.926955:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641106a00, transno 8589935593 00000004:00080000:1.0:1788572240.926957:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641107480, transno 8589935594 00000004:00080000:1.0:1788572240.926960:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289180, transno 8589935595 00000004:00080000:1.0:1788572240.926963:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288700, transno 8589935596 00000004:00080000:1.0:1788572240.926965:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289880, transno 8589935597 00000004:00080000:1.0:1788572240.926968:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 8589935598 00000004:00080000:1.0:1788572240.926971:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10000, transno 8589935599 00000004:00080000:1.0:1788572240.926973:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12300, transno 8589935600 00000004:00080000:1.0:1788572240.926975:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 8589935601 00000004:00080000:1.0:1788572240.926978:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10700, transno 8589935602 00000004:00080000:1.0:1788572240.926980:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13b80, transno 8589935603 00000004:00080000:1.0:1788572240.926982:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13100, transno 8589935604 00000004:00080000:1.0:1788572240.926985:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349e9180, transno 8589935605 00000004:00080000:1.0:1788572240.926987:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349e8a80, transno 8589935606 00000004:00080000:1.0:1788572240.926989:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28b100, transno 8589935607 00000004:00080000:1.0:1788572240.926992:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349eb480, transno 8589935608 00000004:00080000:1.0:1788572240.926995:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0700, transno 8589935609 00000004:00080000:1.0:1788572240.926997:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637715500, transno 8589935610 00000004:00080000:1.0:1788572240.926999:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349e9500, transno 8589935611 00000004:00080000:1.0:1788572240.927030:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637715880, transno 8589935612 00000004:00080000:1.0:1788572240.927034:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637714000, transno 8589935613 00000004:00080000:1.0:1788572240.927037:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637717100, transno 8589935614 00000004:00080000:1.0:1788572240.927039:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637714a80, transno 8589935615 00000004:00080000:1.0:1788572240.927042:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e502d5f100, transno 8589935616 00000004:00080000:1.0:1788572240.927045:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28e300, transno 8589935617 00000004:00080000:1.0:1788572240.927047:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28f100, transno 8589935618 00000004:00080000:1.0:1788572240.927050:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28e680, transno 8589935619 00000004:00080000:1.0:1788572240.927052:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288000, transno 8589935620 00000004:00080000:1.0:1788572240.927064:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349eaa00, transno 8589935621 00000004:00080000:1.0:1788572240.927067:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329c000, transno 8589935622 00000004:00080000:1.0:1788572240.927070:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329f800, transno 8589935623 00000004:00080000:1.0:1788572240.927072:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349e8380, transno 8589935624 00000004:00080000:1.0:1788572240.927075:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28b800, transno 8589935625 00000004:00080000:1.0:1788572240.927077:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329dc00, transno 8589935626 00000004:00080000:1.0:1788572240.927079:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329d500, transno 8589935627 00000004:00080000:1.0:1788572240.927081:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d3b80, transno 8589935628 00000004:00080000:1.0:1788572240.927084:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d1500, transno 8589935629 00000004:00080000:1.0:1788572240.927086:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d2300, transno 8589935630 00000004:00080000:1.0:1788572240.927088:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d1880, transno 8589935631 00000004:00080000:1.0:1788572240.927091:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d2a00, transno 8589935632 00000004:00080000:1.0:1788572240.927093:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b0a80, transno 8589935633 00000004:00080000:1.0:1788572240.927095:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d0e00, transno 8589935634 00000004:00080000:1.0:1788572240.927097:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d1c00, transno 8589935635 00000004:00080000:1.0:1788572240.927099:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d0a80, transno 8589935636 00000004:00080000:1.0:1788572240.927102:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d0700, transno 8589935637 00000004:00080000:1.0:1788572240.927105:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173c000, transno 8589935638 00000004:00080000:1.0:1788572240.927107:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173d500, transno 8589935639 00000004:00080000:1.0:1788572240.927110:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63c506680, transno 8589935640 00000004:00080000:1.0:1788572240.927112:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173e300, transno 8589935641 00000004:00080000:1.0:1788572240.927114:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63c504e00, transno 8589935642 00000004:00080000:1.0:1788572240.927117:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173fb80, transno 8589935643 00000004:00080000:1.0:1788572240.927119:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173f800, transno 8589935644 00000004:00080000:1.0:1788572240.927122:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173f100, transno 8589935645 00000004:00080000:1.0:1788572240.927125:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0000, transno 8589935646 00000004:00080000:1.0:1788572240.927128:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0000, transno 8589935647 00000004:00080000:1.0:1788572240.927130:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173c700, transno 8589935648 00000004:00080000:1.0:1788572240.927133:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184eed80, transno 8589935649 00000004:00080000:1.0:1788572240.927135:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0a80, transno 8589935650 00000004:00080000:1.0:1788572240.927137:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28f480, transno 8589935651 00000004:00080000:1.0:1788572240.927140:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b2680, transno 8589935652 00000004:00080000:1.0:1788572240.927144:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b0e00, transno 8589935653 00000004:00080000:1.0:1788572240.927146:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493800, transno 8589935654 00000004:00080000:1.0:1788572240.927148:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493100, transno 8589935655 00000004:00080000:1.0:1788572240.927151:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44e00, transno 8589935656 00000004:00080000:1.0:1788572240.927153:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798e00, transno 8589935657 00000004:00080000:1.0:1788572240.927156:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d4b0380, transno 8589935658 00000004:00080000:1.0:1788572240.927158:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798380, transno 8589935659 00000004:00080000:1.0:1788572240.927160:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44a80, transno 8589935660 00000004:00080000:1.0:1788572240.927162:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779b100, transno 8589935661 00000004:00080000:1.0:1788572240.927164:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe45f80, transno 8589935662 00000004:00080000:1.0:1788572240.927167:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779a680, transno 8589935663 00000004:00080000:1.0:1788572240.927169:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779b800, transno 8589935664 00000004:00080000:1.0:1788572240.927172:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779b480, transno 8589935665 00000004:00080000:1.0:1788572240.927174:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798a80, transno 8589935666 00000004:00080000:1.0:1788572240.927176:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc8c700, transno 8589935667 00000004:00080000:1.0:1788572240.927179:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779bb80, transno 8589935668 00000004:00080000:1.0:1788572240.927181:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779a300, transno 8589935669 00000004:00080000:1.0:1788572240.927184:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb0700, transno 8589935670 00000004:00080000:1.0:1788572240.927186:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb2d80, transno 8589935671 00000004:00080000:1.0:1788572240.927188:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799880, transno 8589935672 00000004:00080000:1.0:1788572240.927190:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799180, transno 8589935673 00000004:00080000:1.0:1788572240.927192:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb3800, transno 8589935674 00000004:00080000:1.0:1788572240.927194:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb1c00, transno 8589935675 00000004:00080000:1.0:1788572240.927197:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe45c00, transno 8589935676 00000004:00080000:1.0:1788572240.927200:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb1180, transno 8589935677 00000004:00080000:1.0:1788572240.927954:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb0a80, transno 8589935678 00000004:00080000:1.0:1788572240.927961:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493b80, transno 8589935679 00000004:00080000:1.0:1788572240.927963:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb0000, transno 8589935680 00000004:00080000:1.0:1788572240.927966:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506551f80, transno 8589935681 00000004:00080000:1.0:1788572240.927968:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798700, transno 8589935682 00000004:00080000:1.0:1788572240.927971:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779aa00, transno 8589935683 00000004:00080000:1.0:1788572240.927973:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc8ca80, transno 8589935684 00000004:00080000:1.0:1788572240.927977:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641695c00, transno 8589935685 00000004:00080000:1.0:1788572240.927979:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc8ea00, transno 8589935686 00000004:00080000:1.0:1788572240.927982:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57e680, transno 8589935687 00000004:00080000:1.0:1788572240.927985:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641696a00, transno 8589935688 00000004:00080000:1.0:1788572240.927987:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57fb80, transno 8589935689 00000004:00080000:1.0:1788572240.927990:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641695180, transno 8589935690 00000004:00080000:1.0:1788572240.927992:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641696680, transno 8589935691 00000004:00080000:1.0:1788572240.927995:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5033f2680, transno 8589935692 00000004:00080000:1.0:1788572240.927997:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5033f1500, transno 8589935693 00000004:00080000:1.0:1788572240.928000:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641696300, transno 8589935694 00000004:00080000:1.0:1788572240.928027:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28c700, transno 8589935695 00000004:00080000:1.0:1788572240.928031:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d0380, transno 8589935696 00000004:00080000:1.0:1788572240.928034:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28f800, transno 8589935697 00000004:00080000:1.0:1788572240.928036:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d3800, transno 8589935698 00000004:00080000:1.0:1788572240.928039:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d3480, transno 8589935699 00000100:00100000:1.0:1788572240.928051:0:3652:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3ad80 x1875449638985984/t8589935700(8589935700) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572256 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788572240.928076:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f1c00/2, rc 0, transno 8589935716 00000100:00100000:1.0:1788572240.928082:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638988800:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572240.928114:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f2a00/2, rc 0, transno 8589935715 00000100:00100000:1.0:1788572240.928118:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638988672:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572240.929306:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 42 changes, 20 in progress, 6 in flight, 138 done 00000100:00100000:1.0:1788572240.929392:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638989184:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.929455:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.929493:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572240.929499:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638989312:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572240.929733:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638989056:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572240.929761:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.929790:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572240.929795:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638988928:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572240.929815:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572240.929861:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618700e00/2, rc 0, transno 4294968405 00010000:00010000:0.0:1788572240.929967:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b8326411 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.929981:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b8326411 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x955:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572240.930030:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638989184 00000100:00100000:0.0:1788572240.930036:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638989184 00000100:00100000:0.0:1788572240.930083:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638989056 00000100:00100000:0.0:1788572240.930087:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638989056 00000100:00100000:0.0:1788572240.930104:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638988928 00000100:00100000:0.0:1788572240.930106:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638988928 00000100:00100000:0.0:1788572240.930121:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3305 00000100:00100000:0.0:1788572240.930129:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3652:x1875449638989184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.930156:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2408 count 1 00002000:00010000:0.0:1788572240.930187:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x968:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.930194:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326450 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.930206:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x968:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.930210:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x968:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.930216:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.930233:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.930242:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326450 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.930249:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.930264:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572240.930397:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3652:x1875449638989184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 268us (942us total) trans 8589935717 rc 0/0 00000100:00100000:0.0:1788572240.930405:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3305 00000100:00100000:0.0:1788572240.930423:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3306 00000100:00100000:0.0:1788572240.930429:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3651:x1875449638989056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.930440:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2407 count 1 00002000:00010000:0.0:1788572240.930453:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x967:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.930457:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba0911ec/0xdb7edb52b8326457 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.930465:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x967:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.930468:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x967:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.930472:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba0911ec/0xdb7edb52b8326457 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.930486:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba0911ec/0xdb7edb52b8326457 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.930493:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba0911ec/0xdb7edb52b8326457 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.930500:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba0911ec/0xdb7edb52b8326457 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572240.930834:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572240.930873:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b2d80/2, rc 0, transno 8589935717 00000100:00100000:1.0:1788572240.930882:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638989184:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.930902:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638989312 00000100:00100000:1.0:1788572240.930906:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638989312 00000100:00100000:1.0:1788572240.930934:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3307 00000100:00100000:1.0:1788572240.930941:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3651:x1875449638988928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.930954:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2406 count 1 00002000:00010000:1.0:1788572240.930972:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x966:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.930977:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71f92d/0xdb7edb52b832645e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.930986:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x966:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.930989:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x966:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.930994:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f71f92d/0xdb7edb52b832645e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931019:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f71f92d/0xdb7edb52b832645e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931033:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f71f92d/0xdb7edb52b832645e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931040:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f71f92d/0xdb7edb52b832645e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931057:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572240.931159:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449638988928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 218us (1343us total) trans 8589935718 rc 0/0 00000100:00100000:1.0:1788572240.931166:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3307 00000100:00100000:1.0:1788572240.931180:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3308 00000100:00100000:1.0:1788572240.931187:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3652:x1875449638989312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.931199:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2409 count 1 00002000:00010000:1.0:1788572240.931213:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x969:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.931218:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b8326465 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931227:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x969:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.931230:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x969:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.931234:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b8326465 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931244:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b8326465 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931257:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b8326465 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931265:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b8326465 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931279:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572240.931348:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3652:x1875449638989312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 160us (514us total) trans 8589935719 rc 0/0 00000100:00100000:1.0:1788572240.931354:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3308 00010000:00010000:1.0:1788572240.931384:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572240.931390:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931398:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.931402:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326450 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931412:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326450 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931428:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326450 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931436:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326450 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931456:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572240.931459:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f71f92d/0xdb7edb52b832645e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931466:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0ca00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.931469:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71f92d/0xdb7edb52b832645e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931477:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f71f92d/0xdb7edb52b832645e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931487:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f71f92d/0xdb7edb52b832645e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.931494:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f71f92d/0xdb7edb52b832645e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.932220:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572240.932227:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b8326465 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.932235:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.932238:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b8326465 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.932253:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b8326465 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.932266:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b8326465 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.932274:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b8326465 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.932290:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.932292:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.932294:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572240.932329:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b1500/2, rc 0, transno 8589935719 00000100:00100000:1.0:1788572240.932336:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638989312:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572240.932424:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572240.932437:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638989568:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.932477:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572240.932642:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788572240.932825:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f3800/2, rc 0, transno 8589935718 00000100:00100000:1.0:1788572240.932835:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638988928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.932845:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572240.932851:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638989440:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.933439:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449638989056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3007us (3673us total) trans 8589935720 rc 0/0 00000100:00100000:0.0:1788572240.933450:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3306 00000100:00100000:0.0:1788572240.933476:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638989568 00000100:00100000:0.0:1788572240.933481:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638989568 00000100:00100000:0.0:1788572240.933538:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3309 00000100:00100000:0.0:1788572240.933546:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449638989568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.933576:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2411 count 1 00002000:00010000:0.0:1788572240.933607:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x96b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.933625:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a28a5b/0xdb7edb52b832646c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933638:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96b:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.933642:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.933648:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a28a5b/0xdb7edb52b832646c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933661:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017a28a5b/0xdb7edb52b832646c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933670:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a28a5b/0xdb7edb52b832646c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933677:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017a28a5b/0xdb7edb52b832646c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933691:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572240.933777:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3651:x1875449638989568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 232us (1300us total) trans 8589935721 rc 0/0 00000100:00100000:0.0:1788572240.933784:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3309 00010000:00010000:0.0:1788572240.933820:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572240.933825:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba0911ec/0xdb7edb52b8326457 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933833:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.933836:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba0911ec/0xdb7edb52b8326457 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933844:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba0911ec/0xdb7edb52b8326457 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933858:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba0911ec/0xdb7edb52b8326457 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933865:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba0911ec/0xdb7edb52b8326457 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933883:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572240.933886:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017a28a5b/0xdb7edb52b832646c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933892:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.933894:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a28a5b/0xdb7edb52b832646c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933901:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a28a5b/0xdb7edb52b832646c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933909:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017a28a5b/0xdb7edb52b832646c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933915:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017a28a5b/0xdb7edb52b832646c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.933924:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572240.933925:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572240.933927:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572240.934038:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572240.934041:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572240.934043:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572240.934080:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788572240.934093:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x962:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.934099:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fe8f890/0xdb7edb52b832643b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.934107:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x962:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.934110:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x962:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.934114:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fe8f890/0xdb7edb52b832643b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.934122:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fe8f890/0xdb7edb52b832643b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.934130:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fe8f890/0xdb7edb52b832643b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.934137:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fe8f890/0xdb7edb52b832643b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.934149:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572240.934155:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572240.934158:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fe8f890/0xdb7edb52b832643b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.934165:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572240.934168:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fe8f890/0xdb7edb52b832643b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.934181:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fe8f890/0xdb7edb52b832643b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.934191:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fe8f890/0xdb7edb52b832643b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.934198:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fe8f890/0xdb7edb52b832643b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.934215:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572240.934217:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572240.934218:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572240.934296:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3650:x1875449638988416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15812us (16438us total) trans 8589935722 rc 0/0 00000100:00100000:0.0:1788572240.934304:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3293 00010000:00010000:0.0:1788572240.934391:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572240.934408:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638989696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.934439:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572240.934799:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638987136:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572240.934826:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618701180/2, rc 0, transno 4294968410 00000100:00100000:3.0:1788572240.935882:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638987520:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572240.935916:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618703800/2, rc 0, transno 4294968406 00000100:00100000:3.0:1788572240.935920:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638988032:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572240.935933:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f1500/2, rc 0, transno 8589935712 00000100:00100000:3.0:1788572240.935944:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638988544:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572240.935957:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618700a80/2, rc 0, transno 4294968403 00000100:00100000:3.0:1788572240.935960:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638987392:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572240.935968:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618703100/2, rc 0, transno 4294968404 00000100:00100000:3.0:1788572240.935972:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638987904:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572240.935980:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f2d80/2, rc 0, transno 8589935722 00000100:00100000:3.0:1788572240.935983:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638988416:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.936244:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572240.936280:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b3100/2, rc 0, transno 8589935721 00000100:00100000:1.0:1788572240.936284:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638989568:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572240.936297:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b1f80/2, rc 0, transno 8589935720 00000100:00100000:1.0:1788572240.936300:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638989056:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.936321:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638989696 00000100:00100000:1.0:1788572240.936327:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638989696 00000100:00100000:1.0:1788572240.936377:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638989440 00000100:00100000:1.0:1788572240.936381:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638989440 00000100:00100000:1.0:1788572240.936401:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3310 00000100:00100000:1.0:1788572240.936409:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61ea3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3652:x1875449638989696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.936437:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2412 count 1 00002000:00010000:1.0:1788572240.936468:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x96c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.936475:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc709c1b/0xdb7edb52b8326473 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.936491:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96c:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.936495:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.936501:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc709c1b/0xdb7edb52b8326473 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.936690:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc709c1b/0xdb7edb52b8326473 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.936699:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc709c1b/0xdb7edb52b8326473 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.936706:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc709c1b/0xdb7edb52b8326473 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.936729:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572240.936875:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61ea3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3652:x1875449638989696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 466us (2435us total) trans 8589935723 rc 0/0 00000100:00100000:1.0:1788572240.936883:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3310 00000100:00100000:1.0:1788572240.936901:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3311 00000100:00100000:1.0:1788572240.936910:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3651:x1875449638989440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.936922:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2410 count 1 00002000:00010000:1.0:1788572240.936939:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x96a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.936945:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a6d80f/0xdb7edb52b832647a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.936953:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96a:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.936956:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.936961:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040a6d80f/0xdb7edb52b832647a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.936969:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040a6d80f/0xdb7edb52b832647a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.937168:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638987648:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572240.937191:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f0380/2, rc 0, transno 8589935714 00000100:00100000:2.0:1788572240.937195:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638988160:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572240.937206:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618702a00/2, rc 0, transno 4294968407 00000100:00100000:2.0:1788572240.937211:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638987264:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572240.937219:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618700000/2, rc 0, transno 4294968408 00000100:00100000:2.0:1788572240.937221:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638987776:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572240.937230:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f3480/2, rc 0, transno 8589935713 00000100:00100000:2.0:1788572240.937232:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638988288:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572240.937703:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a6d80f/0xdb7edb52b832647a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.937711:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040a6d80f/0xdb7edb52b832647a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.937735:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572240.937787:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638989824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572240.937825:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.937831:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3651:x1875449638989440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 924us (1588us total) trans 8589935724 rc 0/0 00000100:00100000:1.0:1788572240.937839:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3311 00000100:00100000:2.0:1788572240.937846:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638990336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.937855:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638989824 00000100:00100000:1.0:1788572240.937859:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638989824 00000100:00100000:2.0:1788572240.937865:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.937880:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638990336 00000100:00100000:2.0:1788572240.937881:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572240.937883:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638990336 00000100:00100000:2.0:1788572240.937886:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638990208:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.937899:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3312 00000100:00100000:2.0:1788572240.937903:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.937905:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3653:x1875449638989824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.937922:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2413 count 1 00000100:00100000:2.0:1788572240.937935:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638989952:0@lo:6:osp-syn-0-0.0 00002000:00010000:1.0:1788572240.937944:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x96d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.937949:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035633440/0xdb7edb52b8326481 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.937956:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572240.937958:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96d:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.937962:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.937966:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035633440/0xdb7edb52b8326481 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.937969:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638990464:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572240.937977:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035633440/0xdb7edb52b8326481 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.937986:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035633440/0xdb7edb52b8326481 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.938033:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572240.938052:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788572240.938203:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572240.938210:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc709c1b/0xdb7edb52b8326473 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.938219:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0cc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572240.938223:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc709c1b/0xdb7edb52b8326473 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.938234:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc709c1b/0xdb7edb52b8326473 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.938251:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc709c1b/0xdb7edb52b8326473 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.938263:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc709c1b/0xdb7edb52b8326473 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.938289:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572240.938293:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040a6d80f/0xdb7edb52b832647a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.938297:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638990080:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572240.938300:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572240.938303:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a6d80f/0xdb7edb52b832647a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.938311:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a6d80f/0xdb7edb52b832647a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.938321:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572240.938321:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040a6d80f/0xdb7edb52b832647a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.938328:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040a6d80f/0xdb7edb52b832647a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.938342:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572240.938344:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572240.938345:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572240.939137:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638990208 00000100:00100000:3.0:1788572240.939144:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638990208 00000100:00100000:3.0:1788572240.939176:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638989952 00000100:00100000:3.0:1788572240.939179:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638989952 00000100:00100000:3.0:1788572240.939191:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638990464 00000100:00100000:3.0:1788572240.939193:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638990464 00000100:00100000:3.0:1788572240.939204:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638990080 00000100:00100000:3.0:1788572240.939207:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638990080 00000100:00100000:3.0:1788572240.939222:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3313 00000100:00100000:3.0:1788572240.939229:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3653:x1875449638990336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572240.939247:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2417 count 1 00002000:00010000:3.0:1788572240.939269:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x971:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572240.939275:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8326488 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.939285:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x971:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:3.0:1788572240.939288:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x971:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572240.939293:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8326488 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.939303:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8326488 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.939311:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8326488 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.939317:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8326488 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.939332:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572240.939462:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3653:x1875449638990336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 232us (1594us total) trans 8589935725 rc 0/0 00000100:00100000:3.0:1788572240.939469:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3313 00000100:00100000:3.0:1788572240.939484:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3314 00000100:00100000:3.0:1788572240.939490:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3653:x1875449638990208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572240.939501:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2416 count 1 00010000:00010000:1.0:1788572240.939719:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035633440/0xdb7edb52b8326481 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.939738:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572240.939812:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3653:x1875449638989824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1906us (1986us total) trans 8589935726 rc 0/0 00000100:00100000:1.0:1788572240.939818:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3312 00000100:00100000:1.0:1788572240.939832:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3315 00000100:00100000:1.0:1788572240.939838:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3650:x1875449638989952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.939850:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2414 count 1 00002000:00010000:1.0:1788572240.939864:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x96e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.939870:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f7224d8/0xdb7edb52b832648f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.939878:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96e:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.939881:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.939885:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f7224d8/0xdb7edb52b832648f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.939894:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f7224d8/0xdb7edb52b832648f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.939902:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f7224d8/0xdb7edb52b832648f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.939914:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f7224d8/0xdb7edb52b832648f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.939934:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788572240.940178:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572240.940185:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8326488 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940193:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.940196:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8326488 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940205:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8326488 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940218:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8326488 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940225:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8326488 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940241:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572240.940245:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035633440/0xdb7edb52b8326481 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940256:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.940259:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035633440/0xdb7edb52b8326481 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940266:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035633440/0xdb7edb52b8326481 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940275:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035633440/0xdb7edb52b8326481 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940281:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035633440/0xdb7edb52b8326481 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940307:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572240.940311:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f7224d8/0xdb7edb52b832648f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940316:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.940319:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f7224d8/0xdb7edb52b832648f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940326:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f7224d8/0xdb7edb52b832648f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940336:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f7224d8/0xdb7edb52b832648f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940344:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f7224d8/0xdb7edb52b832648f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.940355:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.940357:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.940358:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572240.940723:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3316 00000100:00100000:0.0:1788572240.940734:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+36:3650:x1875449638990464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.940752:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2418 count 1 00002000:00010000:0.0:1788572240.940771:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x972:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.940777:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326496 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.940792:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x972:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.940795:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x972:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.940800:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326496 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.940810:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326496 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.940818:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326496 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.940825:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326496 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.940838:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572240.940937:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+37:3650:x1875449638990464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 206us (2934us total) trans 8589935728 rc 0/0 00000100:00100000:0.0:1788572240.940945:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3316 00000100:00100000:0.0:1788572240.940963:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3317 00000100:00100000:0.0:1788572240.940971:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+36:3650:x1875449638990080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.940983:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2415 count 1 00002000:00010000:0.0:1788572240.941028:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x96f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.941034:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b832649d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.941048:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96f:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.941051:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x96f:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1788572240.941157:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3650:x1875449638989952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1318us (3198us total) trans 8589935727 rc 0/0 00000100:00100000:1.0:1788572240.941164:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3315 00010000:00010000:1.0:1788572240.941198:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572240.941203:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326496 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.941209:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.941213:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326496 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.941220:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326496 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.941230:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326496 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.941237:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326496 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.941252:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.941254:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.941256:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572240.941275:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638990592:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.941323:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.941354:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638991104:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.941388:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572240.941427:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b0000/2, rc 0, transno 8589935724 00000100:00100000:1.0:1788572240.941438:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638989440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.941450:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572240.941455:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638990976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.941474:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.941490:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638991488:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572240.941831:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638990592 00000100:00100000:2.0:1788572240.941839:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638990592 00002000:00010000:3.0:1788572240.941847:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x970:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572240.941854:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b83264a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.941863:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x970:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:3.0:1788572240.941867:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x970:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1788572240.941869:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638991104 00000100:00100000:2.0:1788572240.941872:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638991104 00010000:00010000:3.0:1788572240.941872:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b83264a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.941883:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638990976 00010000:00010000:3.0:1788572240.941883:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b83264a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.941886:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638990976 00010000:00010000:3.0:1788572240.941892:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b83264a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.941899:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3318 00010000:00010000:3.0:1788572240.941901:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b83264a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.941904:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+153:3651:x1875449638990592:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572240.941915:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788572240.941923:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2396 count 1 00002000:00010000:2.0:1788572240.941942:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x95c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.941947:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba588a7/0xdb7edb52b83264ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.941955:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95c:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:2.0:1788572240.941958:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.941962:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eba588a7/0xdb7edb52b83264ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.941972:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eba588a7/0xdb7edb52b83264ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572240.942039:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3653:x1875449638990208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2548us (4133us total) trans 8589935729 rc 0/0 00000100:00100000:3.0:1788572240.942050:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3314 00010000:00010000:0.0:1788572240.942131:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b832649d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.942144:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b832649d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.942152:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b832649d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.942159:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b832649d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.942168:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572240.942405:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.942451:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638991488 00000100:00100000:3.0:1788572240.942455:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638991488 00010000:00010000:2.0:1788572240.942469:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eba588a7/0xdb7edb52b83264ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.942476:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eba588a7/0xdb7edb52b83264ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572240.942476:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3319 00000100:00100000:3.0:1788572240.942482:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+154:3651:x1875449638991104:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572240.942485:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1788572240.942494:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2400 count 1 00002000:00010000:3.0:1788572240.942583:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x960:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572240.942593:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b83264b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.942600:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x960:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:3.0:1788572240.942603:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x960:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572240.942608:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b83264b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.942627:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b83264b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.942680:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b83264b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.942688:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b83264b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.942696:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788572240.943043:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3320 00000100:00100000:1.0:1788572240.943053:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+156:3651:x1875449638990976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572240.943144:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2399 count 1 00002000:00010000:1.0:1788572240.943162:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x95f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.943168:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e428836/0xdb7edb52b83264b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943177:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95f:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.943181:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.943184:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e428836/0xdb7edb52b83264b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943195:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e428836/0xdb7edb52b83264b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943203:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e428836/0xdb7edb52b83264b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943210:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e428836/0xdb7edb52b83264b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943219:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1788572240.943305:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+157:3651:x1875449638990976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 254us (1829us total) trans 4294968413 rc 0/0 00000100:00100000:1.0:1788572240.943313:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3320 00000100:00100000:1.0:1788572240.943330:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3321 00000100:00100000:1.0:1788572240.943337:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+156:3651:x1875449638991488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572240.943349:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2403 count 1 00002000:00010000:1.0:1788572240.943362:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x963:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.943380:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2815bd/0xdb7edb52b83264c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943388:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x963:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.943391:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x963:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.943395:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e2815bd/0xdb7edb52b83264c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943404:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e2815bd/0xdb7edb52b83264c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943417:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e2815bd/0xdb7edb52b83264c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943424:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e2815bd/0xdb7edb52b83264c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943432:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1788572240.943498:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+157:3651:x1875449638991488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 162us (1990us total) trans 4294968414 rc 0/0 00000100:00100000:1.0:1788572240.943505:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3321 00010000:00010000:1.0:1788572240.943903:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788572240.943909:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b83264a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943917:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.943921:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b83264a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943931:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b83264a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943948:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b83264a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943956:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b83264a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.943981:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788572240.944145:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b832649d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944151:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.944154:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b832649d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944162:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b832649d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944172:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b832649d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944180:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b832649d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944199:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788572240.944203:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eba588a7/0xdb7edb52b83264ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944208:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.944212:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba588a7/0xdb7edb52b83264ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944223:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eba588a7/0xdb7edb52b83264ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944233:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eba588a7/0xdb7edb52b83264ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944240:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eba588a7/0xdb7edb52b83264ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x95c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944253:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572240.944256:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b83264b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944262:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.944265:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b83264b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944271:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b83264b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944280:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b83264b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944287:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b83264b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x960:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944302:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572240.944305:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e428836/0xdb7edb52b83264b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944311:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.944313:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e428836/0xdb7edb52b83264b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944320:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e428836/0xdb7edb52b83264b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944327:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e428836/0xdb7edb52b83264b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944332:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e428836/0xdb7edb52b83264b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x95f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944343:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572240.944346:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e2815bd/0xdb7edb52b83264c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944351:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.944354:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2815bd/0xdb7edb52b83264c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944365:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e2815bd/0xdb7edb52b83264c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944385:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e2815bd/0xdb7edb52b83264c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944392:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e2815bd/0xdb7edb52b83264c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x963:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944405:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.944407:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.944409:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572240.944428:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638991616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.944475:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572240.944526:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3d880/2, rc 0, transno 4294968413 00000100:00100000:1.0:1788572240.944542:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638990976:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572240.944554:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3c700/2, rc 0, transno 4294968414 00000100:00100000:1.0:1788572240.944558:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638991488:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.944682:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638991616 00000100:00100000:1.0:1788572240.944688:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638991616 00000100:00100000:1.0:1788572240.944721:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3322 00000100:00100000:1.0:1788572240.944728:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3651:x1875449638991616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.944746:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2419 count 1 00002000:00010000:1.0:1788572240.944767:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x973:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.944773:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072f530d5/0xdb7edb52b83264c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944782:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x973:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.944786:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x973:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.944792:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072f530d5/0xdb7edb52b83264c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944802:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072f530d5/0xdb7edb52b83264c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944810:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072f530d5/0xdb7edb52b83264c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944818:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072f530d5/0xdb7edb52b83264c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.944832:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572240.944947:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3651:x1875449638991616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 219us (471us total) trans 8589935731 rc 0/0 00000100:00100000:1.0:1788572240.944953:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3322 00000004:00080000:1.0:1788572240.944985:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b0a80/2, rc 0, transno 8589935731 00000100:00100000:1.0:1788572240.945030:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638991616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.945157:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572240.945166:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638992000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.945191:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.945218:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638992000 00000100:00100000:1.0:1788572240.945222:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638992000 00000100:00100000:1.0:1788572240.945245:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3323 00000100:00100000:1.0:1788572240.945252:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3651:x1875449638992000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.945264:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2420 count 1 00002000:00010000:1.0:1788572240.945281:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x974:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.945286:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cf3094/0xdb7edb52b83264ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945295:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x974:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.945298:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x974:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.945302:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cf3094/0xdb7edb52b83264ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945312:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7cf3094/0xdb7edb52b83264ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945321:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cf3094/0xdb7edb52b83264ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945328:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cf3094/0xdb7edb52b83264ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945337:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572240.945424:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3651:x1875449638992000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 172us (231us total) trans 8589935732 rc 0/0 00000100:00100000:1.0:1788572240.945430:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3323 00010000:00010000:1.0:1788572240.945449:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572240.945454:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072f530d5/0xdb7edb52b83264c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945462:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.945466:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072f530d5/0xdb7edb52b83264c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945474:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072f530d5/0xdb7edb52b83264c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945485:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072f530d5/0xdb7edb52b83264c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945491:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072f530d5/0xdb7edb52b83264c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945507:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572240.945510:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7cf3094/0xdb7edb52b83264ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945516:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.945519:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cf3094/0xdb7edb52b83264ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945527:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cf3094/0xdb7edb52b83264ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945541:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7cf3094/0xdb7edb52b83264ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945548:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7cf3094/0xdb7edb52b83264ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945559:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.945561:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.945562:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572240.945580:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634be8a80/2, rc 0, transno 8589935732 00000100:00100000:1.0:1788572240.945589:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638992000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.945741:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638992128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.945768:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.945795:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638992128 00000100:00100000:1.0:1788572240.945799:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638992128 00000100:00100000:1.0:1788572240.945822:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3324 00000100:00100000:1.0:1788572240.945828:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3651:x1875449638992128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572240.945840:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2421 count 1 00002000:00010000:1.0:1788572240.945857:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x975:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.945862:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009900332a/0xdb7edb52b83264d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945871:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x975:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.945874:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x975:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.945878:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009900332a/0xdb7edb52b83264d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945888:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009900332a/0xdb7edb52b83264d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945897:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009900332a/0xdb7edb52b83264d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945905:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009900332a/0xdb7edb52b83264d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.945918:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572240.945988:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3651:x1875449638992128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 160us (219us total) trans 8589935733 rc 0/0 00000100:00100000:1.0:1788572240.945995:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3324 00010000:00010000:1.0:1788572240.946035:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572240.946039:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009900332a/0xdb7edb52b83264d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.946046:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.946048:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009900332a/0xdb7edb52b83264d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.946147:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009900332a/0xdb7edb52b83264d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.946161:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009900332a/0xdb7edb52b83264d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.946169:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009900332a/0xdb7edb52b83264d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.946185:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.946187:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.946189:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572240.946208:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634bea680/2, rc 0, transno 8589935733 00000100:00100000:1.0:1788572240.946217:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638992128:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572240.946291:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572240.946312:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638990848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.946339:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.946357:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638991360:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.946388:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.946405:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638991872:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.946425:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572240.946448:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6411eaa00/2, rc 0, transno 8589935729 00000100:00100000:1.0:1788572240.946454:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638990208:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572240.946465:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6411eb100/2, rc 0, transno 8589935726 00000100:00100000:1.0:1788572240.946468:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638989824:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572240.946477:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6411ebb80/2, rc 0, transno 8589935725 00000100:00100000:1.0:1788572240.946479:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638990336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.946490:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788572240.946497:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638990720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.946520:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.946536:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638991232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.946555:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.946569:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638991744:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.946589:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.946603:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638992256:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.946768:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.946798:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638990848 00000100:00100000:1.0:1788572240.946803:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638990848 00000100:00100000:1.0:1788572240.946825:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638991360 00000100:00100000:1.0:1788572240.946828:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638991360 00000100:00100000:1.0:1788572240.946842:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638991872 00000100:00100000:1.0:1788572240.946844:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638991872 00000100:00100000:1.0:1788572240.946857:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638990720 00000100:00100000:1.0:1788572240.946859:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638990720 00000100:00100000:1.0:1788572240.946870:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638991232 00000100:00100000:1.0:1788572240.946872:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638991232 00000100:00100000:1.0:1788572240.946882:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638991744 00000100:00100000:1.0:1788572240.946885:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638991744 00000100:00100000:1.0:1788572240.946892:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638992256 00000100:00100000:1.0:1788572240.946894:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638992256 00000100:00100000:1.0:1788572240.946905:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3325 00000100:00100000:1.0:1788572240.946911:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+162:3653:x1875449638990848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572240.946928:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2398 count 1 00002000:00010000:1.0:1788572240.946949:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x95e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.946955:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e66fae1/0xdb7edb52b83264dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.946965:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95e:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.946968:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.946973:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e66fae1/0xdb7edb52b83264dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947100:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e66fae1/0xdb7edb52b83264dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947111:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e66fae1/0xdb7edb52b83264dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947119:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e66fae1/0xdb7edb52b83264dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947134:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572240.947229:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+163:3653:x1875449638990848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 318us (889us total) trans 4294968415 rc 0/0 00000100:00100000:1.0:1788572240.947237:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3325 00000100:00100000:1.0:1788572240.947251:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3326 00000100:00100000:1.0:1788572240.947257:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+162:3653:x1875449638991360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572240.947269:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2402 count 1 00002000:00010000:1.0:1788572240.947284:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x962:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.947289:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2c660c/0xdb7edb52b83264e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947297:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x962:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.947300:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x962:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.947304:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2c660c/0xdb7edb52b83264e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947313:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f2c660c/0xdb7edb52b83264e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947321:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2c660c/0xdb7edb52b83264e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947328:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f2c660c/0xdb7edb52b83264e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947342:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572240.947362:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+162:3651:x1875449638990592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5070us (5652us total) trans 4294968411 rc 0/0 00000100:00100000:1.0:1788572240.947412:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+163:3653:x1875449638991360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 155us (1022us total) trans 4294968416 rc 0/0 00000100:00100000:1.0:1788572240.947418:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3326 00000100:00100000:1.0:1788572240.947431:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3327 00000100:00100000:1.0:1788572240.947437:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+162:3653:x1875449638991872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572240.947449:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2405 count 1 00002000:00010000:1.0:1788572240.947462:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x965:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.947467:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d765fe8a/0xdb7edb52b83264ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947475:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x965:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.947478:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x965:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.947482:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d765fe8a/0xdb7edb52b83264ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.947493:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3318 00010000:00010000:1.0:1788572240.947496:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d765fe8a/0xdb7edb52b83264ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947504:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d765fe8a/0xdb7edb52b83264ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947511:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d765fe8a/0xdb7edb52b83264ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.947519:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572240.947576:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+163:3653:x1875449638991872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 138us (1150us total) trans 4294968417 rc 0/0 00000100:00100000:1.0:1788572240.947582:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3327 00000100:00100000:1.0:1788572240.947594:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3328 00000100:00100000:1.0:1788572240.947600:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+162:3653:x1875449638990720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572240.947611:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2397 count 1 00000100:00100000:2.0:1788572240.947688:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3329 00000100:00100000:2.0:1788572240.947696:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+161:3653:x1875449638991232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572240.947709:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2401 count 1 00002000:00010000:2.0:1788572240.947723:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x961:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.947728:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024990a51/0xdb7edb52b83264f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572240.947729:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+161:3651:x1875449638991104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5245us (6339us total) trans 4294968412 rc 0/0 00000100:00100000:3.0:1788572240.947736:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3319 00010000:00010000:2.0:1788572240.947737:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x961:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:2.0:1788572240.947739:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x961:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.947743:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024990a51/0xdb7edb52b83264f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572240.947750:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3330 00010000:00010000:2.0:1788572240.947752:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024990a51/0xdb7edb52b83264f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572240.947758:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+160:3653:x1875449638991744:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572240.947766:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024990a51/0xdb7edb52b83264f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788572240.947769:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2404 count 1 00010000:00010000:2.0:1788572240.947773:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024990a51/0xdb7edb52b83264f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.947781:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788572240.947782:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x964:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572240.947786:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b83264f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.947794:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x964:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:3.0:1788572240.947797:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x964:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572240.947801:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b83264f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.947810:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b83264f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.947818:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b83264f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.947825:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b83264f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.947833:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1788572240.947840:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+161:3653:x1875449638991232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 146us (1284us total) trans 4294968418 rc 0/0 00000100:00100000:2.0:1788572240.947846:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3329 00000100:00100000:2.0:1788572240.947857:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3331 00000100:00100000:2.0:1788572240.947864:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+40:3653:x1875449638992256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572240.947875:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2422 count 1 00002000:00010000:2.0:1788572240.947890:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x976:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1788572240.947892:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+161:3653:x1875449638991744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 136us (1302us total) trans 4294968419 rc 0/0 00010000:00010000:2.0:1788572240.947895:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d6f6d3/0xdb7edb52b83264ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572240.947898:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3330 00010000:00010000:2.0:1788572240.947903:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x976:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:2.0:1788572240.947906:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x976:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.947910:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d6f6d3/0xdb7edb52b83264ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.947918:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d6f6d3/0xdb7edb52b83264ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.947930:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d6f6d3/0xdb7edb52b83264ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.947936:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d6f6d3/0xdb7edb52b83264ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.947943:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1788572240.949095:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+41:3650:x1875449638990080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8117us (10765us total) trans 8589935730 rc 0/0 00000100:00100000:0.0:1788572240.949105:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3317 00000001:00080000:0.0:1788572240.949283:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968402 is committed 00000100:00100000:2.0:1788572240.949680:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+40:3653:x1875449638992256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1815us (2911us total) trans 8589935734 rc 0/0 00000100:00100000:2.0:1788572240.949688:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3331 00010000:00010000:2.0:1788572240.949707:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788572240.949713:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e66fae1/0xdb7edb52b83264dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949723:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.949728:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e66fae1/0xdb7edb52b83264dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949739:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e66fae1/0xdb7edb52b83264dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949757:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e66fae1/0xdb7edb52b83264dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949765:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e66fae1/0xdb7edb52b83264dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x95e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949789:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788572240.949793:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f2c660c/0xdb7edb52b83264e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949799:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.949802:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2c660c/0xdb7edb52b83264e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949809:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2c660c/0xdb7edb52b83264e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949819:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f2c660c/0xdb7edb52b83264e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949826:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f2c660c/0xdb7edb52b83264e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x962:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949838:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572240.949841:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d765fe8a/0xdb7edb52b83264ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949847:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.949850:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d765fe8a/0xdb7edb52b83264ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949863:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d765fe8a/0xdb7edb52b83264ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949872:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d765fe8a/0xdb7edb52b83264ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949879:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d765fe8a/0xdb7edb52b83264ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x965:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949890:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572240.949894:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024990a51/0xdb7edb52b83264f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949900:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.949903:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024990a51/0xdb7edb52b83264f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949911:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024990a51/0xdb7edb52b83264f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949920:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024990a51/0xdb7edb52b83264f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949927:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024990a51/0xdb7edb52b83264f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x961:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949944:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572240.949948:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b83264f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949954:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.949957:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b83264f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949965:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b83264f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.949975:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b83264f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.950511:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572240.950519:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d6f6d3/0xdb7edb52b83264ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.950529:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572240.950532:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d6f6d3/0xdb7edb52b83264ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.950541:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d6f6d3/0xdb7edb52b83264ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.950554:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d6f6d3/0xdb7edb52b83264ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.950561:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d6f6d3/0xdb7edb52b83264ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.950577:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572240.950580:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572240.950581:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572240.950648:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3d500/2, rc 0, transno 8589935723 00000100:00100000:3.0:1788572240.950655:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638989696:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572240.950672:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572240.951210:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638992512:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.951256:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572240.951290:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6411ea680/2, rc 0, transno 8589935730 00000100:00100000:0.0:1788572240.951299:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638990080:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572240.951309:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6411e9880/2, rc 0, transno 8589935727 00000100:00100000:0.0:1788572240.951312:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638989952:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572240.951321:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6411e8700/2, rc 0, transno 8589935728 00000100:00100000:0.0:1788572240.951324:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638990464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.951333:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572240.951338:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638992640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.951359:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572240.951398:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638992512 00000100:00100000:0.0:1788572240.951403:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638992512 00000100:00100000:0.0:1788572240.951440:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638992640 00000100:00100000:0.0:1788572240.951443:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638992640 00000100:00100000:0.0:1788572240.951464:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3332 00000100:00100000:0.0:1788572240.951472:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61ea3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+41:3650:x1875449638992512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.951497:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2424 count 1 00002000:00010000:0.0:1788572240.951526:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x978:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.951533:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b21495e/0xdb7edb52b8326506 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.951547:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x978:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.951552:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x978:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.951558:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b21495e/0xdb7edb52b8326506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.951571:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b21495e/0xdb7edb52b8326506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.951580:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b21495e/0xdb7edb52b8326506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.951593:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b21495e/0xdb7edb52b8326506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.951607:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572240.951802:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b83264f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x964:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.951822:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572240.951825:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b21495e/0xdb7edb52b8326506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.951832:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.951835:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b21495e/0xdb7edb52b8326506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.951846:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b21495e/0xdb7edb52b8326506 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.951860:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b21495e/0xdb7edb52b8326506 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.951867:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b21495e/0xdb7edb52b8326506 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.951879:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.951881:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.951882:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572240.951923:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3333 00000100:00100000:2.0:1788572240.951933:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61ea3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3650:x1875449638992640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572240.951946:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2425 count 1 00002000:00010000:2.0:1788572240.951962:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x979:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.951968:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025310e7f/0xdb7edb52b832650d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.951975:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x979:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:2.0:1788572240.951992:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x979:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.951997:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025310e7f/0xdb7edb52b832650d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.952031:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025310e7f/0xdb7edb52b832650d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.952039:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025310e7f/0xdb7edb52b832650d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.952046:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025310e7f/0xdb7edb52b832650d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.952059:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572240.952204:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61ea3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3650:x1875449638992640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 274us (844us total) trans 8589935735 rc 0/0 00000100:00100000:2.0:1788572240.952211:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3333 00000004:00080000:2.0:1788572240.952260:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3d180/2, rc 0, transno 4294968411 00000100:00100000:2.0:1788572240.952281:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638990592:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572240.952306:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3e680/2, rc 0, transno 4294968412 00000100:00100000:2.0:1788572240.952310:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638991104:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572240.952325:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572240.952330:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025310e7f/0xdb7edb52b832650d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.952337:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.952340:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025310e7f/0xdb7edb52b832650d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.952348:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025310e7f/0xdb7edb52b832650d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.952366:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025310e7f/0xdb7edb52b832650d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.952385:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025310e7f/0xdb7edb52b832650d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.952400:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.952402:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.954925:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572240.954985:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638992384:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572240.955471:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572240.955659:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3ea00/2, rc 0, transno 4294968418 00000100:00100000:2.0:1788572240.955667:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638991232:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572240.955680:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b3800/2, rc 0, transno 4294968419 00000100:00100000:2.0:1788572240.955684:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638991744:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572240.955694:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac4700/2, rc 0, transno 8589935734 00000100:00100000:2.0:1788572240.955699:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638992256:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572240.955709:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3f100/2, rc 0, transno 4294968415 00000100:00100000:2.0:1788572240.955713:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638990848:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572240.955722:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3fb80/2, rc 0, transno 4294968416 00000100:00100000:2.0:1788572240.955725:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638991360:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572240.955733:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b1c00/2, rc 0, transno 4294968417 00000100:00100000:2.0:1788572240.955736:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638991872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572240.955753:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572240.955759:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638992768:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572240.955783:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572240.955818:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638992384 00000100:00100000:2.0:1788572240.955824:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638992384 00000100:00100000:2.0:1788572240.955869:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638992768 00000100:00100000:2.0:1788572240.955872:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638992768 00000100:00100000:2.0:1788572240.955889:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3334 00000100:00100000:2.0:1788572240.955897:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3653:x1875449638992384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572240.955924:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2423 count 1 00002000:00010000:2.0:1788572240.955955:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x977:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.955962:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484419c8/0xdb7edb52b8326514 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.955989:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x977:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:2.0:1788572240.955994:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x977:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.956001:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000484419c8/0xdb7edb52b8326514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572240.956019:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61ea3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+44:3650:x1875449638992512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4548us (4762us total) trans 8589935736 rc 0/0 00000100:00100000:0.0:1788572240.956027:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3332 00010000:00010000:2.0:1788572240.956029:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000484419c8/0xdb7edb52b8326514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.956039:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000484419c8/0xdb7edb52b8326514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572240.956044:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3335 00010000:00010000:2.0:1788572240.956047:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000484419c8/0xdb7edb52b8326514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572240.956051:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+43:3653:x1875449638992768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.956062:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2426 count 1 00002000:00010000:0.0:1788572240.956078:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x97a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.956081:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572240.956083:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f350189a/0xdb7edb52b832651b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.956090:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572240.956091:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97a:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.956094:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.956095:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000484419c8/0xdb7edb52b8326514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956098:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f350189a/0xdb7edb52b832651b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.956103:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.956108:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000484419c8/0xdb7edb52b8326514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956109:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f350189a/0xdb7edb52b832651b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956117:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f350189a/0xdb7edb52b832651b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.956118:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000484419c8/0xdb7edb52b8326514 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956130:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f350189a/0xdb7edb52b832651b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.956134:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000484419c8/0xdb7edb52b8326514 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.956141:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000484419c8/0xdb7edb52b8326514 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956145:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572240.956160:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572240.956163:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f350189a/0xdb7edb52b832651b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.956170:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.956173:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f350189a/0xdb7edb52b832651b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.956185:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f350189a/0xdb7edb52b832651b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.956195:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f350189a/0xdb7edb52b832651b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.956202:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f350189a/0xdb7edb52b832651b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572240.956203:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+44:3653:x1875449638992768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 153us (419us total) trans 8589935737 rc 0/0 00000100:00100000:0.0:1788572240.956211:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3335 00010000:00010000:2.0:1788572240.956216:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.956218:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.956220:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572240.956282:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3653:x1875449638992384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 384us (917us total) trans 8589935738 rc 0/0 00000100:00100000:0.0:1788572240.956300:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638993152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.956327:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572240.956345:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572240.956351:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638993024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.956383:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572240.956407:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638993152 00000100:00100000:0.0:1788572240.956411:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638993152 00000100:00100000:0.0:1788572240.956432:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638993024 00000100:00100000:0.0:1788572240.956435:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638993024 00000100:00100000:0.0:1788572240.956451:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3336 00000100:00100000:0.0:1788572240.956456:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3651:x1875449638993152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.956468:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2429 count 1 00002000:00010000:0.0:1788572240.956483:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x97d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.956489:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e1ebc8a/0xdb7edb52b8326522 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956497:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97d:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.956501:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.956506:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e1ebc8a/0xdb7edb52b8326522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956515:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e1ebc8a/0xdb7edb52b8326522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956524:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e1ebc8a/0xdb7edb52b8326522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956531:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e1ebc8a/0xdb7edb52b8326522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956550:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572240.956691:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3651:x1875449638993152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 233us (363us total) trans 8589935739 rc 0/0 00000100:00100000:0.0:1788572240.956698:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3336 00000100:00100000:0.0:1788572240.956712:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3337 00000100:00100000:0.0:1788572240.956719:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3651:x1875449638993024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.956731:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2428 count 1 00002000:00010000:0.0:1788572240.956745:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x97c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.956750:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267a3d03/0xdb7edb52b8326529 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956758:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97c:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.956761:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.956765:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267a3d03/0xdb7edb52b8326529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956778:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267a3d03/0xdb7edb52b8326529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956786:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267a3d03/0xdb7edb52b8326529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956794:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000267a3d03/0xdb7edb52b8326529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.956803:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572240.956863:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3651:x1875449638993024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 145us (478us total) trans 8589935740 rc 0/0 00000100:00100000:0.0:1788572240.956869:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3337 00000004:00080000:0.0:1788572240.956909:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3dc00/2, rc 0, transno 8589935740 00000100:00100000:0.0:1788572240.956918:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638993024:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572240.956927:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3df80/2, rc 0, transno 8589935739 00000100:00100000:0.0:1788572240.956931:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638993152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.956970:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572240.956977:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638993536:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.957001:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572240.957044:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638993536 00000100:00100000:0.0:1788572240.957048:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638993536 00000100:00100000:0.0:1788572240.957071:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3338 00000100:00100000:0.0:1788572240.957077:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3651:x1875449638993536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.957090:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2432 count 1 00002000:00010000:0.0:1788572240.957104:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x980:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.957110:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f1ec331/0xdb7edb52b8326530 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.957117:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x980:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.957120:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x980:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.957124:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f1ec331/0xdb7edb52b8326530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.957132:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f1ec331/0xdb7edb52b8326530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.957139:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f1ec331/0xdb7edb52b8326530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.957146:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f1ec331/0xdb7edb52b8326530 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.957155:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788572240.957217:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3651:x1875449638993536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 139us (215us total) trans 8589935741 rc 0/0 00000100:00100000:0.0:1788572240.957223:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3338 00000004:00080000:0.0:1788572240.957250:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f1880/2, rc 0, transno 8589935741 00000100:00100000:0.0:1788572240.957258:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638993536:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.957309:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638993664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572240.957332:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572240.957358:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638993664 00000100:00100000:0.0:1788572240.957361:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638993664 00000100:00100000:0.0:1788572240.957397:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3339 00000100:00100000:0.0:1788572240.957403:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+48:3651:x1875449638993664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.957415:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2433 count 1 00002000:00010000:0.0:1788572240.957429:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x981:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.957434:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326537 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.957442:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x981:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:0.0:1788572240.957445:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x981:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.957449:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.957458:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.957466:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326537 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.957474:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.957482:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788572240.957545:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+49:3651:x1875449638993664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 141us (211us total) trans 8589935742 rc 0/0 00000100:00100000:0.0:1788572240.957555:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3339 00000004:00080000:0.0:1788572240.957581:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f0000/2, rc 0, transno 8589935742 00000100:00100000:0.0:1788572240.957589:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638993664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572240.957883:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638994176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.957913:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.957935:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638994688:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.957954:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.957970:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572240.957974:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638994048:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.958074:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.958093:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638994560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572240.958098:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3334 00000100:00100000:1.0:1788572240.958114:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572240.958117:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572240.958123:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e1ebc8a/0xdb7edb52b8326522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958132:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973e00 already unused, calling callback (ffffffffc0be44f0) 00000100:00100000:1.0:1788572240.958136:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638994176 00010000:00010000:2.0:1788572240.958136:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e1ebc8a/0xdb7edb52b8326522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572240.958139:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638994176 00010000:00010000:2.0:1788572240.958144:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e1ebc8a/0xdb7edb52b8326522 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572240.958161:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638994688 00000100:00100000:1.0:1788572240.958163:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638994688 00010000:00010000:2.0:1788572240.958164:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e1ebc8a/0xdb7edb52b8326522 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958172:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e1ebc8a/0xdb7edb52b8326522 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572240.958176:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638994048 00000100:00100000:1.0:1788572240.958178:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638994048 00000100:00100000:1.0:1788572240.958189:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638994560 00000100:00100000:1.0:1788572240.958191:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638994560 00010000:00010000:2.0:1788572240.958192:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572240.958196:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000267a3d03/0xdb7edb52b8326529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958202:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973a00 already unused, calling callback (ffffffffc0be44f0) 00000100:00100000:1.0:1788572240.958204:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3340 00010000:00010000:2.0:1788572240.958206:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000267a3d03/0xdb7edb52b8326529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572240.958210:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+26:3651:x1875449638994176:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572240.958214:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000267a3d03/0xdb7edb52b8326529 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958223:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000267a3d03/0xdb7edb52b8326529 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572240.958224:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2408 count 1 00010000:00010000:2.0:1788572240.958230:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267a3d03/0xdb7edb52b8326529 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958240:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:1.0:1788572240.958241:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x968:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.958244:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f1ec331/0xdb7edb52b8326530 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958247:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b4b3e7/0xdb7edb52b832653e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958252:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.958255:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f1ec331/0xdb7edb52b8326530 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958256:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x968:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.958260:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x968:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.958262:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f1ec331/0xdb7edb52b8326530 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958265:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b4b3e7/0xdb7edb52b832653e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958272:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f1ec331/0xdb7edb52b8326530 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958275:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b4b3e7/0xdb7edb52b832653e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958279:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f1ec331/0xdb7edb52b8326530 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958282:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b4b3e7/0xdb7edb52b832653e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958290:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005b4b3e7/0xdb7edb52b832653e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958300:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572240.958302:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572240.958305:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958311:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.958314:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958331:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326537 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958341:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326537 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958348:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec872689/0xdb7edb52b8326537 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958361:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572240.958364:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005b4b3e7/0xdb7edb52b832653e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958382:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.958385:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b4b3e7/0xdb7edb52b832653e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.958393:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b4b3e7/0xdb7edb52b832653e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572240.958400:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449638994176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 189us (486us total) trans 4294968420 rc 0/0 00010000:00010000:2.0:1788572240.958404:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005b4b3e7/0xdb7edb52b832653e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572240.958406:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3340 00000100:00100000:1.0:1788572240.958418:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3341 00000100:00100000:1.0:1788572240.958424:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+26:3651:x1875449638994688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572240.958435:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2412 count 1 00002000:00010000:1.0:1788572240.958448:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x96c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.958453:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049faab5f/0xdb7edb52b8326545 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958461:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96c:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.958465:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.958468:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049faab5f/0xdb7edb52b8326545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958476:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049faab5f/0xdb7edb52b8326545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958484:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049faab5f/0xdb7edb52b8326545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958491:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049faab5f/0xdb7edb52b8326545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.958504:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572240.958569:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449638994688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 144us (613us total) trans 4294968421 rc 0/0 00000100:00100000:1.0:1788572240.958576:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3341 00000100:00100000:1.0:1788572240.958588:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3342 00000100:00100000:1.0:1788572240.958593:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+26:3651:x1875449638994048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572240.958604:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2407 count 1 00000100:00100000:3.0:1788572240.958771:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3343 00000100:00100000:3.0:1788572240.958781:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3651:x1875449638994560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572240.958794:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2411 count 1 00002000:00010000:3.0:1788572240.958809:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x96b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572240.958815:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b832654c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.958824:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96b:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:3.0:1788572240.958827:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572240.958831:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b832654c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.958841:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b832654c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.958848:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b832654c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.958855:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b832654c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.958864:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572240.958931:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449638994560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 152us (815us total) trans 4294968422 rc 0/0 00000100:00100000:3.0:1788572240.958937:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3343 00010000:00010000:3.0:1788572240.958959:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572240.958964:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049faab5f/0xdb7edb52b8326545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.958970:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572240.958973:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049faab5f/0xdb7edb52b8326545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.958981:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049faab5f/0xdb7edb52b8326545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.959079:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049faab5f/0xdb7edb52b8326545 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.959086:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049faab5f/0xdb7edb52b8326545 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.959107:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572240.959110:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b832654c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.959117:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572240.959120:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b832654c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.959129:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b832654c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.959138:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b832654c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.959145:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b832654c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.959161:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b4b3e7/0xdb7edb52b832653e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x968:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.959167:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572240.959169:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572240.959171:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.959174:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.959175:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.959177:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572240.959183:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638993280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572240.959210:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572240.959212:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572240.959228:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638993280 00000100:00100000:3.0:1788572240.959230:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638993792:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572240.959233:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638993280 00000100:00100000:3.0:1788572240.959248:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1788572240.959299:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x967:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.959305:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000938e20a9/0xdb7edb52b8326553 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.959312:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x967:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.959315:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x967:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.959319:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000938e20a9/0xdb7edb52b8326553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.959327:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000938e20a9/0xdb7edb52b8326553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.959335:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000938e20a9/0xdb7edb52b8326553 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.959341:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000938e20a9/0xdb7edb52b8326553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.959358:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572240.959433:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449638994048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 838us (1358us total) trans 4294968423 rc 0/0 00000100:00100000:1.0:1788572240.959439:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3342 00000100:00100000:3.0:1788572240.962892:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638994304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572240.962953:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572240.975901:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638993792 00000100:00100000:2.0:1788572240.975916:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638993792 00000100:00100000:2.0:1788572240.975999:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3344 00000100:00100000:2.0:1788572240.976025:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+49:3652:x1875449638993280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572240.976059:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2430 count 1 00002000:00010000:2.0:1788572240.976094:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x97e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.976101:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b832655a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976118:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97e:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:2.0:1788572240.976123:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.976129:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b832655a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976144:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b832655a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976154:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b832655a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976161:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b832655a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976177:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572240.976192:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572240.976198:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000938e20a9/0xdb7edb52b8326553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976210:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.976215:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000938e20a9/0xdb7edb52b8326553 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976224:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000938e20a9/0xdb7edb52b8326553 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976241:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000938e20a9/0xdb7edb52b8326553 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976248:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000938e20a9/0xdb7edb52b8326553 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x967:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976271:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572240.976275:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b832655a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572240.976279:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3345 00010000:00010000:2.0:1788572240.976282:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703800 already unused, calling callback (ffffffffc0be44f0) 00000100:00100000:1.0:1788572240.976289:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+49:3652:x1875449638993792:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572240.976297:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b832655a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572240.976302:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2434 count 1 00010000:00010000:2.0:1788572240.976305:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b832655a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976315:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b832655a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572240.976318:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x982:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.976323:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2c918d5/0xdb7edb52b8326561 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976324:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3409742/0xdb7edb52b832655a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.976332:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x982:0x0].0x0 since=4157s v=(0 0) 00010000:00010000:1.0:1788572240.976335:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x982:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.976338:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.976339:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c918d5/0xdb7edb52b8326561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.976340:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.976342:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.976348:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2c918d5/0xdb7edb52b8326561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.976355:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2c918d5/0xdb7edb52b8326561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.976361:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c918d5/0xdb7edb52b8326561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.976391:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572240.976537:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+50:3652:x1875449638993792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 250us (17286us total) trans 8589935743 rc 0/0 00000100:00100000:1.0:1788572240.976545:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3345 00010000:00010000:1.0:1788572240.976567:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572240.976572:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2c918d5/0xdb7edb52b8326561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.976580:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca4e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.976583:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2c918d5/0xdb7edb52b8326561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.976591:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2c918d5/0xdb7edb52b8326561 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.976602:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2c918d5/0xdb7edb52b8326561 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.976609:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2c918d5/0xdb7edb52b8326561 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.978745:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.978749:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.978751:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572240.979366:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b3480/2, rc 0, transno 8589935743 00000100:00100000:3.0:1788572240.979398:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638993792:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572240.979406:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788572240.979417:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638992896:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572240.979470:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.979491:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638993408:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572240.979822:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.979847:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638993920:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572240.979871:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.979889:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638994432:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572240.979908:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572240.979946:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638994304 00000100:00100000:3.0:1788572240.979954:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638994304 00000100:00100000:2.0:1788572240.980638:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+50:3652:x1875449638993280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4611us (21422us total) trans 8589935744 rc 0/0 00000100:00100000:2.0:1788572240.980648:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3344 00000100:00100000:3.0:1788572240.981157:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638992896 00000100:00100000:3.0:1788572240.981164:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638992896 00000100:00100000:1.0:1788572240.985939:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968402 gen 2 00000004:00080000:1.0:1788572240.985951:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637595180, transno 4294968265 00000004:00080000:1.0:1788572240.985963:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5033f0000, transno 4294968266 00000004:00080000:1.0:1788572240.985966:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff6a00, transno 4294968267 00000004:00080000:1.0:1788572240.985969:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5033f2d80, transno 4294968268 00000004:00080000:1.0:1788572240.985971:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5033f3800, transno 4294968269 00000004:00080000:1.0:1788572240.985973:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff5180, transno 4294968270 00000100:00100000:0.0:1788572240.986136:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638993408 00000100:00100000:0.0:1788572240.986145:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638993408 00000004:00080000:1.0:1788572240.986321:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5033f1f80, transno 4294968271 00000004:00080000:1.0:1788572240.986327:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff4700, transno 4294968272 00000004:00080000:1.0:1788572240.986330:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4e00, transno 4294968273 00000004:00080000:1.0:1788572240.986332:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5180, transno 4294968274 00000004:00080000:1.0:1788572240.986335:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6300, transno 4294968275 00000004:00080000:1.0:1788572240.986337:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a7800, transno 4294968276 00000004:00080000:1.0:1788572240.986339:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637673480, transno 4294968277 00000004:00080000:1.0:1788572240.986341:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e761880, transno 4294968278 00000004:00080000:1.0:1788572240.986344:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e760700, transno 4294968279 00000004:00080000:1.0:1788572240.986346:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d2f0e00, transno 4294968280 00000004:00080000:1.0:1788572240.986348:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d2f1c00, transno 4294968281 00000004:00080000:1.0:1788572240.986351:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e762a00, transno 4294968282 00000004:00080000:1.0:1788572240.986353:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670a80, transno 4294968283 00000004:00080000:1.0:1788572240.986355:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670e00, transno 4294968284 00000004:00080000:1.0:1788572240.986358:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634be9c00, transno 4294968285 00000004:00080000:1.0:1788572240.986360:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670000, transno 4294968286 00000004:00080000:1.0:1788572240.986362:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634bea300, transno 4294968287 00000004:00080000:1.0:1788572240.986364:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a7b80, transno 4294968288 00000004:00080000:1.0:1788572240.986376:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4a80, transno 4294968289 00000004:00080000:1.0:1788572240.986379:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11880, transno 4294968290 00000004:00080000:1.0:1788572240.986382:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5880, transno 4294968291 00000004:00080000:1.0:1788572240.986384:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12d80, transno 4294968292 00000004:00080000:1.0:1788572240.986387:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4000, transno 4294968293 00000004:00080000:1.0:1788572240.986389:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5c00, transno 4294968294 00000004:00080000:1.0:1788572240.986392:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637671c00, transno 4294968295 00000004:00080000:1.0:1788572240.986394:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e763100, transno 4294968296 00000004:00080000:1.0:1788572240.986397:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28ce00, transno 4294968297 00000004:00080000:1.0:1788572240.986400:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28ed80, transno 4294968298 00000004:00080000:1.0:1788572240.986403:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28fb80, transno 4294968299 00000004:00080000:1.0:1788572240.986405:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28df80, transno 4294968300 00000004:00080000:1.0:1788572240.986408:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28d880, transno 4294968301 00000004:00080000:1.0:1788572240.986411:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28d180, transno 4294968302 00000004:00080000:1.0:1788572240.986413:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28ca80, transno 4294968303 00000004:00080000:1.0:1788572240.986416:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634ad6d80, transno 4294968304 00000004:00080000:1.0:1788572240.986419:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d4000, transno 4294968305 00000004:00080000:1.0:1788572240.986422:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d7100, transno 4294968306 00000004:00080000:1.0:1788572240.986425:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329c380, transno 4294968307 00000004:00080000:1.0:1788572240.986427:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6a00, transno 4294968308 00000004:00080000:1.0:1788572240.986430:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4380, transno 4294968309 00000004:00080000:1.0:1788572240.986432:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329df80, transno 4294968310 00000004:00080000:1.0:1788572240.986434:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12a00, transno 4294968311 00000004:00080000:1.0:1788572240.986436:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d5f80, transno 4294968312 00000004:00080000:1.0:1788572240.986439:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13800, transno 4294968313 00000004:00080000:1.0:1788572240.986441:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10e00, transno 4294968314 00000004:00080000:1.0:1788572240.986443:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4700, transno 4294968315 00000004:00080000:1.0:1788572240.986446:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11c00, transno 4294968316 00000004:00080000:1.0:1788572240.986449:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10380, transno 4294968317 00000004:00080000:1.0:1788572240.986452:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0a80, transno 4294968318 00000004:00080000:1.0:1788572240.986455:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13480, transno 4294968319 00000004:00080000:1.0:1788572240.986457:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c1c00, transno 4294968320 00000004:00080000:1.0:1788572240.986460:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e502d5ed80, transno 4294968321 00000004:00080000:1.0:1788572240.986463:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3b80, transno 4294968322 00000004:00080000:1.0:1788572240.986465:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 4294968323 00000004:00080000:1.0:1788572240.986468:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184ed880, transno 4294968324 00000004:00080000:1.0:1788572240.986471:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db1f80, transno 4294968325 00000004:00080000:1.0:1788572240.986473:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3480, transno 4294968326 00000004:00080000:1.0:1788572240.986476:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28d500, transno 4294968327 00000004:00080000:1.0:1788572240.986478:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349ebb80, transno 4294968328 00000004:00080000:1.0:1788572240.986480:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28dc00, transno 4294968329 00000004:00080000:1.0:1788572240.986482:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349eb100, transno 4294968330 00000004:00080000:1.0:1788572240.986484:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349e9c00, transno 4294968331 00000004:00080000:1.0:1788572240.986487:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289c00, transno 4294968332 00000004:00080000:1.0:1788572240.986489:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289f80, transno 4294968333 00000004:00080000:1.0:1788572240.986491:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289500, transno 4294968334 00000004:00080000:1.0:1788572240.986494:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d7480, transno 4294968335 00000004:00080000:1.0:1788572240.986497:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288e00, transno 4294968336 00000004:00080000:1.0:1788572240.986500:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d5880, transno 4294968337 00000004:00080000:1.0:1788572240.986502:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d5c00, transno 4294968338 00000004:00080000:1.0:1788572240.986505:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28aa00, transno 4294968339 00000004:00080000:1.0:1788572240.986508:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6131cd180, transno 4294968340 00000004:00080000:1.0:1788572240.986510:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6131cdc00, transno 4294968341 00000004:00080000:1.0:1788572240.986512:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47100, transno 4294968342 00000004:00080000:1.0:1788572240.986515:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633dfe680, transno 4294968343 00000004:00080000:1.0:1788572240.986517:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633dfc380, transno 4294968344 00000004:00080000:1.0:1788572240.986520:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633dfdf80, transno 4294968345 00000004:00080000:1.0:1788572240.986522:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47b80, transno 4294968346 00000004:00080000:1.0:1788572240.986525:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618432680, transno 4294968347 00000004:00080000:1.0:1788572240.986527:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490e00, transno 4294968348 00000004:00080000:1.0:1788572240.986530:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46a00, transno 4294968349 00000004:00080000:1.0:1788572240.986532:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778d500, transno 4294968350 00000004:00080000:1.0:1788572240.986535:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778dc00, transno 4294968351 00000004:00080000:1.0:1788572240.986537:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552d180, transno 4294968352 00000004:00080000:1.0:1788572240.986540:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552df80, transno 4294968353 00000004:00080000:1.0:1788572240.986542:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618491880, transno 4294968354 00000004:00080000:1.0:1788572240.986545:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552ea00, transno 4294968355 00000004:00080000:1.0:1788572240.986548:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552d880, transno 4294968356 00000004:00080000:1.0:1788572240.986551:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552dc00, transno 4294968357 00000004:00080000:1.0:1788572240.986553:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552fb80, transno 4294968358 00000004:00080000:1.0:1788572240.986556:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552f480, transno 4294968359 00000004:00080000:1.0:1788572240.986558:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552c380, transno 4294968360 00000004:00080000:1.0:1788572240.986561:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552f800, transno 4294968361 00000004:00080000:1.0:1788572240.986563:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552ce00, transno 4294968362 00000004:00080000:1.0:1788572240.986565:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552d500, transno 4294968363 00000004:00080000:1.0:1788572240.986567:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506551180, transno 4294968364 00000004:00080000:1.0:1788572240.986570:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506552300, transno 4294968365 00000004:00080000:1.0:1788572240.986572:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506550700, transno 4294968366 00000004:00080000:1.0:1788572240.986574:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506550380, transno 4294968367 00000004:00080000:1.0:1788572240.986577:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506553480, transno 4294968368 00000004:00080000:1.0:1788572240.986579:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506552a00, transno 4294968369 00000004:00080000:1.0:1788572240.986582:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506553100, transno 4294968370 00000004:00080000:1.0:1788572240.986584:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506550e00, transno 4294968371 00000004:00080000:1.0:1788572240.986586:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44000, transno 4294968372 00000004:00080000:1.0:1788572240.986588:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47800, transno 4294968373 00000004:00080000:1.0:1788572240.986590:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46680, transno 4294968374 00000004:00080000:1.0:1788572240.986593:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490380, transno 4294968375 00000004:00080000:1.0:1788572240.986595:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506553800, transno 4294968376 00000004:00080000:1.0:1788572240.986598:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506553b80, transno 4294968377 00000004:00080000:1.0:1788572240.986600:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506551c00, transno 4294968378 00000004:00080000:1.0:1788572240.986603:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552ed80, transno 4294968379 00000004:00080000:1.0:1788572240.986606:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552c000, transno 4294968380 00000004:00080000:1.0:1788572240.986608:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552c700, transno 4294968381 00000004:00080000:1.0:1788572240.989446:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57ca80, transno 4294968382 00000004:00080000:1.0:1788572240.989462:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d952680, transno 4294968383 00000004:00080000:1.0:1788572240.989465:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552ca80, transno 4294968384 00000004:00080000:1.0:1788572240.989469:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506550a80, transno 4294968385 00000004:00080000:1.0:1788572240.989472:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506552d80, transno 4294968386 00000004:00080000:1.0:1788572240.989474:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552e300, transno 4294968387 00000004:00080000:1.0:1788572240.989477:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57d500, transno 4294968388 00000004:00080000:1.0:1788572240.989479:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57f480, transno 4294968389 00000004:00080000:1.0:1788572240.989482:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d951180, transno 4294968390 00000004:00080000:1.0:1788572240.989484:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d952300, transno 4294968391 00000004:00080000:1.0:1788572240.989487:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d951500, transno 4294968392 00000004:00080000:1.0:1788572240.989489:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d951880, transno 4294968393 00000004:00080000:1.0:1788572240.989491:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d950700, transno 4294968394 00000004:00080000:1.0:1788572240.989494:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d952a00, transno 4294968395 00000004:00080000:1.0:1788572240.989497:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5038c0700, transno 4294968396 00000004:00080000:1.0:1788572240.989499:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d500, transno 4294968397 00000004:00080000:1.0:1788572240.989502:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f480, transno 4294968398 00000004:00080000:1.0:1788572240.989504:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d950000, transno 4294968399 00000004:00080000:1.0:1788572240.989507:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5038c2a00, transno 4294968400 00000004:00080000:1.0:1788572240.989509:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d880, transno 4294968401 00000004:00080000:1.0:1788572240.989512:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5038c3800, transno 4294968402 00000100:00100000:1.0:1788572240.989525:0:3651:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e618700a80 x1875449638987392/t4294968403(4294968403) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572256 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788572240.989542:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637673800/2, rc 0, transno 4294968423 00000100:00100000:1.0:1788572240.989549:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638994048:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572240.989598:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641105500/2, rc 0, transno 4294968422 00000100:00100000:1.0:1788572240.989602:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638994560:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572240.989626:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637673b80/2, rc 0, transno 4294968420 00000100:00100000:1.0:1788572240.989629:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638994176:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572240.989640:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641104a80/2, rc 0, transno 4294968421 00000100:00100000:1.0:1788572240.989643:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638994688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572240.989832:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638993920 00000100:00100000:2.0:1788572240.989840:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638993920 00000100:00100000:2.0:1788572240.989892:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638994432 00000100:00100000:2.0:1788572240.989896:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638994432 00000100:00100000:2.0:1788572240.989918:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3346 00000100:00100000:2.0:1788572240.989927:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3652:x1875449638994304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572240.989955:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2409 count 1 00002000:00010000:2.0:1788572240.989987:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x969:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.989996:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e6ff6c/0xdb7edb52b8326568 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990025:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x969:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:2.0:1788572240.990030:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x969:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.990037:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e6ff6c/0xdb7edb52b8326568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990054:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e6ff6c/0xdb7edb52b8326568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990065:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e6ff6c/0xdb7edb52b8326568 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990072:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e6ff6c/0xdb7edb52b8326568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990089:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572240.990263:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3652:x1875449638994304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 336us (27309us total) trans 4294968424 rc 0/0 00000100:00100000:2.0:1788572240.990271:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3346 00000100:00100000:2.0:1788572240.990289:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3347 00000100:00100000:2.0:1788572240.990296:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3652:x1875449638993920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572240.990309:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2406 count 1 00002000:00010000:2.0:1788572240.990322:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x966:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.990327:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a12394a4/0xdb7edb52b832656f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990334:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x966:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:2.0:1788572240.990338:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x966:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.990342:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a12394a4/0xdb7edb52b832656f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990350:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a12394a4/0xdb7edb52b832656f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990362:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a12394a4/0xdb7edb52b832656f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990385:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a12394a4/0xdb7edb52b832656f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990400:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572240.990465:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3652:x1875449638993920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 170us (10594us total) trans 4294968425 rc 0/0 00000100:00100000:2.0:1788572240.990472:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3347 00000100:00100000:2.0:1788572240.990483:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3348 00000100:00100000:2.0:1788572240.990488:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3652:x1875449638994432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572240.990498:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2410 count 1 00000004:00080000:1.0:1788572240.990605:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 37 changes, 25 in progress, 4 in flight, 138 done 00002000:00010000:2.0:1788572240.990684:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x96a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.990690:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b8326576 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990698:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96a:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:2.0:1788572240.990701:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.990705:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b8326576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990715:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b8326576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990729:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b8326576 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.990737:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572240.990737:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b8326576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.990743:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0e6ff6c/0xdb7edb52b8326568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990745:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572240.990751:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572240.990755:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e6ff6c/0xdb7edb52b8326568 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.990765:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e6ff6c/0xdb7edb52b8326568 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.990782:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0e6ff6c/0xdb7edb52b8326568 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.990790:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e6ff6c/0xdb7edb52b8326568 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x969:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572240.990801:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3652:x1875449638994432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 313us (10892us total) trans 4294968426 rc 0/0 00000100:00100000:2.0:1788572240.990807:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3348 00010000:00010000:1.0:1788572240.990811:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572240.990814:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a12394a4/0xdb7edb52b832656f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.990821:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.990822:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572240.990824:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a12394a4/0xdb7edb52b832656f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990827:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b8326576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990835:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572240.990838:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b8326576 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.990839:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a12394a4/0xdb7edb52b832656f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990846:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b8326576 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.990849:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a12394a4/0xdb7edb52b832656f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990856:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b8326576 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.990857:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a12394a4/0xdb7edb52b832656f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x966:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.990864:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b8326576 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.990868:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.990870:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572240.990871:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.990875:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.990877:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572240.990878:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572240.990884:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638995200:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572240.990887:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572240.990924:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572240.990951:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572240.990956:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638995072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.990974:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572240.991052:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638995200 00000100:00100000:2.0:1788572240.991057:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638995200 00000100:00100000:2.0:1788572240.991082:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3349 00000100:00100000:2.0:1788572240.991088:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3651:x1875449638995200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572240.991102:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2416 count 1 00002000:00010000:2.0:1788572240.991118:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x970:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.991123:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2bab33/0xdb7edb52b832657d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.991131:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x970:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:2.0:1788572240.991134:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x970:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572240.991138:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b2bab33/0xdb7edb52b832657d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.991146:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b2bab33/0xdb7edb52b832657d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.991155:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2bab33/0xdb7edb52b832657d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.991162:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b2bab33/0xdb7edb52b832657d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.991179:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572240.991244:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3651:x1875449638995200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 155us (320us total) trans 4294968427 rc 0/0 00000100:00100000:2.0:1788572240.991249:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3349 00000100:00100000:2.0:1788572240.991260:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3350 00000100:00100000:2.0:1788572240.991266:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3652:x1875449638992896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572240.991278:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2427 count 1 00002000:00010000:2.0:1788572240.991294:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x97b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572240.991299:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cda81eb/0xdb7edb52b8326584 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.991307:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97b:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:2.0:1788572240.991310:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1788572240.991313:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638994816:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572240.991314:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cda81eb/0xdb7edb52b8326584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.991325:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cda81eb/0xdb7edb52b8326584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.991333:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cda81eb/0xdb7edb52b8326584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.991340:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cda81eb/0xdb7edb52b8326584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572240.991452:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641107480/2, rc 0, transno 4294968427 00000100:00100000:1.0:1788572240.991461:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638995200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572240.991477:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638995072 00000100:00100000:1.0:1788572240.991480:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638995072 00000100:00100000:1.0:1788572240.991504:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3351 00000100:00100000:1.0:1788572240.991510:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+31:3651:x1875449638995072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572240.991522:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2415 count 1 00002000:00010000:1.0:1788572240.991537:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x96f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572240.991543:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036bf26f9/0xdb7edb52b832658b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.991551:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96f:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572240.991554:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572240.991558:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036bf26f9/0xdb7edb52b832658b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.991567:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036bf26f9/0xdb7edb52b832658b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.991575:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036bf26f9/0xdb7edb52b832658b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572240.991582:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036bf26f9/0xdb7edb52b832658b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572240.991707:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3352 00000100:00100000:0.0:1788572240.991717:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+51:3652:x1875449638993408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572240.991730:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2431 count 1 00002000:00010000:0.0:1788572240.991748:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x97f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572240.991752:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd16d475/0xdb7edb52b8326592 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.991760:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97f:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572240.991763:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x97f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572240.991767:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd16d475/0xdb7edb52b8326592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.991777:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd16d475/0xdb7edb52b8326592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.991785:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd16d475/0xdb7edb52b8326592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572240.991793:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd16d475/0xdb7edb52b8326592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572240.992682:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1788572240.992834:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3652:x1875449638992896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1565us (13360us total) trans 8589935745 rc 0/0 00000100:00100000:2.0:1788572240.992843:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3350 00010000:00010000:3.0:1788572240.995772:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572240.995789:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b2bab33/0xdb7edb52b832657d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995804:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572240.995809:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2bab33/0xdb7edb52b832657d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995822:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2bab33/0xdb7edb52b832657d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995847:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b2bab33/0xdb7edb52b832657d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995855:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b2bab33/0xdb7edb52b832657d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x970:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995889:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572240.995894:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cda81eb/0xdb7edb52b8326584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995901:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572240.995905:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cda81eb/0xdb7edb52b8326584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995912:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cda81eb/0xdb7edb52b8326584 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995923:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cda81eb/0xdb7edb52b8326584 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995929:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cda81eb/0xdb7edb52b8326584 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995943:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572240.995947:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036bf26f9/0xdb7edb52b832658b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995952:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572240.995955:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036bf26f9/0xdb7edb52b832658b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995961:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036bf26f9/0xdb7edb52b832658b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995970:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036bf26f9/0xdb7edb52b832658b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.995995:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572240.995999:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd16d475/0xdb7edb52b8326592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.996019:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572240.996023:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd16d475/0xdb7edb52b8326592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.996031:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd16d475/0xdb7edb52b8326592 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.996040:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd16d475/0xdb7edb52b8326592 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572240.996047:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572240.996049:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572240.996052:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572241.008065:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572241.008082:0:43975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036bf26f9/0xdb7edb52b832658b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.008144:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572241.008333:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+32:3651:x1875449638995072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16819us (17353us total) trans 4294968428 rc 0/0 00000100:00100000:1.0:1788572241.008344:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3351 00000100:00100000:1.0:1788572241.008400:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572241.008459:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638995328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572241.008503:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572241.008542:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3f800/2, rc 0, transno 8589935745 00000100:00100000:1.0:1788572241.008556:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638992896:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572241.008572:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637670380/2, rc 0, transno 4294968425 00000100:00100000:1.0:1788572241.008576:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638993920:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572241.008585:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641105880/2, rc 0, transno 4294968426 00000100:00100000:1.0:1788572241.008589:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638994432:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572241.008598:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f1f80/2, rc 0, transno 8589935744 00000100:00100000:1.0:1788572241.008602:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638993280:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572241.008610:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641104000/2, rc 0, transno 4294968424 00000100:00100000:1.0:1788572241.008858:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638994304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572241.008879:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572241.008887:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638994944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572241.008917:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572241.008966:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638994816 00000100:00100000:1.0:1788572241.008983:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638994816 00000100:00100000:1.0:1788572241.009070:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638995328 00000100:00100000:1.0:1788572241.009075:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638995328 00000100:00100000:1.0:1788572241.009096:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638994944 00000100:00100000:1.0:1788572241.009099:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638994944 00000100:00100000:1.0:1788572241.009118:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3353 00000100:00100000:1.0:1788572241.009126:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3652:x1875449638994816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.009153:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2413 count 1 00002000:00010000:1.0:1788572241.009185:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x96d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.009193:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040a6d80f/0xdb7edb52b8326599 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.009216:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96d:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.009220:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.009226:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040a6d80f/0xdb7edb52b8326599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.009240:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040a6d80f/0xdb7edb52b8326599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.009249:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040a6d80f/0xdb7edb52b8326599 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.009256:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040a6d80f/0xdb7edb52b8326599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.009275:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572241.009405:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3652:x1875449638994816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 279us (1005us total) trans 4294968429 rc 0/0 00000100:00100000:1.0:1788572241.009412:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3353 00000100:00100000:1.0:1788572241.009429:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3354 00000100:00100000:1.0:1788572241.009436:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+52:3652:x1875449638995328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572241.009449:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2435 count 1 00002000:00010000:1.0:1788572241.009469:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x983:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.009473:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b83265a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.009486:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x983:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.009489:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x983:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.009492:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b83265a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.009501:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b83265a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.009508:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b83265a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.009514:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b83265a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.009525:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572241.009604:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+53:3652:x1875449638995328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 169us (1100us total) trans 8589935746 rc 0/0 00000100:00100000:1.0:1788572241.009610:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3354 00000100:00100000:1.0:1788572241.010275:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3355 00000100:00100000:1.0:1788572241.010288:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3652:x1875449638994944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.010307:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2414 count 1 00002000:00010000:1.0:1788572241.010330:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x96e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.010337:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f71f92d/0xdb7edb52b83265a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.010353:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96e:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.010357:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x96e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.010362:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f71f92d/0xdb7edb52b83265a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.010386:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f71f92d/0xdb7edb52b83265a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.010395:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f71f92d/0xdb7edb52b83265a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.010402:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f71f92d/0xdb7edb52b83265a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.010412:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572241.010512:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3652:x1875449638994944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 227us (1593us total) trans 4294968430 rc 0/0 00000100:00100000:1.0:1788572241.010519:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3355 00000004:00080000:1.0:1788572241.010582:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641106680/2, rc 0, transno 4294968430 00000100:00100000:1.0:1788572241.010590:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638994944:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572241.010607:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641107100/2, rc 0, transno 4294968429 00000100:00100000:1.0:1788572241.010610:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638994816:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572241.011019:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788572241.011028:0:43976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd16d475/0xdb7edb52b8326592 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.011152:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+53:3652:x1875449638993408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19436us (31329us total) trans 8589935747 rc 0/0 00000100:00100000:0.0:1788572241.011161:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3352 00010000:00010000:0.0:1788572241.011201:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000004:00080000:3.0:1788572241.011206:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641106a00/2, rc 0, transno 4294968428 00010000:00010000:0.0:1788572241.011209:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040a6d80f/0xdb7edb52b8326599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572241.011216:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638995072:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572241.011223:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.011230:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040a6d80f/0xdb7edb52b8326599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.011241:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040a6d80f/0xdb7edb52b8326599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.011244:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572241.011253:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b83265a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.011264:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040a6d80f/0xdb7edb52b8326599 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.011264:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.011270:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b83265a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.011282:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040a6d80f/0xdb7edb52b8326599 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.011287:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b83265a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.011304:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b83265a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.011307:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572241.011315:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f71f92d/0xdb7edb52b83265a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.011316:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bc3518a/0xdb7edb52b83265a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.011339:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0ca00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.011344:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f71f92d/0xdb7edb52b83265a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.011349:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.011352:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f71f92d/0xdb7edb52b83265a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.011353:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.011357:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.011380:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f71f92d/0xdb7edb52b83265a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.011389:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f71f92d/0xdb7edb52b83265a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x96e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.011402:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.011403:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.011405:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572241.011434:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3ed80/2, rc 0, transno 8589935735 00000100:00100000:0.0:1788572241.011440:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638992640:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572241.011450:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3f480/2, rc 0, transno 8589935736 00000100:00100000:0.0:1788572241.011455:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638992512:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572241.011483:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3ce00/2, rc 0, transno 8589935737 00000100:00100000:0.0:1788572241.011487:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638992768:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572241.011496:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3c380/2, rc 0, transno 8589935738 00000100:00100000:0.0:1788572241.011499:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638992384:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572241.013520:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6411e9500/2, rc 0, transno 8589935746 00000100:00100000:1.0:1788572241.013534:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638995328:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572241.013554:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f3100/2, rc 0, transno 8589935747 00000100:00100000:1.0:1788572241.013558:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638993408:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572241.013597:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572241.013861:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638995840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572241.013920:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.014281:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638995584:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.014583:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d2f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638995456:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.014622:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638995712:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.014827:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572241.014887:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638996352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572241.015253:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638996224:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.015278:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.016355:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638995840 00000100:00100000:0.0:1788572241.016381:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638995840 00000100:00100000:0.0:1788572241.016462:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638995712 00000100:00100000:0.0:1788572241.016471:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638995712 00000100:00100000:0.0:1788572241.016498:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3356 00000100:00100000:0.0:1788572241.016507:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3652:x1875449638995840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572241.016544:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2420 count 1 00002000:00010000:0.0:1788572241.016584:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x974:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.016591:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017a28a5b/0xdb7edb52b83265ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.016610:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x974:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.016627:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x974:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.016633:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017a28a5b/0xdb7edb52b83265ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.016649:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017a28a5b/0xdb7edb52b83265ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.016659:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017a28a5b/0xdb7edb52b83265ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.016666:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017a28a5b/0xdb7edb52b83265ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.016689:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572241.017358:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3652:x1875449638995840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 849us (3435us total) trans 4294968431 rc 0/0 00000100:00100000:0.0:1788572241.017377:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3356 00000100:00100000:0.0:1788572241.017408:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3357 00000100:00100000:0.0:1788572241.017417:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3651:x1875449638995712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572241.017436:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2419 count 1 00002000:00010000:0.0:1788572241.017457:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x973:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.017462:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba0911ec/0xdb7edb52b83265b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017471:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x973:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.017475:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x973:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.017479:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0911ec/0xdb7edb52b83265b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017489:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba0911ec/0xdb7edb52b83265b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017497:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba0911ec/0xdb7edb52b83265b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017505:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0911ec/0xdb7edb52b83265b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017529:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572241.017543:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572241.017549:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017a28a5b/0xdb7edb52b83265ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017556:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.017559:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017a28a5b/0xdb7edb52b83265ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017568:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017a28a5b/0xdb7edb52b83265ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017583:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017a28a5b/0xdb7edb52b83265ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017590:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017a28a5b/0xdb7edb52b83265ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x974:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017628:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572241.017633:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba0911ec/0xdb7edb52b83265b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017639:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.017642:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0911ec/0xdb7edb52b83265b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017653:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0911ec/0xdb7edb52b83265b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017663:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba0911ec/0xdb7edb52b83265b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017670:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba0911ec/0xdb7edb52b83265b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x973:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017680:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.017681:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.017683:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572241.017891:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3651:x1875449638995712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 475us (3064us total) trans 4294968432 rc 0/0 00000100:00100000:0.0:1788572241.017898:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3357 00002000:00010000:0.0:1788572241.017931:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x95d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.017937:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b83265bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017946:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95d:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.017950:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x95d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.017954:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b83265bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017964:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b83265bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017990:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b83265bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.017998:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b83265bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.018040:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572241.018058:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572241.018067:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b83265bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.018077:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572241.018081:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b83265bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.018090:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b83265bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.018104:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b83265bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.018112:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bf2f524/0xdb7edb52b83265bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x95d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.018120:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3653:x1875449638990720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 70517us (71596us total) trans 4294968433 rc 0/0 00000100:00100000:0.0:1788572241.018130:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3328 00000100:00080000:0.0:1788572241.018258:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572241.018265:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788572241.018295:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.018306:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.018327:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.018338:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.018340:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.018342:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572241.024780:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.024793:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638996736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572241.024818:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.024833:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638995968:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.024848:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638996096:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572241.024927:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638996224 00000100:00100000:1.0:1788572241.024937:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638996224 00000100:00100000:1.0:1788572241.024981:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638995456 00000100:00100000:1.0:1788572241.024984:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638995456 00000100:00100000:1.0:1788572241.025030:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638995584 00000100:00100000:1.0:1788572241.025033:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638995584 00000100:00100000:1.0:1788572241.025051:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3358 00000100:00100000:1.0:1788572241.025074:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3651:x1875449638996224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.025108:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2423 count 1 00002000:00010000:1.0:1788572241.025140:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x977:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.025155:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc709c1b/0xdb7edb52b83265c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.025172:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x977:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.025181:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x977:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.025187:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc709c1b/0xdb7edb52b83265c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.025201:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc709c1b/0xdb7edb52b83265c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.025222:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc709c1b/0xdb7edb52b83265c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.025234:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc709c1b/0xdb7edb52b83265c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.025253:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572241.028127:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572241.028154:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3651:x1875449638996224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3078us (12871us total) trans 4294968434 rc 0/0 00000100:00100000:1.0:1788572241.028167:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3358 00000100:00100000:0.0:1788572241.028182:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638996480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572241.028201:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638995968 00000100:00100000:1.0:1788572241.028209:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638995968 00000100:00100000:0.0:1788572241.028227:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.028250:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638996992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572241.028251:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638996480 00000100:00100000:1.0:1788572241.028256:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638996480 00000100:00100000:0.0:1788572241.028281:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572241.028286:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3359 00000100:00100000:1.0:1788572241.028297:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3653:x1875449638995456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.028330:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2417 count 1 00000004:00080000:0.0:1788572241.028331:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3c000/2, rc 0, transno 4294968433 00000100:00100000:0.0:1788572241.028346:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638990720:0@lo:6:osp-syn-1-0.0 00002000:00010000:1.0:1788572241.028378:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x971:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.028387:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bfbbcd0/0xdb7edb52b83265ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.028396:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638996992 00000100:00100000:0.0:1788572241.028402:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638996992 00010000:00010000:1.0:1788572241.028405:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x971:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.028411:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x971:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.028418:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bfbbcd0/0xdb7edb52b83265ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.028435:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3360 00010000:00010000:1.0:1788572241.028437:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bfbbcd0/0xdb7edb52b83265ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.028446:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3650:x1875449638995584:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788572241.028452:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bfbbcd0/0xdb7edb52b83265ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788572241.028461:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2418 count 1 00010000:00010000:1.0:1788572241.028462:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bfbbcd0/0xdb7edb52b83265ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572241.028483:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x972:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.028486:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572241.028490:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e27a5de9/0xdb7edb52b83265d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.028501:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x972:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.028505:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x972:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.028509:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e27a5de9/0xdb7edb52b83265d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.028521:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e27a5de9/0xdb7edb52b83265d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.028529:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e27a5de9/0xdb7edb52b83265d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.028537:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e27a5de9/0xdb7edb52b83265d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.028552:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788572241.028889:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3650:x1875449638995584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 445us (4069us total) trans 4294968435 rc 0/0 00000100:00100000:0.0:1788572241.028897:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3360 00000100:00100000:0.0:1788572241.028915:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3361 00000100:00100000:0.0:1788572241.028922:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3653:x1875449638995968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572241.029075:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2421 count 1 00002000:00010000:0.0:1788572241.029092:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x975:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.029098:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b83265d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029107:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x975:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.029109:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x975:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.029114:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b83265d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029124:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b83265d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029132:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b83265d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029138:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b83265d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029152:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788572241.029219:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3653:x1875449638995968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 297us (1100us total) trans 4294968437 rc 0/0 00000100:00100000:0.0:1788572241.029226:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3361 00000100:00100000:0.0:1788572241.029240:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3362 00000100:00100000:0.0:1788572241.029246:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3653:x1875449638996480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572241.029258:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2437 count 1 00002000:00010000:0.0:1788572241.029279:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x985:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.029286:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b83265df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572241.029286:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3653:x1875449638995456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 989us (4514us total) trans 4294968436 rc 0/0 00000100:00100000:1.0:1788572241.029300:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3359 00010000:00010000:0.0:1788572241.029304:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x985:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.029309:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x985:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.029314:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b83265df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572241.029319:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3363 00000100:00100000:1.0:1788572241.029330:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+54:3653:x1875449638996992:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572241.029331:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b83265df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029344:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b83265df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572241.029346:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2441 count 1 00010000:00010000:0.0:1788572241.029355:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b83265df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572241.029364:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x989:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.029381:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788572241.029382:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000262aefcf/0xdb7edb52b83265e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029393:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x989:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.029396:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x989:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.029400:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000262aefcf/0xdb7edb52b83265e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029416:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000262aefcf/0xdb7edb52b83265e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029424:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000262aefcf/0xdb7edb52b83265e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029431:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000262aefcf/0xdb7edb52b83265e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029441:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1788572241.029466:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3653:x1875449638996480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 219us (1238us total) trans 8589935748 rc 0/0 00000100:00100000:0.0:1788572241.029473:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3362 00010000:00010000:0.0:1788572241.029495:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788572241.029503:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc709c1b/0xdb7edb52b83265c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029511:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0cc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.029517:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc709c1b/0xdb7edb52b83265c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029528:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc709c1b/0xdb7edb52b83265c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572241.029529:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3653:x1875449638996992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 199us (1246us total) trans 8589935749 rc 0/0 00000100:00100000:1.0:1788572241.029546:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3363 00010000:00010000:0.0:1788572241.029556:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc709c1b/0xdb7edb52b83265c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029566:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc709c1b/0xdb7edb52b83265c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x977:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029588:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572241.029592:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bfbbcd0/0xdb7edb52b83265ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029599:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.029602:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bfbbcd0/0xdb7edb52b83265ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029609:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bfbbcd0/0xdb7edb52b83265ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029636:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788572241.029642:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e27a5de9/0xdb7edb52b83265d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029649:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.029653:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e27a5de9/0xdb7edb52b83265d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029660:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e27a5de9/0xdb7edb52b83265d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029670:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e27a5de9/0xdb7edb52b83265d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029677:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e27a5de9/0xdb7edb52b83265d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x972:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029693:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572241.029696:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b83265d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029701:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.029704:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b83265d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029710:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b83265d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029719:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b83265d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029726:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac95169/0xdb7edb52b83265d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x975:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029735:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572241.029738:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b83265df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029744:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a972400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.029747:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b83265df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029753:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b83265df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029761:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b83265df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029767:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ba399c8/0xdb7edb52b83265df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029776:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572241.029779:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000262aefcf/0xdb7edb52b83265e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029790:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.029794:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000262aefcf/0xdb7edb52b83265e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029801:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000262aefcf/0xdb7edb52b83265e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029803:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bfbbcd0/0xdb7edb52b83265ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029815:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000262aefcf/0xdb7edb52b83265e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029817:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bfbbcd0/0xdb7edb52b83265ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x971:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.029836:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000262aefcf/0xdb7edb52b83265e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.029847:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.029851:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.029854:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572241.029856:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572241.029859:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572241.029862:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572241.029872:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572241.029905:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d2f1c00/2, rc 0, transno 4294968436 00000100:00100000:0.0:1788572241.029920:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d2f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638995456:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788572241.029929:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572241.029936:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572241.030079:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637670a80/2, rc 0, transno 4294968437 00000100:00100000:0.0:1788572241.030095:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638995968:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572241.030109:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b1180/2, rc 0, transno 8589935748 00000100:00100000:0.0:1788572241.030119:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638996480:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572241.030131:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6184eed80/2, rc 0, transno 8589935749 00000100:00100000:0.0:1788572241.030134:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638996992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572241.030149:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638997504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.030185:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.030209:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572241.030216:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638997376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.030238:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.030266:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638997504 00000100:00100000:0.0:1788572241.030272:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638997504 00000100:00100000:3.0:1788572241.030285:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.030312:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638997376 00000100:00100000:0.0:1788572241.030315:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638997376 00000100:00100000:3.0:1788572241.030326:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638996608:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572241.030333:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638996096 00000100:00100000:0.0:1788572241.030337:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638996096 00000100:00100000:3.0:1788572241.030359:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.030364:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3364 00000100:00100000:0.0:1788572241.030385:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3653:x1875449638997504:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.030396:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638997120:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572241.030405:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2425 count 1 00000100:00100000:3.0:1788572241.030423:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1788572241.030428:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x979:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.030436:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b83265ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.030446:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x979:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.030450:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x979:0x0].0x0 since=0s v=(0 0) 00000004:00080000:3.0:1788572241.030450:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634be9c00/2, rc 0, transno 4294968435 00000100:00100000:3.0:1788572241.030459:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638995584:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572241.030460:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b83265ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.030475:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b83265ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.030485:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b83265ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572241.030485:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572241.030496:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b83265ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.030512:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572241.030523:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638996864:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572241.030549:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572241.030576:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637673480/2, rc 0, transno 4294968431 00000100:00100000:3.0:1788572241.030582:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638995840:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.030601:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638996608 00000100:00100000:3.0:1788572241.030605:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638996608 00000100:00100000:3.0:1788572241.030631:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638997120 00000100:00100000:3.0:1788572241.030634:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638997120 00000100:00100000:3.0:1788572241.030648:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638996352 00000100:00100000:3.0:1788572241.030650:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638996352 00000100:00100000:3.0:1788572241.030663:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638996864 00000100:00100000:3.0:1788572241.030665:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638996864 00000100:00100000:3.0:1788572241.030682:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3365 00000100:00100000:3.0:1788572241.030688:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3653:x1875449638997376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572241.030701:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2424 count 1 00002000:00010000:3.0:1788572241.030718:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x978:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572241.030723:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b83265f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.030731:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x978:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:3.0:1788572241.030734:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x978:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572241.030738:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b83265f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.030746:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b83265f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.030753:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b83265f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.030764:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b83265f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.030778:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572241.030841:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3653:x1875449638997376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 153us (602us total) trans 4294968439 rc 0/0 00000100:00100000:0.0:1788572241.030848:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3653:x1875449638997504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 231us (428us total) trans 4294968438 rc 0/0 00000100:00100000:3.0:1788572241.030851:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3365 00000100:00100000:0.0:1788572241.030863:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3364 00000100:00100000:3.0:1788572241.030875:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3366 00000100:00100000:3.0:1788572241.030884:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3650:x1875449638996096:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.030889:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3367 00000100:00100000:0.0:1788572241.030899:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3650:x1875449638996608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572241.030901:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2422 count 1 00002000:00080000:0.0:1788572241.030917:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2438 count 1 00002000:00010000:3.0:1788572241.030918:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x976:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572241.030925:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b83265fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.030933:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x976:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:3.0:1788572241.030936:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x976:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572241.030941:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b83265fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572241.030942:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x986:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.030953:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326602 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.030956:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b83265fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.030977:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b83265fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.031057:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x986:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.031063:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x986:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.031067:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.031078:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.031086:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326602 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.031094:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.031109:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788572241.031184:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3650:x1875449638996608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 287us (826us total) trans 8589935750 rc 0/0 00000100:00100000:0.0:1788572241.031191:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3367 00000100:00100000:0.0:1788572241.031206:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3368 00000100:00100000:1.0:1788572241.031261:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3369 00000100:00100000:1.0:1788572241.031271:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+58:3652:x1875449638996352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572241.031284:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2436 count 1 00002000:00010000:1.0:1788572241.031303:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x984:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.031308:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f51bd8ec/0xdb7edb52b8326609 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031316:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x984:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.031319:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x984:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.031324:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f51bd8ec/0xdb7edb52b8326609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031334:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f51bd8ec/0xdb7edb52b8326609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031342:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f51bd8ec/0xdb7edb52b8326609 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031349:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f51bd8ec/0xdb7edb52b8326609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031381:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788572241.031455:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+59:3652:x1875449638996352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 187us (969us total) trans 8589935751 rc 0/0 00000100:00100000:1.0:1788572241.031462:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3369 00000100:00100000:1.0:1788572241.031475:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370 00000100:00100000:1.0:1788572241.031482:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+58:3652:x1875449638996864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572241.031493:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2440 count 1 00002000:00010000:1.0:1788572241.031518:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x988:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.031523:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000673442c6/0xdb7edb52b8326610 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031531:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x988:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.031534:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x988:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.031538:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000673442c6/0xdb7edb52b8326610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031547:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000673442c6/0xdb7edb52b8326610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031555:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000673442c6/0xdb7edb52b8326610 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031562:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000673442c6/0xdb7edb52b8326610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031580:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1788572241.031640:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+59:3652:x1875449638996864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 159us (1090us total) trans 8589935752 rc 0/0 00000100:00100000:1.0:1788572241.031647:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370 00010000:00010000:1.0:1788572241.031713:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788572241.031720:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b83265ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031727:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.031731:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b83265ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031740:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b83265ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031752:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b83265ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031759:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b21495e/0xdb7edb52b83265ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x979:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031778:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788572241.031782:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b83265f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031793:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.031796:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b83265f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031802:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b83265f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031811:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b83265f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031818:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da54d7e/0xdb7edb52b83265f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x978:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031835:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572241.031838:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.031843:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3650:x1875449638997120:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572241.031845:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.031851:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326602 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031864:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326602 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788572241.031871:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2442 count 1 00010000:00010000:1.0:1788572241.031873:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326602 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031883:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031f4ffba/0xdb7edb52b8326602 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572241.031890:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x98a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.031897:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572241.031898:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326617 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031904:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f51bd8ec/0xdb7edb52b8326609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.031917:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98a:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.031919:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.031924:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.031925:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51bd8ec/0xdb7edb52b8326609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.031933:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031936:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51bd8ec/0xdb7edb52b8326609 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.031952:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031956:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f51bd8ec/0xdb7edb52b8326609 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.031967:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326617 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.031969:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f51bd8ec/0xdb7edb52b8326609 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032138:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326617 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032148:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572241.032221:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3650:x1875449638997120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1009us (1797us total) trans 8589935753 rc 0/0 00000100:00100000:0.0:1788572241.032229:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3368 00010000:00010000:0.0:1788572241.032264:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572241.032269:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000673442c6/0xdb7edb52b8326610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032283:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.032286:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000673442c6/0xdb7edb52b8326610 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032294:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000673442c6/0xdb7edb52b8326610 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032306:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000673442c6/0xdb7edb52b8326610 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032313:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000673442c6/0xdb7edb52b8326610 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032328:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572241.032331:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326617 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032338:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.032341:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326617 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032348:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326617 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032356:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326617 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032362:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd53822b/0xdb7edb52b8326617 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.032388:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.032390:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.032392:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.032435:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b83265fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572241.032436:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637670700/2, rc 0, transno 4294968439 00000100:00100000:0.0:1788572241.032459:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638997376:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572241.032460:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788572241.032476:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637671500/2, rc 0, transno 4294968438 00000100:00100000:0.0:1788572241.032480:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638997504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.032492:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572241.032501:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638997888:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.032536:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.032568:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3650:x1875449638996096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1684us (2281us total) trans 4294968440 rc 0/0 00000100:00100000:0.0:1788572241.032573:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638997888 00000100:00100000:3.0:1788572241.032578:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3366 00000100:00100000:0.0:1788572241.032581:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638997888 00000100:00100000:3.0:1788572241.032607:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637671880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638997632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.032635:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572241.032662:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b1880/2, rc 0, transno 8589935750 00000100:00100000:3.0:1788572241.032667:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638996608:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572241.032676:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3b80/2, rc 0, transno 8589935753 00000100:00100000:3.0:1788572241.032680:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638997120:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572241.032687:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637670e00/2, rc 0, transno 4294968440 00000100:00100000:3.0:1788572241.032691:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638996096:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.032698:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572241.032704:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638997760:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.032726:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572241.032759:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b0e00/2, rc 0, transno 8589935751 00000100:00100000:3.0:1788572241.032763:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638996352:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572241.032772:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6184ed880/2, rc 0, transno 8589935752 00000100:00100000:3.0:1788572241.032776:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638996864:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572241.032790:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638997632 00000100:00100000:3.0:1788572241.032794:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638997632 00000100:00100000:3.0:1788572241.032815:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638997760 00000100:00100000:3.0:1788572241.032817:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638997760 00000100:00100000:3.0:1788572241.032833:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3371 00000100:00100000:3.0:1788572241.032841:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3653:x1875449638997888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572241.032857:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2428 count 1 00002000:00010000:3.0:1788572241.032876:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x97c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572241.032882:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b832661e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.032892:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97c:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:3.0:1788572241.032895:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572241.032901:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b832661e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.032913:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b832661e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.032922:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b832661e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.032929:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b832661e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.032938:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572241.033921:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3372 00000100:00100000:0.0:1788572241.033939:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3650:x1875449638997632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572241.033963:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2426 count 1 00000100:00100000:1.0:1788572241.034543:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3373 00000100:00100000:1.0:1788572241.034554:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+46:3650:x1875449638997760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.034571:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2427 count 1 00002000:00010000:1.0:1788572241.034599:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x97b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.034606:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1e764b1/0xdb7edb52b8326625 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.034622:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97b:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.034626:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.034633:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1e764b1/0xdb7edb52b8326625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.034647:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1e764b1/0xdb7edb52b8326625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.034657:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1e764b1/0xdb7edb52b8326625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.034663:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1e764b1/0xdb7edb52b8326625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.034673:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788572241.034795:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x97a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.034803:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fe8f890/0xdb7edb52b832662c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.034812:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97a:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.034816:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.034820:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fe8f890/0xdb7edb52b832662c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.034832:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fe8f890/0xdb7edb52b832662c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572241.034832:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+47:3650:x1875449638997760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 278us (2103us total) trans 4294968442 rc 0/0 00010000:00010000:0.0:1788572241.034848:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fe8f890/0xdb7edb52b832662c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572241.034848:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3373 00010000:00010000:0.0:1788572241.034859:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fe8f890/0xdb7edb52b832662c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.034868:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788572241.034898:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788572241.034906:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b83265fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.034914:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.034919:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b83265fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.034929:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b83265fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.034947:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b83265fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.034948:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3650:x1875449638997632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1016us (2311us total) trans 4294968443 rc 0/0 00000100:00100000:0.0:1788572241.034965:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3372 00010000:00010000:1.0:1788572241.034965:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b83265fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x976:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572241.035210:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3653:x1875449638997888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2369us (2673us total) trans 4294968441 rc 0/0 00000100:00100000:3.0:1788572241.035218:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3371 00000100:00100000:3.0:1788572241.035251:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638998400:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572241.035293:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.035893:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638998912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572241.035921:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.035950:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572241.035956:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638998016:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.035978:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572241.037570:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572241.037584:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b832661e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572241.037594:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e760700/2, rc 0, transno 4294968441 00010000:00010000:1.0:1788572241.037598:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.037604:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b832661e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.037618:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b832661e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.037638:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b832661e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.037645:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b832661e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.037697:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449638997888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.037716:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638998528:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572241.037775:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.037812:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638998400 00000100:00100000:3.0:1788572241.037817:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638999040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572241.037820:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638998400 00000100:00100000:3.0:1788572241.037847:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.037885:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638998144:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.037910:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.042731:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638998656:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572241.042800:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.042829:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638998912 00000100:00100000:0.0:1788572241.042840:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638998912 00000100:00100000:0.0:1788572241.042911:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638998016 00000100:00100000:0.0:1788572241.042915:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638998016 00000100:00100000:0.0:1788572241.042934:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638998528 00000100:00100000:0.0:1788572241.042938:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638998528 00000100:00100000:0.0:1788572241.042953:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638999040 00000100:00100000:0.0:1788572241.042956:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638999040 00000100:00100000:0.0:1788572241.042970:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638998144 00000100:00100000:0.0:1788572241.042973:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638998144 00000100:00100000:0.0:1788572241.043087:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3374 00000100:00100000:0.0:1788572241.043361:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3652:x1875449638998400:12345-0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572241.043404:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e761880/2, rc 0, transno 4294968442 00002000:00080000:0.0:1788572241.043411:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2444 count 1 00000100:00100000:3.0:1788572241.043423:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638997760:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572241.043438:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637671880/2, rc 0, transno 4294968443 00000100:00100000:3.0:1788572241.043441:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637671880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638997632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.043457:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638999168:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.043485:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.043500:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572241.043520:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638998272:0@lo:6:osp-syn-1-0.0 00002000:00010000:0.0:1788572241.043522:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x98c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.043531:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b8326633 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572241.043545:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572241.043549:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98c:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.043555:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1788572241.043561:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61ea3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638998784:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572241.043563:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b8326633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.043581:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b8326633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572241.043589:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572241.043599:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b8326633 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.043607:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b8326633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572241.043624:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638998656 00000100:00100000:3.0:1788572241.043629:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638998656 00000100:00100000:3.0:1788572241.043651:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638999168 00000100:00100000:3.0:1788572241.043653:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638999168 00000100:00100000:3.0:1788572241.043663:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638998272 00000100:00100000:3.0:1788572241.043666:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638998272 00000100:00100000:3.0:1788572241.043673:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638998784 00000100:00100000:3.0:1788572241.043675:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638998784 00000100:00100000:3.0:1788572241.043685:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3375 00000100:00100000:3.0:1788572241.043690:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+64:3652:x1875449638998912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572241.043704:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2448 count 1 00002000:00010000:3.0:1788572241.043723:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x990:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572241.043728:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b832663a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.043739:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x990:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:3.0:1788572241.043742:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x990:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572241.043747:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b832663a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.043758:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b832663a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.043766:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b832663a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.043774:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b832663a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.043787:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788572241.043817:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1788572241.044183:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3652:x1875449638998912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 489us (8258us total) trans 8589935754 rc 0/0 00000100:00100000:0.0:1788572241.044190:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3652:x1875449638998400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1093us (8894us total) trans 8589935755 rc 0/0 00000100:00100000:3.0:1788572241.044197:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3375 00000100:00100000:0.0:1788572241.044204:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3374 00000100:00100000:3.0:1788572241.044229:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3376 00000100:00100000:0.0:1788572241.044237:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3377 00000100:00100000:3.0:1788572241.044242:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3652:x1875449638998016:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.044250:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3652:x1875449638998528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572241.044260:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2429 count 1 00002000:00080000:0.0:1788572241.044266:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2445 count 1 00002000:00010000:3.0:1788572241.044282:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x97d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1788572241.044287:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x98d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572241.044290:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8326641 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.044294:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8326648 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.044307:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97d:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.044309:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98d:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:3.0:1788572241.044313:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.044315:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572241.044320:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8326641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.044321:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8326648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.044345:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8326641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.044346:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8326648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.044377:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8326641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.044380:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8326648 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.044397:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8326641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.044399:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8326648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.044427:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788572241.044483:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1788572241.044666:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3652:x1875449638998016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 429us (8685us total) trans 4294968444 rc 0/0 00000100:00100000:3.0:1788572241.044674:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3376 00000100:00100000:3.0:1788572241.044779:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3378 00000100:00100000:3.0:1788572241.044787:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+65:3652:x1875449638999040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572241.044798:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2449 count 1 00002000:00010000:3.0:1788572241.044814:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x991:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572241.044819:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b832664f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.044827:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x991:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:3.0:1788572241.044830:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x991:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572241.044834:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b832664f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.044844:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b832664f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.044852:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b832664f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.044859:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b832664f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.044873:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1788572241.045540:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3652:x1875449638998528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1290us (7761us total) trans 8589935756 rc 0/0 00000100:00100000:0.0:1788572241.045548:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3377 00000100:00100000:0.0:1788572241.045573:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3379 00000100:00100000:0.0:1788572241.045582:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3650:x1875449638998144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572241.045598:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2430 count 1 00000100:00100000:1.0:1788572241.045634:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3380 00000100:00100000:1.0:1788572241.045646:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+65:3650:x1875449638998656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572241.045661:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2446 count 1 00002000:00010000:1.0:1788572241.045680:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x98e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.045686:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7393c2c/0xdb7edb52b832665d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572241.045696:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x97e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.045697:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98e:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.045705:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.045706:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007222a829/0xdb7edb52b8326656 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.045710:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7393c2c/0xdb7edb52b832665d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.045727:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7393c2c/0xdb7edb52b832665d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.045735:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7393c2c/0xdb7edb52b832665d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.045742:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7393c2c/0xdb7edb52b832665d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.045751:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1788572241.045789:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97e:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.045795:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.045800:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007222a829/0xdb7edb52b8326656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.045812:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007222a829/0xdb7edb52b8326656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.045820:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007222a829/0xdb7edb52b8326656 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.045827:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007222a829/0xdb7edb52b8326656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.045836:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:1.0:1788572241.045855:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+66:3650:x1875449638998656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 211us (3053us total) trans 8589935758 rc 0/0 00000100:00100000:1.0:1788572241.045863:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3380 00000100:00100000:1.0:1788572241.045880:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3381 00000100:00100000:1.0:1788572241.045888:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+50:3650:x1875449638999168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.045902:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2432 count 1 00000100:00100000:0.0:1788572241.045918:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3650:x1875449638998144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 337us (8005us total) trans 4294968445 rc 0/0 00002000:00010000:1.0:1788572241.045920:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x980:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.045931:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a73a4824/0xdb7edb52b8326664 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.045932:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3379 00010000:00010000:1.0:1788572241.045943:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x980:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.045947:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x980:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.045951:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a73a4824/0xdb7edb52b8326664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.045954:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3382 00000100:00100000:0.0:1788572241.045966:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3650:x1875449638998272:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788572241.045968:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a73a4824/0xdb7edb52b8326664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.045979:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a73a4824/0xdb7edb52b8326664 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788572241.046066:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2431 count 1 00002000:00010000:0.0:1788572241.046083:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x97f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.046088:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a206dd75/0xdb7edb52b832666b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.046914:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97f:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.046918:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x97f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.046923:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a206dd75/0xdb7edb52b832666b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.046936:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a206dd75/0xdb7edb52b832666b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.046945:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a206dd75/0xdb7edb52b832666b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.046952:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a206dd75/0xdb7edb52b832666b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.046963:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:0.0:1788572241.047237:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3650:x1875449638998272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1271us (3690us total) trans 4294968446 rc 0/0 00000100:00100000:0.0:1788572241.047245:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3382 00000100:00100000:0.0:1788572241.047266:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3383 00000100:00100000:0.0:1788572241.047275:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3650:x1875449638998784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572241.047293:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2447 count 1 00002000:00010000:0.0:1788572241.047313:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x98f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.047318:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326672 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047331:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98f:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.047334:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.047339:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326672 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047349:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326672 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047357:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326672 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047363:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326672 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047381:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00000100:00100000:0.0:1788572241.047533:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+66:3650:x1875449638998784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 260us (3946us total) trans 8589935759 rc 0/0 00000100:00100000:0.0:1788572241.047539:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3383 00010000:00010000:0.0:1788572241.047582:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788572241.047590:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1e764b1/0xdb7edb52b8326625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047597:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.047601:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1e764b1/0xdb7edb52b8326625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.047667:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a73a4824/0xdb7edb52b8326664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047677:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1e764b1/0xdb7edb52b8326625 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.047679:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:0.0:1788572241.047700:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1e764b1/0xdb7edb52b8326625 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047707:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1e764b1/0xdb7edb52b8326625 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572241.047778:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+50:3650:x1875449638999168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1891us (4292us total) trans 4294968447 rc 0/0 00000100:00100000:1.0:1788572241.047785:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3381 00010000:00010000:0.0:1788572241.047791:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788572241.047796:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fe8f890/0xdb7edb52b832662c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047803:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.047806:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fe8f890/0xdb7edb52b832662c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047813:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fe8f890/0xdb7edb52b832662c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047826:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fe8f890/0xdb7edb52b832662c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047833:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fe8f890/0xdb7edb52b832662c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047857:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788572241.047862:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b832663a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047869:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.047872:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b832663a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047881:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b832663a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047893:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b832663a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047901:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b832663a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047924:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788572241.047929:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b8326633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047935:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.047938:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b8326633 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.047948:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788572241.047951:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b8326633 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.047955:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8326641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.047968:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b8326633 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.047968:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.047973:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8326641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.047983:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8326641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048162:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b8326633 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048177:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788572241.048181:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8326648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048187:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.048190:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8326648 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048198:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8326648 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048209:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8326648 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048216:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8326648 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048232:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788572241.048236:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b832664f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048242:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.048245:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b832664f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048253:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b832664f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048261:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b832664f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048268:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b832664f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048280:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572241.048283:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7393c2c/0xdb7edb52b832665d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048289:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0de00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.048293:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7393c2c/0xdb7edb52b832665d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048304:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7393c2c/0xdb7edb52b832665d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048312:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7393c2c/0xdb7edb52b832665d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048318:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7393c2c/0xdb7edb52b832665d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048330:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572241.048333:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007222a829/0xdb7edb52b8326656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048339:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.048342:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007222a829/0xdb7edb52b8326656 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048348:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007222a829/0xdb7edb52b8326656 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048356:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007222a829/0xdb7edb52b8326656 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048362:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007222a829/0xdb7edb52b8326656 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048389:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572241.048392:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a206dd75/0xdb7edb52b832666b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048398:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.048400:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a206dd75/0xdb7edb52b832666b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048408:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a206dd75/0xdb7edb52b832666b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048417:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a206dd75/0xdb7edb52b832666b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048423:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a206dd75/0xdb7edb52b832666b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048433:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572241.048436:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326672 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048442:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.048444:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326672 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048456:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326672 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048465:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326672 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048473:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8326672 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048486:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572241.048489:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a73a4824/0xdb7edb52b8326664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048495:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0dc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572241.048497:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a73a4824/0xdb7edb52b8326664 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048505:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a73a4824/0xdb7edb52b8326664 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048515:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a73a4824/0xdb7edb52b8326664 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048522:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a73a4824/0xdb7edb52b8326664 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x980:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048538:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.048539:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.048541:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.048566:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572241.048740:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8326641 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.048747:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8326641 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x97d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.048802:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.048805:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.048808:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572241.048837:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572241.048900:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.049250:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638997248:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572241.049281:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.049307:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638996736 00000100:00100000:0.0:1788572241.049314:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638996736 00000100:00100000:0.0:1788572241.049351:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638997248 00000100:00100000:0.0:1788572241.049355:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638997248 00000100:00100000:0.0:1788572241.049387:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3384 00000100:00100000:0.0:1788572241.049396:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3651:x1875449638996736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572241.049425:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2439 count 1 00002000:00010000:0.0:1788572241.049450:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x987:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.049456:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326679 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.049468:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x987:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.049473:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x987:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.049480:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326679 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.049497:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326679 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.049506:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326679 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.049513:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326679 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.049529:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572241.049691:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3651:x1875449638996736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 292us (789us total) trans 8589935760 rc 0/0 00000100:00100000:0.0:1788572241.049698:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3384 00000100:00100000:0.0:1788572241.049738:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3385 00000100:00100000:0.0:1788572241.049747:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3651:x1875449638997248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572241.049760:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2443 count 1 00002000:00010000:0.0:1788572241.049775:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x98b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.049780:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8326680 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.049789:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98b:0x0].0x0 since=4158s v=(0 0) 00000004:00080000:1.0:1788572241.049792:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634bea300/2, rc 0, transno 4294968432 00010000:00010000:0.0:1788572241.049793:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x98b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.049802:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8326680 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572241.049805:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638995712:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572241.049823:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8326680 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572241.049823:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637670000/2, rc 0, transno 4294968434 00000100:00100000:1.0:1788572241.049832:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638996224:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572241.049838:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8326680 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572241.049846:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e5b2680/2, rc 0, transno 8589935760 00010000:00010000:0.0:1788572241.049847:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8326680 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572241.049855:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e5b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638996736:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572241.049866:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572241.049892:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572241.049899:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326679 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.049908:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.049913:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326679 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.049922:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326679 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.049936:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326679 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.049940:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3651:x1875449638997248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 194us (656us total) trans 8589935761 rc 0/0 00010000:00010000:1.0:1788572241.049953:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8326679 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.049956:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3385 00010000:00010000:1.0:1788572241.049978:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572241.049982:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8326680 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572241.050111:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3652:x1875449638999040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5323us (12261us total) trans 8589935757 rc 0/0 00000100:00100000:3.0:1788572241.050119:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3378 00000004:00080000:3.0:1788572241.050158:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e762a00/2, rc 0, transno 4294968444 00000100:00100000:3.0:1788572241.050163:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638998016:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572241.050173:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac7800/2, rc 0, transno 8589935756 00000100:00100000:3.0:1788572241.050176:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638998528:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572241.050184:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f1180/2, rc 0, transno 8589935757 00000100:00100000:3.0:1788572241.050187:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638999040:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572241.050194:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac4380/2, rc 0, transno 8589935755 00000100:00100000:3.0:1788572241.050197:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638998400:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572241.050205:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f0e00/2, rc 0, transno 8589935754 00000100:00100000:3.0:1788572241.050207:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638998912:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572241.050229:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634ad6d80/2, rc 0, transno 4294968446 00000100:00100000:3.0:1788572241.050234:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638998272:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572241.050246:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3ca80/2, rc 0, transno 8589935759 00000100:00100000:3.0:1788572241.050249:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638998784:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572241.050259:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a4e00/2, rc 0, transno 4294968447 00000100:00100000:3.0:1788572241.050262:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638999168:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572241.050274:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e763100/2, rc 0, transno 4294968445 00000100:00100000:3.0:1788572241.050279:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e763100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638998144:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572241.050294:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61ea3e300/2, rc 0, transno 8589935758 00000100:00100000:3.0:1788572241.050299:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61ea3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638998656:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572241.050351:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3800/2, rc 0, transno 8589935761 00000100:00100000:0.0:1788572241.050357:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449638997248:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572241.050381:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572241.050481:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638999680:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.050526:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.050550:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639000192:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.050569:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.050580:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638999424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.050587:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572241.050595:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638999296:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.050621:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572241.050637:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572241.050637:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638999808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.050655:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.050680:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638999680 00000100:00100000:0.0:1788572241.050685:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.050686:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638999680 00000100:00100000:0.0:1788572241.050716:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638999936:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.050722:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639000192 00000100:00100000:3.0:1788572241.050726:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639000192 00000100:00100000:2.0:1788572241.050727:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638999296 00000100:00100000:2.0:1788572241.050730:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638999296 00000100:00100000:3.0:1788572241.050742:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638999808 00000100:00100000:3.0:1788572241.050744:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638999808 00000100:00100000:2.0:1788572241.050748:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638999424 00000100:00100000:2.0:1788572241.050751:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638999424 00000100:00100000:3.0:1788572241.050760:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3386 00000100:00100000:2.0:1788572241.050764:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3387 00000100:00100000:3.0:1788572241.050766:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+54:3650:x1875449638999680:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572241.050769:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+54:3650:x1875449639000192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572241.050784:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2440 count 1 00002000:00080000:3.0:1788572241.050784:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2436 count 1 00002000:00010000:2.0:1788572241.050808:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x988:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1788572241.050808:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x984:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1788572241.050815:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572241.050819:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b832668e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.050819:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8326687 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.050831:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x988:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:3.0:1788572241.050831:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x984:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:2.0:1788572241.050836:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x988:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572241.050836:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x984:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572241.050843:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b832668e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.050843:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8326687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.050844:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788572241.050855:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638999552:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572241.050859:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b832668e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.050859:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8326687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.050870:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b832668e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.050870:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8326687 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.050880:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b832668e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.050880:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8326687 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.050881:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572241.050901:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572241.050904:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639000064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.050925:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.050951:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638999936 00000100:00100000:0.0:1788572241.050955:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638999936 00010000:00010000:2.0:1788572241.051034:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572241.051068:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3388 00000100:00100000:0.0:1788572241.051079:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+55:3650:x1875449638999296:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572241.051162:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3650:x1875449639000192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 390us (590us total) trans 4294968448 rc 0/0 00002000:00080000:0.0:1788572241.051168:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2433 count 1 00000100:00100000:2.0:1788572241.051171:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3387 00000100:00100000:2.0:1788572241.051188:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449638999552 00002000:00010000:0.0:1788572241.051191:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x981:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1788572241.051192:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449638999552 00010000:00010000:0.0:1788572241.051201:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007432844c/0xdb7edb52b8326695 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051210:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x981:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.051214:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x981:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1788572241.051216:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639000064 00010000:00010000:0.0:1788572241.051219:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007432844c/0xdb7edb52b8326695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572241.051221:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639000064 00010000:00010000:0.0:1788572241.051234:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007432844c/0xdb7edb52b8326695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572241.051243:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3389 00010000:00010000:0.0:1788572241.051244:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007432844c/0xdb7edb52b8326695 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572241.051251:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3650:x1875449638999808:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572241.051262:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007432844c/0xdb7edb52b8326695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788572241.051267:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2437 count 1 00010000:00010000:0.0:1788572241.051278:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788572241.051285:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x985:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572241.051292:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3409742/0xdb7edb52b832669c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.051301:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x985:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:2.0:1788572241.051304:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x985:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572241.051309:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3409742/0xdb7edb52b832669c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.051318:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3409742/0xdb7edb52b832669c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.051325:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3409742/0xdb7edb52b832669c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.051332:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3409742/0xdb7edb52b832669c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.051346:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788572241.051353:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+58:3650:x1875449638999296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 276us (729us total) trans 4294968449 rc 0/0 00000100:00100000:0.0:1788572241.051364:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3388 00000100:00100000:0.0:1788572241.051390:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3390 00000100:00100000:0.0:1788572241.051398:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+57:3652:x1875449638999424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572241.051411:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2434 count 1 00002000:00010000:0.0:1788572241.051428:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x982:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.051433:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a3a0df5/0xdb7edb52b83266a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051441:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x982:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.051444:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x982:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.051448:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a3a0df5/0xdb7edb52b83266a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051456:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a3a0df5/0xdb7edb52b83266a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051464:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a3a0df5/0xdb7edb52b83266a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051471:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a3a0df5/0xdb7edb52b83266a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051479:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788572241.051500:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572241.051505:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8326680 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572241.051545:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+59:3652:x1875449638999424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 148us (863us total) trans 4294968451 rc 0/0 00000100:00100000:0.0:1788572241.051551:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3390 00000100:00100000:0.0:1788572241.051564:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3391 00000100:00100000:0.0:1788572241.051571:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+58:3652:x1875449638999936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572241.051584:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2438 count 1 00010000:00010000:1.0:1788572241.051587:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8326680 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572241.051601:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x986:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.051606:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8326680 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051608:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83266aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.051619:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8326680 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572241.051665:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3392 00000100:00100000:1.0:1788572241.051673:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+58:3652:x1875449638999552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.051688:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2435 count 1 00010000:00010000:0.0:1788572241.051692:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x986:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.051697:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x986:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.051701:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83266aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572241.051708:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x983:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.051711:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83266aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.051715:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e319a96/0xdb7edb52b83266b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.051728:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x983:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.051734:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x983:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.051737:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83266aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.051739:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e319a96/0xdb7edb52b83266b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051755:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83266aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.051759:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e319a96/0xdb7edb52b83266b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051773:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788572241.051774:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e319a96/0xdb7edb52b83266b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.051784:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e319a96/0xdb7edb52b83266b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.051794:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:0.0:1788572241.051849:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+60:3652:x1875449638999936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 278us (1036us total) trans 4294968452 rc 0/0 00000100:00100000:0.0:1788572241.051856:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3391 00000100:00100000:1.0:1788572241.051880:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+59:3652:x1875449638999552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 206us (996us total) trans 4294968453 rc 0/0 00000100:00100000:0.0:1788572241.051882:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3393 00000100:00100000:1.0:1788572241.051892:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3392 00000100:00100000:0.0:1788572241.051895:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+59:3652:x1875449639000064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572241.051909:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2439 count 1 00002000:00010000:0.0:1788572241.051924:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x987:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572241.051930:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8d3d852/0xdb7edb52b83266b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051938:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x987:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:0.0:1788572241.051941:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x987:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572241.051945:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d3d852/0xdb7edb52b83266b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051955:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8d3d852/0xdb7edb52b83266b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051964:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8d3d852/0xdb7edb52b83266b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.051972:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d3d852/0xdb7edb52b83266b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572241.052184:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:0.0:1788572241.052253:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e5b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+59:3652:x1875449639000064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 360us (1325us total) trans 4294968454 rc 0/0 00000100:00100000:0.0:1788572241.052260:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3393 00000004:00080000:0.0:1788572241.052305:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff5180/2, rc 0, transno 4294968453 00000100:00100000:0.0:1788572241.052321:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638999552:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.052323:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+59:3650:x1875449638999680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1555us (1794us total) trans 4294968455 rc 0/0 00000100:00100000:3.0:1788572241.052333:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3386 00000004:00080000:0.0:1788572241.052338:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3480/2, rc 0, transno 4294968454 00000100:00100000:0.0:1788572241.052346:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639000064:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572241.052357:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff6a00/2, rc 0, transno 4294968451 00000100:00100000:0.0:1788572241.052362:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638999424:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572241.052388:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637595180/2, rc 0, transno 4294968449 00000004:00080000:0.0:1788572241.052389:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637671c00/2, rc 0, transno 4294968452 00000100:00100000:3.0:1788572241.052398:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638999296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.052399:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449638999936:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572241.052418:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff4700/2, rc 0, transno 4294968455 00000100:00100000:3.0:1788572241.052424:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638999680:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572241.052434:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db1f80/2, rc 0, transno 4294968448 00000100:00100000:3.0:1788572241.052438:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639000192:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.052531:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639000704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.052559:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572241.052772:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788572241.052778:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8326687 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052794:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.052797:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8326687 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052806:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8326687 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052821:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8326687 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052829:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8326687 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x984:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052853:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788572241.052857:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b832668e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052863:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.052867:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b832668e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052874:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b832668e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052883:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b832668e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052891:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8dced1b/0xdb7edb52b832668e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x988:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052903:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788572241.052907:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007432844c/0xdb7edb52b8326695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052913:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.052916:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007432844c/0xdb7edb52b8326695 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052924:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007432844c/0xdb7edb52b8326695 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052934:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007432844c/0xdb7edb52b8326695 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052941:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007432844c/0xdb7edb52b8326695 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x981:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052954:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572241.052957:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3409742/0xdb7edb52b832669c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052964:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.052967:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3409742/0xdb7edb52b832669c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052975:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3409742/0xdb7edb52b832669c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.052984:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3409742/0xdb7edb52b832669c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572241.054030:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3650:x1875449638999808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2775us (3367us total) trans 4294968450 rc 0/0 00000100:00100000:2.0:1788572241.054041:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3389 00000100:00100000:2.0:1788572241.054065:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639000704 00000100:00100000:2.0:1788572241.054073:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639000704 00000100:00100000:2.0:1788572241.054119:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3394 00000100:00100000:2.0:1788572241.054127:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3650:x1875449639000704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572241.054153:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2444 count 1 00002000:00010000:2.0:1788572241.054179:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x98c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572241.054186:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000484419c8/0xdb7edb52b83266bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.054199:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98c:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:2.0:1788572241.054203:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572241.054209:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000484419c8/0xdb7edb52b83266bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.054221:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000484419c8/0xdb7edb52b83266bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.054231:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000484419c8/0xdb7edb52b83266bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.054239:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000484419c8/0xdb7edb52b83266bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.054249:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1788572241.054387:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3650:x1875449639000704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 260us (1826us total) trans 4294968456 rc 0/0 00000100:00100000:2.0:1788572241.054393:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3394 00010000:00010000:3.0:1788572241.054426:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3409742/0xdb7edb52b832669c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x985:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.054443:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572241.054449:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a3a0df5/0xdb7edb52b83266a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.054456:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.054459:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a3a0df5/0xdb7edb52b83266a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.054467:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a3a0df5/0xdb7edb52b83266a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.054479:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a3a0df5/0xdb7edb52b83266a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.054486:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a3a0df5/0xdb7edb52b83266a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x982:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055098:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572241.055107:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83266aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055116:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.055119:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83266aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055126:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83266aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055139:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83266aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055146:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed3e9ee1/0xdb7edb52b83266aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x986:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055162:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572241.055166:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e319a96/0xdb7edb52b83266b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055172:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.055175:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e319a96/0xdb7edb52b83266b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055189:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e319a96/0xdb7edb52b83266b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055197:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e319a96/0xdb7edb52b83266b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055203:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e319a96/0xdb7edb52b83266b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x983:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055215:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572241.055218:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8d3d852/0xdb7edb52b83266b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055222:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.055225:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8d3d852/0xdb7edb52b83266b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055232:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8d3d852/0xdb7edb52b83266b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055239:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8d3d852/0xdb7edb52b83266b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055245:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8d3d852/0xdb7edb52b83266b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x987:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055260:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572241.055263:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000484419c8/0xdb7edb52b83266bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055268:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.055271:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000484419c8/0xdb7edb52b83266bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055278:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000484419c8/0xdb7edb52b83266bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055287:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000484419c8/0xdb7edb52b83266bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055294:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000484419c8/0xdb7edb52b83266bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.055306:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.055309:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.055311:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.055317:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.055321:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.055324:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.055326:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.055330:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572241.055335:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641104380/2, rc 0, transno 4294968456 00000100:00100000:0.0:1788572241.055360:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639000704:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572241.055496:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d2f0e00/2, rc 0, transno 4294968450 00000100:00100000:0.0:1788572241.055515:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449638999808:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.055534:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639001216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.055582:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572241.055616:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639001216 00000100:00100000:1.0:1788572241.055623:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639001216 00000100:00100000:1.0:1788572241.055663:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3395 00000100:00100000:1.0:1788572241.055677:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+59:3650:x1875449639001216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.055699:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2448 count 1 00002000:00010000:1.0:1788572241.055725:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x990:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.055731:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51bd8ec/0xdb7edb52b83266c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.055743:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x990:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.055749:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x990:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.055755:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f51bd8ec/0xdb7edb52b83266c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.055767:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f51bd8ec/0xdb7edb52b83266c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.055776:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f51bd8ec/0xdb7edb52b83266c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.055783:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f51bd8ec/0xdb7edb52b83266c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.055811:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572241.055824:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572241.055832:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639000320:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.055864:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572241.055884:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639000832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.055914:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572241.055933:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+60:3650:x1875449639001216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 261us (348us total) trans 4294968457 rc 0/0 00000100:00100000:0.0:1788572241.055940:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639001344:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572241.055944:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3395 00000100:00100000:1.0:1788572241.055963:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639000320 00000100:00100000:1.0:1788572241.055966:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639000320 00000100:00100000:0.0:1788572241.055971:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572241.056097:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572241.056102:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f51bd8ec/0xdb7edb52b83266c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.056108:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.056111:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51bd8ec/0xdb7edb52b83266c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.056118:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f51bd8ec/0xdb7edb52b83266c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.056130:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f51bd8ec/0xdb7edb52b83266c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.056137:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f51bd8ec/0xdb7edb52b83266c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x990:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.056151:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.056153:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.056154:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572241.056855:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a9b0e00/2, rc 0, transno 4294968457 00000100:00100000:0.0:1788572241.056866:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639001216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.056893:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639000448:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.056935:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572241.058443:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572241.058449:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572241.058451:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572241.060451:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639000960:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572241.060511:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572241.076125:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639000832 00000100:00100000:1.0:1788572241.076142:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639000832 00000100:00100000:1.0:1788572241.076216:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639001344 00000100:00100000:1.0:1788572241.076219:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639001344 00000100:00100000:1.0:1788572241.076241:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639000448 00000100:00100000:1.0:1788572241.076244:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639000448 00000100:00100000:1.0:1788572241.076271:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3396 00000100:00100000:1.0:1788572241.076280:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+63:3650:x1875449639000320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.076315:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2441 count 1 00002000:00010000:1.0:1788572241.076350:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x989:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.076359:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000262aefcf/0xdb7edb52b83266cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076388:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x989:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.076393:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x989:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.076399:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000262aefcf/0xdb7edb52b83266cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076413:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000262aefcf/0xdb7edb52b83266cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076425:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000262aefcf/0xdb7edb52b83266cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076433:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000262aefcf/0xdb7edb52b83266cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076468:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572241.076676:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+64:3650:x1875449639000320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 396us (20811us total) trans 4294968458 rc 0/0 00000100:00100000:1.0:1788572241.076683:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3396 00000100:00100000:1.0:1788572241.076702:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3397 00000100:00100000:1.0:1788572241.076708:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+63:3650:x1875449639000832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.076719:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2445 count 1 00002000:00010000:1.0:1788572241.076732:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x98d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.076736:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2201d73/0xdb7edb52b83266d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076745:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98d:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.076747:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.076751:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2201d73/0xdb7edb52b83266d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076759:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2201d73/0xdb7edb52b83266d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076766:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2201d73/0xdb7edb52b83266d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076772:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2201d73/0xdb7edb52b83266d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076790:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572241.076849:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+64:3650:x1875449639000832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 141us (20934us total) trans 4294968459 rc 0/0 00000100:00100000:1.0:1788572241.076856:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3397 00000100:00100000:1.0:1788572241.076869:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3398 00000100:00100000:1.0:1788572241.076875:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+63:3650:x1875449639001344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.076886:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2449 count 1 00002000:00010000:1.0:1788572241.076899:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x991:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.076903:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a5e895a/0xdb7edb52b83266db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076911:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x991:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.076914:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x991:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.076918:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a5e895a/0xdb7edb52b83266db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076927:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a5e895a/0xdb7edb52b83266db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076934:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a5e895a/0xdb7edb52b83266db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076941:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a5e895a/0xdb7edb52b83266db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.076959:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572241.079229:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+64:3650:x1875449639001344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2347us (23253us total) trans 4294968460 rc 0/0 00000100:00100000:1.0:1788572241.079242:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3398 00000100:00100000:1.0:1788572241.079273:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3399 00010000:00010000:3.0:1788572241.079858:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572241.079867:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000262aefcf/0xdb7edb52b83266cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.079880:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.079885:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000262aefcf/0xdb7edb52b83266cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.079902:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000262aefcf/0xdb7edb52b83266cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.079922:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000262aefcf/0xdb7edb52b83266cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.079929:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000262aefcf/0xdb7edb52b83266cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x989:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.079954:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572241.079958:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2201d73/0xdb7edb52b83266d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.079964:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.079967:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2201d73/0xdb7edb52b83266d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.079974:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2201d73/0xdb7edb52b83266d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.079984:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2201d73/0xdb7edb52b83266d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572241.080091:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+63:3652:x1875449639000448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572241.080120:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2442 count 1 00002000:00010000:1.0:1788572241.080148:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x98a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572241.080154:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081dbc61c/0xdb7edb52b83266e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.080166:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98a:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:1.0:1788572241.080170:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572241.080176:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081dbc61c/0xdb7edb52b83266e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.080187:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081dbc61c/0xdb7edb52b83266e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.080195:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081dbc61c/0xdb7edb52b83266e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.080446:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2201d73/0xdb7edb52b83266d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.080468:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572241.080471:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a5e895a/0xdb7edb52b83266db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.080478:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0d200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.080481:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a5e895a/0xdb7edb52b83266db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.080488:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a5e895a/0xdb7edb52b83266db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.080498:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a5e895a/0xdb7edb52b83266db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.080505:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a5e895a/0xdb7edb52b83266db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x991:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.080517:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.080519:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.080520:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.080528:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.080534:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572241.080582:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639000576:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788572241.080644:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081dbc61c/0xdb7edb52b83266e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572241.080674:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572241.081108:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+64:3652:x1875449639000448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1668us (24014us total) trans 4294968461 rc 0/0 00000100:00100000:1.0:1788572241.081118:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3399 00010000:00010000:3.0:1788572241.081200:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572241.081281:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081dbc61c/0xdb7edb52b83266e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.081334:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0ce00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.081338:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081dbc61c/0xdb7edb52b83266e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.081346:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081dbc61c/0xdb7edb52b83266e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.081360:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081dbc61c/0xdb7edb52b83266e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.081378:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081dbc61c/0xdb7edb52b83266e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.081397:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.081398:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.081400:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572241.084562:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639000960 00000100:00100000:2.0:1788572241.084580:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639000960 00000100:00100000:3.0:1788572241.084716:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3400 00000100:00100000:3.0:1788572241.084730:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+64:3652:x1875449639000960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572241.084763:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2446 count 1 00002000:00010000:3.0:1788572241.084797:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x98e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572241.084805:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b83266e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.084822:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98e:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:3.0:1788572241.084827:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572241.084834:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b83266e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.084848:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b83266e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.084858:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b83266e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.084866:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b83266e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.084886:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572241.085084:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+65:3652:x1875449639000960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 358us (24572us total) trans 4294968462 rc 0/0 00000100:00100000:3.0:1788572241.085111:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3400 00010000:00010000:3.0:1788572241.085136:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572241.085143:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b83266e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.085151:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.085156:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b83266e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.085165:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b83266e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.085187:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b83266e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.085194:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b83266e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.085218:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.085220:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.085223:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572241.086017:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641105180/2, rc 0, transno 4294968458 00000100:00100000:2.0:1788572241.086029:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639000320:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572241.086043:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b5880/2, rc 0, transno 4294968459 00000100:00100000:2.0:1788572241.086047:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639000832:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572241.086057:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63a9b0a80/2, rc 0, transno 4294968460 00000100:00100000:2.0:1788572241.086060:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639001344:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572241.086114:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572241.086151:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639001088:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572241.086190:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572241.086812:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639000576 00000100:00100000:3.0:1788572241.086823:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639000576 00000100:00100000:3.0:1788572241.086884:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639001088 00000100:00100000:3.0:1788572241.086889:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639001088 00000100:00100000:2.0:1788572241.086907:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3401 00000100:00100000:3.0:1788572241.086917:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3402 00000100:00100000:2.0:1788572241.086923:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3653:x1875449639000576:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572241.086931:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3653:x1875449639001088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572241.086961:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2443 count 1 00002000:00080000:3.0:1788572241.086961:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2447 count 1 00002000:00010000:2.0:1788572241.086996:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x98b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1788572241.087001:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x98f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572241.087023:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025310e7f/0xdb7edb52b83266f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.087033:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007acd8aef/0xdb7edb52b83266f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.087043:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98b:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:3.0:1788572241.087045:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98f:0x0].0x0 since=4158s v=(0 0) 00010000:00010000:2.0:1788572241.087048:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572241.087051:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x98f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572241.087057:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025310e7f/0xdb7edb52b83266f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.087058:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007acd8aef/0xdb7edb52b83266f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.087089:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007acd8aef/0xdb7edb52b83266f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.087090:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025310e7f/0xdb7edb52b83266f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.087102:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025310e7f/0xdb7edb52b83266f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.087110:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025310e7f/0xdb7edb52b83266f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.087128:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572241.087268:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3653:x1875449639000576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 352us (1153us total) trans 4294968463 rc 0/0 00000100:00100000:2.0:1788572241.087276:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3401 00000004:00080000:2.0:1788572241.087317:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641107800/2, rc 0, transno 4294968463 00000100:00100000:2.0:1788572241.087323:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639000576:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572241.087361:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572241.087440:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025310e7f/0xdb7edb52b83266f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.087450:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572241.087454:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025310e7f/0xdb7edb52b83266f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.087464:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025310e7f/0xdb7edb52b83266f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.087482:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025310e7f/0xdb7edb52b83266f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572241.087491:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025310e7f/0xdb7edb52b83266f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.087753:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007acd8aef/0xdb7edb52b83266f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.087762:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007acd8aef/0xdb7edb52b83266f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.087778:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572241.087876:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3653:x1875449639001088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 947us (1683us total) trans 4294968464 rc 0/0 00000100:00100000:3.0:1788572241.087883:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3402 00010000:00010000:3.0:1788572241.087902:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572241.087907:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007acd8aef/0xdb7edb52b83266f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.087915:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572241.087918:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007acd8aef/0xdb7edb52b83266f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.087926:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007acd8aef/0xdb7edb52b83266f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.087937:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007acd8aef/0xdb7edb52b83266f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.087944:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007acd8aef/0xdb7edb52b83266f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x98f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572241.087967:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.087969:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.087971:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572241.088028:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618491880/2, rc 0, transno 4294968464 00000100:00100000:3.0:1788572241.088034:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639001088:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572241.088565:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490e00/2, rc 0, transno 4294968462 00000100:00100000:0.0:1788572241.088571:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639000960:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572241.088585:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641106300/2, rc 0, transno 4294968461 00000100:00100000:0.0:1788572241.088588:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639000448:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572241.092781:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572241.092790:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572241.092794:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572241.614300:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572242.629653:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572242.947268:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639001472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572242.947363:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572242.947541:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639001600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572242.947573:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572242.947678:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639001600 00000100:00100000:3.0:1788572242.947686:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639001600 00000100:00100000:3.0:1788572242.947731:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:3.0:1788572242.947740:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+67:3653:x1875449639001600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572242.947777:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923480576 avail 3691958272 00000100:00100000:3.0:1788572242.947816:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+67:3653:x1875449639001600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572242.947822:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000100:00100000:3.0:1788572242.947865:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639001600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572242.947995:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639001472 00000100:00100000:0.0:1788572242.948000:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639001472 00000100:00100000:0.0:1788572242.948073:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:0.0:1788572242.948080:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639001472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572242.948104:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:0.0:1788572242.948142:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639001472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572242.948148:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:3.0:1788572242.948707:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639001728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572242.948805:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572242.948919:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639001472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572242.951849:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639001728 00000100:00100000:0.0:1788572242.951861:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639001728 00000100:00100000:0.0:1788572242.951916:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:0.0:1788572242.951926:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+67:3650:x1875449639001728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572242.951959:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572242.952171:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+67:3650:x1875449639001728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 246us (3424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572242.952179:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000100:00100000:1.0:1788572242.956212:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639001728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788572243.653689:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572243.972656:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639001856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572243.973088:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572243.973235:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639001856 00000100:00100000:3.0:1788572243.973244:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639001856 00000100:00100000:3.0:1788572243.973323:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790 00000100:00100000:3.0:1788572243.973334:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639001856:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788572243.973412:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788572243.975142:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923480576 avail 3691958272 00000100:00100000:2.0:1788572243.975291:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639001856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1954us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572243.975301:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790 00000100:00100000:0.0:1788572243.975455:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639001856:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572244.483797:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639002112:0@lo:400:kworker.0 00000100:00100000:2.0:1788572244.483883:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572244.483942:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639002624:0@lo:400:kworker.0 00000100:00100000:2.0:1788572244.483967:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572244.483986:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639003136:0@lo:400:kworker.0 00000100:00100000:2.0:1788572244.484032:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572244.484054:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788572244.484060:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639001984:0@lo:400:kworker.0 00000100:00100000:2.0:1788572244.484088:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572244.484109:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639002496:0@lo:400:kworker.0 00000100:00100000:2.0:1788572244.484129:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572244.484142:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639003008:0@lo:400:kworker.0 00000100:00100000:2.0:1788572244.484163:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572244.484397:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639003520:0@lo:400:kworker.0 00000100:00100000:2.0:1788572244.484422:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572244.484452:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639002624 00000100:00100000:2.0:1788572244.484459:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639002624 00000100:00100000:2.0:1788572244.484510:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639002496 00000100:00100000:2.0:1788572244.484513:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639002496 00000100:00100000:2.0:1788572244.484530:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639003008 00000100:00100000:2.0:1788572244.484533:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639003008 00000100:00100000:2.0:1788572244.484545:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639003520 00000100:00100000:2.0:1788572244.484548:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639003520 00000100:00100000:2.0:1788572244.484562:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4418 00000100:00100000:2.0:1788572244.484570:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639002624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572244.484619:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639002624:12345-0@lo:400:kworker.0 Request processed in 50us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572244.484626:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4418 00000100:00100000:2.0:1788572244.484642:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4419 00000100:00100000:3.0:1788572244.484740:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639002112 00000100:00100000:3.0:1788572244.484744:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639002112 00000100:00100000:3.0:1788572244.484772:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639003136 00000100:00100000:3.0:1788572244.484775:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639003136 00000100:00100000:3.0:1788572244.484797:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:3.0:1788572244.484803:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639002112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.484843:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639002112:12345-0@lo:400:kworker.0 Request processed in 40us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.484849:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:3.0:1788572244.484861:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:3.0:1788572244.484878:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639003136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.484906:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639003136:12345-0@lo:400:kworker.0 Request processed in 39us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.484912:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:3.0:1788572244.484930:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639001984 00000100:00100000:3.0:1788572244.484933:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639001984 00000100:00100000:3.0:1788572244.484958:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788572244.484964:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639001984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.484992:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639001984:12345-0@lo:400:kworker.0 Request processed in 29us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.484998:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788572244.485094:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639002496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572244.485124:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639002496:12345-0@lo:400:kworker.0 Request processed in 32us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.487385:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4420 00000100:00100000:3.0:1788572244.487419:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639003008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.487536:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639003008:12345-0@lo:400:kworker.0 Request processed in 138us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.487547:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4420 00000100:00100000:3.0:1788572244.487589:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4421 00000100:00100000:3.0:1788572244.487595:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639003520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.487626:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639003520:12345-0@lo:400:kworker.0 Request processed in 31us (3202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.487632:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4421 00000100:00080000:3.0:1788572244.487681:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572244.487686:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572244.488135:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639001984:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488155:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639002496:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488166:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639003008:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488177:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639003520:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488189:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639002112:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488201:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639002624:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488213:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639003136:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488287:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639002368:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488329:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572244.488367:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639002880:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488389:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572244.488417:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639003392:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488437:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572244.488456:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788572244.488807:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639002240:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488836:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572244.488857:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639002752:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488877:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572244.488898:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639003264:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.488918:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572244.488953:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639002368 00000100:00100000:3.0:1788572244.488959:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639002368 00000100:00100000:3.0:1788572244.489000:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639003392 00000100:00100000:3.0:1788572244.489026:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639003392 00000100:00100000:3.0:1788572244.489056:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639002752 00000100:00100000:3.0:1788572244.489059:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639002752 00000100:00100000:3.0:1788572244.489074:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639003264 00000100:00100000:3.0:1788572244.489077:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639003264 00000100:00100000:3.0:1788572244.489094:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3623 00000100:00100000:3.0:1788572244.489102:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639002368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.489148:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639002368:12345-0@lo:400:kworker.0 Request processed in 46us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.489155:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3623 00000100:00100000:3.0:1788572244.489169:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3624 00000100:00100000:3.0:1788572244.489175:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3651:x1875449639003392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.489200:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3651:x1875449639003392:12345-0@lo:400:kworker.0 Request processed in 25us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.489206:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3624 00000100:00100000:3.0:1788572244.489215:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3625 00000100:00100000:3.0:1788572244.489221:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639002752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.489245:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639002752:12345-0@lo:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.489250:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3625 00000100:00100000:3.0:1788572244.489259:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3626 00000100:00100000:3.0:1788572244.489265:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3651:x1875449639003264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.489287:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3651:x1875449639003264:12345-0@lo:400:kworker.0 Request processed in 23us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.489293:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3626 00000100:00100000:3.0:1788572244.489322:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639002880 00000100:00100000:3.0:1788572244.489326:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639002880 00000100:00100000:3.0:1788572244.489362:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639002240 00000100:00100000:3.0:1788572244.489365:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639002240 00000100:00100000:3.0:1788572244.489378:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4422 00000100:00100000:3.0:1788572244.489384:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639002880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.489942:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639002880:12345-0@lo:400:kworker.0 Request processed in 554us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.489950:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4422 00000100:00100000:3.0:1788572244.489967:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4423 00000100:00100000:3.0:1788572244.489974:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639002240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.490030:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639002240:12345-0@lo:400:kworker.0 Request processed in 32us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.490037:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4423 00000100:00080000:3.0:1788572244.490159:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572244.490165:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572244.490167:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572244.490199:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639002240:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.490214:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639002752:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.490226:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639003264:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.490237:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639002368:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.490247:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639002880:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.490256:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639003392:0@lo:400:kworker.0 00000100:00100000:3.0:1788572244.490378:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639003648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572244.490420:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572244.490453:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639003648 00000100:00100000:3.0:1788572244.490457:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639003648 00000100:00100000:3.0:1788572244.490841:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:3.0:1788572244.490849:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639003648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572244.490877:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572244.490918:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639003648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.490925:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00100000:3.0:1788572244.490957:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639003648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572244.491320:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4419 00010000:00010000:3.0:1788572244.675552:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572244.897918:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572244.898076:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572244.898113:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572244.898142:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572244.898179:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572244.898207:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615412096 00000100:00100000:3.0:1788572244.898219:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615412096 00000100:00100000:3.0:1788572244.898277:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615411968 00000100:00100000:3.0:1788572244.898280:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615411968 00000100:00100000:3.0:1788572244.898302:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3627 00000100:00100000:3.0:1788572244.898311:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2383:x1875449615412096:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572244.898393:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2383:x1875449615412096:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.898411:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3627 00000100:00100000:3.0:1788572244.898427:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3628 00000100:00100000:3.0:1788572244.898434:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2383:x1875449615411968:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572244.898458:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2383:x1875449615411968:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 25us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.898465:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3628 00000100:00100000:3.0:1788572244.898918:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615411840 00000100:00100000:3.0:1788572244.898923:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615411840 00000100:00100000:3.0:1788572244.898954:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615411712 00000100:00100000:3.0:1788572244.898957:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615411712 00000100:00100000:3.0:1788572244.898983:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4424 00000100:00100000:3.0:1788572244.898993:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449615411840:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572244.899284:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4425 00000100:00100000:2.0:1788572244.899294:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2383:x1875449615411712:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572244.899349:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2383:x1875449615411712:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 58us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572244.899356:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4425 00000100:00080000:2.0:1788572244.899392:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572244.899396:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572244.899398:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572244.899410:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572244.901761:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449615411840:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 2757us (3672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572244.901777:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4424 00000100:00100000:1.0:1788572244.905307:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615411584 00000100:00100000:1.0:1788572244.905323:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615411584 00000100:00100000:1.0:1788572244.905474:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 85 00000100:00100000:1.0:1788572244.905485:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449615411584:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572244.905745:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449615411584:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 261us (7837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572244.905754:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 85 00000100:00100000:3.0:1788572244.995750:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639003776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572244.995825:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572244.996093:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639003776 00000100:00100000:1.0:1788572244.996100:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639003776 00000100:00100000:1.0:1788572244.996161:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:1.0:1788572244.996171:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639003776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572244.996204:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572244.996259:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639003776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572244.996266:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000100:00100000:3.0:1788572244.996361:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639003776:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572245.702128:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572246.723376:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788572247.054654:0:16234:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589935761 is committed 00000001:00080000:1.0:1788572247.055030:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968464 is committed 00010000:00010000:3.0:1788572247.749726:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572248.068587:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572248.068608:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639003904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572248.068680:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572248.068748:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639003904 00000100:00100000:3.0:1788572248.068754:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639003904 00000100:00100000:3.0:1788572248.068798:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:3.0:1788572248.068808:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639003904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572248.068834:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923480576 avail 3691958272 00000100:00100000:3.0:1788572248.068871:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639003904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572248.068878:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00080000:3.0:1788572248.068895:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572248.068917:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935761 gen 2 00000004:00080000:3.0:1788572248.068922:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3ad80, transno 8589935700 00000004:00080000:3.0:1788572248.068928:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3b800, transno 8589935701 00000004:00080000:3.0:1788572248.068930:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3b480, transno 8589935702 00000004:00080000:3.0:1788572248.068933:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc39c00, transno 8589935703 00000004:00080000:3.0:1788572248.068935:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc38380, transno 8589935704 00000004:00080000:3.0:1788572248.068938:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc38e00, transno 8589935705 00000004:00080000:3.0:1788572248.068940:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc39f80, transno 8589935706 00000004:00080000:3.0:1788572248.068942:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc39500, transno 8589935707 00000004:00080000:3.0:1788572248.068945:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f2300, transno 8589935708 00000004:00080000:3.0:1788572248.068947:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f0700, transno 8589935709 00000004:00080000:3.0:1788572248.068949:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f0a80, transno 8589935710 00000004:00080000:3.0:1788572248.068951:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f3b80, transno 8589935711 00000004:00080000:3.0:1788572248.068953:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f1500, transno 8589935712 00000004:00080000:3.0:1788572248.068956:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f3480, transno 8589935713 00000004:00080000:3.0:1788572248.068958:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f0380, transno 8589935714 00000004:00080000:3.0:1788572248.068961:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f2a00, transno 8589935715 00000004:00080000:3.0:1788572248.068963:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f1c00, transno 8589935716 00000004:00080000:3.0:1788572248.068965:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b2d80, transno 8589935717 00000004:00080000:3.0:1788572248.068968:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f3800, transno 8589935718 00000004:00080000:3.0:1788572248.068970:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b1500, transno 8589935719 00000004:00080000:3.0:1788572248.068972:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b1f80, transno 8589935720 00000004:00080000:3.0:1788572248.068974:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b3100, transno 8589935721 00000004:00080000:3.0:1788572248.068976:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f2d80, transno 8589935722 00000004:00080000:3.0:1788572248.068979:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3d500, transno 8589935723 00000004:00080000:3.0:1788572248.068981:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b0000, transno 8589935724 00000004:00080000:3.0:1788572248.068984:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6411ebb80, transno 8589935725 00000004:00080000:3.0:1788572248.068986:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6411eb100, transno 8589935726 00000004:00080000:3.0:1788572248.068988:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6411e9880, transno 8589935727 00000004:00080000:3.0:1788572248.068991:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6411e8700, transno 8589935728 00000004:00080000:3.0:1788572248.068993:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6411eaa00, transno 8589935729 00000004:00080000:3.0:1788572248.068995:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6411ea680, transno 8589935730 00000004:00080000:3.0:1788572248.068998:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b0a80, transno 8589935731 00000004:00080000:3.0:1788572248.069000:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634be8a80, transno 8589935732 00000004:00080000:3.0:1788572248.069023:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634bea680, transno 8589935733 00000004:00080000:3.0:1788572248.069025:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4700, transno 8589935734 00000004:00080000:3.0:1788572248.069028:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3ed80, transno 8589935735 00000004:00080000:3.0:1788572248.069030:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3f480, transno 8589935736 00000004:00080000:3.0:1788572248.069032:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3ce00, transno 8589935737 00000004:00080000:3.0:1788572248.069034:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3c380, transno 8589935738 00000004:00080000:3.0:1788572248.069037:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3df80, transno 8589935739 00000004:00080000:3.0:1788572248.069039:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3dc00, transno 8589935740 00000004:00080000:3.0:1788572248.069041:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f1880, transno 8589935741 00000004:00080000:3.0:1788572248.069221:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f0000, transno 8589935742 00000004:00080000:3.0:1788572248.069225:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b3480, transno 8589935743 00000004:00080000:3.0:1788572248.069228:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f1f80, transno 8589935744 00000004:00080000:3.0:1788572248.069230:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3f800, transno 8589935745 00000004:00080000:3.0:1788572248.069233:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6411e9500, transno 8589935746 00000004:00080000:3.0:1788572248.069236:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f3100, transno 8589935747 00000004:00080000:3.0:1788572248.069238:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b1180, transno 8589935748 00000004:00080000:3.0:1788572248.069241:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184eed80, transno 8589935749 00000004:00080000:3.0:1788572248.069243:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b1880, transno 8589935750 00000004:00080000:3.0:1788572248.069245:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b0e00, transno 8589935751 00000004:00080000:3.0:1788572248.069248:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184ed880, transno 8589935752 00000004:00080000:3.0:1788572248.069250:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3b80, transno 8589935753 00000004:00080000:3.0:1788572248.069252:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f0e00, transno 8589935754 00000004:00080000:3.0:1788572248.069254:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4380, transno 8589935755 00000004:00080000:3.0:1788572248.069257:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac7800, transno 8589935756 00000004:00080000:3.0:1788572248.069259:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f1180, transno 8589935757 00000004:00080000:3.0:1788572248.069261:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3e300, transno 8589935758 00000004:00080000:3.0:1788572248.069263:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3ca80, transno 8589935759 00000004:00080000:3.0:1788572248.069266:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b2680, transno 8589935760 00000004:00080000:3.0:1788572248.069268:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 8589935761 00000100:00100000:3.0:1788572248.069279:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639003904:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788572248.069681:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 62 done 00000100:00100000:0.0:1788572248.069693:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572248.069702:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639004032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572248.069739:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572248.069778:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639004032 00000100:00100000:0.0:1788572248.069782:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639004032 00000100:00100000:0.0:1788572248.069813:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:0.0:1788572248.069821:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639004032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572248.069843:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:0.0:1788572248.069873:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639004032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572248.069879:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:0.0:1788572248.069908:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639004032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572248.074263:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572248.074284:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639004160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572248.074353:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572248.074451:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639004160 00000100:00100000:3.0:1788572248.074458:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639004160 00000100:00100000:3.0:1788572248.074514:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:3.0:1788572248.074522:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639004160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572248.074550:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1788572248.074650:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572248.074775:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639004160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 253us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572248.074782:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:1.0:1788572248.074846:0:3652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968464 gen 2 00000004:00080000:1.0:1788572248.074852:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618700a80, transno 4294968403 00000004:00080000:1.0:1788572248.074864:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618703100, transno 4294968404 00000004:00080000:1.0:1788572248.074866:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618700e00, transno 4294968405 00000004:00080000:1.0:1788572248.074869:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618703800, transno 4294968406 00000004:00080000:1.0:1788572248.074871:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618702a00, transno 4294968407 00000004:00080000:1.0:1788572248.074873:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618700000, transno 4294968408 00000004:00080000:1.0:1788572248.074876:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618702300, transno 4294968409 00000004:00080000:1.0:1788572248.074878:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618701180, transno 4294968410 00000004:00080000:1.0:1788572248.074880:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3d180, transno 4294968411 00000004:00080000:1.0:1788572248.074883:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3e680, transno 4294968412 00000004:00080000:1.0:1788572248.074885:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3d880, transno 4294968413 00000004:00080000:1.0:1788572248.074887:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3c700, transno 4294968414 00000004:00080000:1.0:1788572248.074889:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3f100, transno 4294968415 00000004:00080000:1.0:1788572248.074892:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3fb80, transno 4294968416 00000004:00080000:1.0:1788572248.074894:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b1c00, transno 4294968417 00000004:00080000:1.0:1788572248.074896:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3ea00, transno 4294968418 00000004:00080000:1.0:1788572248.074899:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e5b3800, transno 4294968419 00000004:00080000:1.0:1788572248.074901:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637673b80, transno 4294968420 00000004:00080000:1.0:1788572248.074903:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104a80, transno 4294968421 00000004:00080000:1.0:1788572248.074906:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641105500, transno 4294968422 00000004:00080000:1.0:1788572248.074908:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637673800, transno 4294968423 00000004:00080000:1.0:1788572248.074910:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104000, transno 4294968424 00000004:00080000:1.0:1788572248.074912:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670380, transno 4294968425 00000004:00080000:1.0:1788572248.074915:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641105880, transno 4294968426 00000004:00080000:1.0:1788572248.074917:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641107480, transno 4294968427 00000004:00080000:1.0:1788572248.074919:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641106a00, transno 4294968428 00000004:00080000:1.0:1788572248.074921:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641107100, transno 4294968429 00000004:00080000:1.0:1788572248.074923:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641106680, transno 4294968430 00000004:00080000:1.0:1788572248.074925:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637673480, transno 4294968431 00000004:00080000:1.0:1788572248.074928:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634bea300, transno 4294968432 00000004:00080000:1.0:1788572248.074931:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61ea3c000, transno 4294968433 00000004:00080000:1.0:1788572248.074933:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670000, transno 4294968434 00000004:00080000:1.0:1788572248.074935:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634be9c00, transno 4294968435 00000004:00080000:1.0:1788572248.074938:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d2f1c00, transno 4294968436 00000004:00080000:1.0:1788572248.074940:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670a80, transno 4294968437 00000004:00080000:1.0:1788572248.074942:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637671500, transno 4294968438 00000004:00080000:1.0:1788572248.074944:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670700, transno 4294968439 00000004:00080000:1.0:1788572248.074946:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637670e00, transno 4294968440 00000004:00080000:1.0:1788572248.074949:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e760700, transno 4294968441 00000004:00080000:1.0:1788572248.074951:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e761880, transno 4294968442 00000004:00080000:1.0:1788572248.074953:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637671880, transno 4294968443 00000004:00080000:1.0:1788572248.074955:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e762a00, transno 4294968444 00000004:00080000:1.0:1788572248.074957:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e763100, transno 4294968445 00000004:00080000:1.0:1788572248.074959:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634ad6d80, transno 4294968446 00000004:00080000:1.0:1788572248.074962:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4e00, transno 4294968447 00000004:00080000:1.0:1788572248.074964:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db1f80, transno 4294968448 00000004:00080000:1.0:1788572248.074966:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637595180, transno 4294968449 00000004:00080000:1.0:1788572248.074968:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d2f0e00, transno 4294968450 00000004:00080000:1.0:1788572248.074971:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff6a00, transno 4294968451 00000004:00080000:1.0:1788572248.074973:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637671c00, transno 4294968452 00000004:00080000:1.0:1788572248.074975:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff5180, transno 4294968453 00000004:00080000:1.0:1788572248.074977:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3480, transno 4294968454 00000004:00080000:1.0:1788572248.074980:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff4700, transno 4294968455 00000004:00080000:1.0:1788572248.074982:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104380, transno 4294968456 00000004:00080000:1.0:1788572248.074984:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b0e00, transno 4294968457 00000004:00080000:1.0:1788572248.074986:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641105180, transno 4294968458 00000004:00080000:1.0:1788572248.074989:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b5880, transno 4294968459 00000004:00080000:1.0:1788572248.074991:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a9b0a80, transno 4294968460 00000004:00080000:1.0:1788572248.074993:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641106300, transno 4294968461 00000004:00080000:1.0:1788572248.074996:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490e00, transno 4294968462 00000004:00080000:1.0:1788572248.074999:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641107800, transno 4294968463 00000004:00080000:1.0:1788572248.075020:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618491880, transno 4294968464 00000100:00100000:1.0:1788572248.075030:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639004160:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788572248.075422:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 62 done 00000001:02000400:1.0:1788572248.567152:0:112961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 41: read from a valid osc while other oscs are invalid ========================================================== 21:37:27 (1788572247) 00010000:00010000:3.0:1788572248.771248:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572248.788112:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572248.788187:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615412352 00000100:00100000:2.0:1788572248.788198:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615412352 00000100:00080000:0.0:1788572248.788327:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572248.790448:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12261 00000100:00100000:2.0:1788572248.790461:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:87602:x1875449615412352:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788572248.790482:0:9276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572248.790485:0:9276:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788572248.790511:0:9276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a972c00/0xdb7edb52b832637e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4703c expref: 7 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.790527:0:9276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63acd5f00) 00010000:00010000:2.0:1788572248.790538:0:9276:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572248.790552:0:9276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b83266fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4704a expref: -99 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.790676:0:9276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b8326705 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.790689:0:9276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b8326705 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.790698:0:9276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b8326705 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.790710:0:9276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.790718:0:9276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.790725:0:9276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791162:0:9276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b8326713 lrc: 3/1,0 mode: --/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791174:0:9276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b8326713 lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791181:0:9276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b8326713 lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572248.791191:0:9276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000182d1:0x643:0x0]: returning size 0 00010000:00010000:2.0:1788572248.791218:0:9276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b8326705 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791224:0:9276:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b8326705 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791231:0:9276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b8326705 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791236:0:9276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572248.791240:0:9276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b8326705 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791247:0:9276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b8326705 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791259:0:9276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194e00) 00010000:00010000:2.0:1788572248.791261:0:9276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572248.791265:0:9276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b8326705 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791270:0:9276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b8326705 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788572248.791281:0:9276:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e210ee0 reply state 0000000050d4703b transno 219043332497 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791291:0:9276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791312:0:9276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c0755f3 (ffff94e613194200) 00010000:00010000:2.0:1788572248.791315:0:9276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788572248.791318:0:9276:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788572248.791354:0:9276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702a00/0xdb7edb52b83266fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4704a expref: 9 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791371:0:9276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b8326713 lrc: 3/0,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4704a expref: 8 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.791379:0:9276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x643:0x0].0x0 (ffff94e613194c00) 00010000:00010000:2.0:1788572248.791381:0:9276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572248.791383:0:9276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61e703a00, rc 0) 00000100:00100000:2.0:1788572248.791452:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+9:87602:x1875449615412352:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 995us (3351us total) trans 219043332497 rc 0/0 00000100:00100000:2.0:1788572248.791460:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12261 00000100:00100000:2.0:1788572248.810204:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572248.810362:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615412608 00000100:00100000:3.0:1788572248.810374:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615412608 00000100:00100000:3.0:1788572248.810433:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12262 00000100:00100000:3.0:1788572248.810446:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+9:87602:x1875449615412608:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:3.0:1788572248.810473:0:6551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572248.810500:0:6551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b8326721 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb47051 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572248.810624:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572248.810641:0:6551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b8326713 lrc: 2/0,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4704a expref: 10 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572248.810651:0:6551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 4/0,1 mode: --/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572248.810687:0:6551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b8326713 lrc: 3/0,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4704a expref: 10 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572248.810701:0:6551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b8326713 lrc: 4/0,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4704a expref: 10 pid: 9276 timeout: 4265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572248.810728:0:6551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6551:1875449639004288:192.168.202.13@tcp:104: 00000100:00100000:3.0:1788572248.810817:0:6551:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e5042e9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572248.819441:0:6551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6551:1875449639004288:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788572248.819472:0:6551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572248.820101:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572248.820362:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615412736 00000100:00100000:1.0:1788572248.820371:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615412736 00010000:00010000:1.0:1788572248.820406:0:8491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b8326713 lrc: 4/0,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4704a expref: 11 pid: 9276 timeout: 4265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572248.820451:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 386 00000100:00100000:1.0:1788572248.820460:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+11:2384:x1875449615412736:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572248.820474:0:8491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572248.820481:0:8491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b8326713 lrc: 4/0,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4704a expref: 11 pid: 9276 timeout: 4265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572248.820496:0:8491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b8326713 lrc: 3/0,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4704a expref: 11 pid: 9276 timeout: 4265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572248.820518:0:8491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703a00/0xdb7edb52b8326713 lrc: 0/0,0 mode: --/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4704a expref: 11 pid: 9276 timeout: 4265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572248.820535:0:8491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x643:0x0].0x0 (ffff94e613194c00) 00010000:00010000:1.0:1788572248.820540:0:8491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572248.820551:0:8491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572248.820559:0:8491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 4/0,1 mode: EX/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572248.820588:0:8491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572248.820646:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2384:x1875449615412736:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 187us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572248.820655:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 386 00010000:00010000:2.0:1788572248.820668:0:6551:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.820676:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572248.820697:0:6551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000182d1:0x643:0x0]: returning size 0 00000004:00080000:2.0:1788572248.820826:0:6551:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x992:0x0], count =16 00000004:00080000:2.0:1788572248.820836:0:6551:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x992:0x0]+16 in llog 00000004:00080000:2.0:1788572248.820887:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9a2:0x0], index 0: 0 00010000:00010000:2.0:1788572248.821634:0:6551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.821646:0:6551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.821666:0:6551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.821672:0:6551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572248.821677:0:6551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.821687:0:6551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.821704:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x643:0x0].0x0 (ffff94e613194c00) 00010000:00010000:2.0:1788572248.821708:0:6551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788572248.821712:0:6551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.821718:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b8326728 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.821782:0:6551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b8326721 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47051 expref: 10 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.821793:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e633e14500) 00010000:00010000:2.0:1788572248.821795:0:6551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788572248.821799:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8c00/0xdb7edb52b8326721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47051 expref: 10 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.821816:0:6551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61a3f8c00, rc 0) 00000100:00100000:2.0:1788572248.822055:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+9:87602:x1875449615412608:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 11610us (11860us total) trans 219043332498 rc 301/301 00000100:00100000:2.0:1788572248.822064:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12262 00000100:00100000:2.0:1788572248.824460:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572248.824800:0:6553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615412992 00000100:00100000:1.0:1788572248.824810:0:6553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615412992 00000100:00100000:1.0:1788572248.824870:0:6553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2448 00000100:00100000:1.0:1788572248.824882:0:6553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+9:87602:x1875449615412992:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:1.0:1788572248.825222:0:6553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+10:87602:x1875449615412992:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 340us (769us total) trans 219043332499 rc 0/0 00000100:00100000:1.0:1788572248.825230:0:6553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2448 00000100:00100000:3.0:1788572248.832621:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572248.832934:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615413120 00000100:00100000:0.0:1788572248.832946:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615413120 00000100:00100000:0.0:1788572248.833041:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12263 00000100:00100000:0.0:1788572248.833054:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+10:87602:x1875449615413120:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788572248.833086:0:95742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572248.833112:0:95742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80000/0xdb7edb52b8326736 lrc: 2/0,0 mode: --/CR res: [0x2000182d1:0x643:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb47058 expref: -99 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.833177:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80000/0xdb7edb52b8326736 lrc: 3/0,0 mode: CR/CR res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47058 expref: 11 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.833193:0:95742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80000/0xdb7edb52b8326736 lrc: 3/0,0 mode: CR/CR res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47058 expref: 11 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.833212:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x643:0x0].0x0 (ffff94e502297c00) 00010000:00010000:0.0:1788572248.833216:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788572248.833220:0:95742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ac80000, rc 0) 00000100:00100000:0.0:1788572248.833283:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+11:87602:x1875449615413120:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 232us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572248.833290:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12263 00000100:00100000:0.0:1788572248.849967:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572248.850045:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615413376 00000100:00100000:2.0:1788572248.850056:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615413376 00000100:00100000:3.0:1788572248.850257:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2449 00000100:00100000:3.0:1788572248.850269:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+11:87602:x1875449615413376:12345-192.168.202.13@tcp:35:lfs.0 00000100:00100000:3.0:1788572248.850520:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+12:87602:x1875449615413376:12345-192.168.202.13@tcp:35:lfs.0 Request processed in 253us (561us total) trans 219043332500 rc 0/0 00000100:00100000:3.0:1788572248.850528:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2449 00000100:00100000:2.0:1788572248.959825:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572248.961695:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615413504 00000100:00100000:0.0:1788572248.961714:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615413504 00000100:00100000:0.0:1788572248.961807:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12264 00000100:00100000:0.0:1788572248.961820:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+12:87616:x1875449615413504:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:0.0:1788572248.961854:0:9276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572248.961887:0:9276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b832673d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4705f expref: -99 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.961993:0:9276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b8326744 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.962082:0:9276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b8326744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.962104:0:9276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b8326744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572248.962169:0:9276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1788572248.962173:0:9276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572248.962226:0:9276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b8326744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.962258:0:9276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b832673d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4705f expref: 14 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.962281:0:9276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b8326744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4705f expref: 13 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.962293:0:9276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297b00) 00010000:00010000:0.0:1788572248.962322:0:9276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572248.962328:0:9276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ac81800, rc 0) 00000100:00100000:0.0:1788572248.962419:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+13:87616:x1875449615413504:12345-192.168.202.13@tcp:101:dd.0 Request processed in 601us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572248.962429:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12264 00000100:00100000:1.0:1788572248.982803:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572248.982933:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615413760 00000100:00100000:2.0:1788572248.982948:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615413760 00000100:00100000:2.0:1788572248.983076:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12265 00000100:00100000:2.0:1788572248.983089:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+13:87616:x1875449615413760:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:2.0:1788572248.983119:0:10390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572248.983124:0:10390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788572248.983164:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81800/0xdb7edb52b8326744 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4705f expref: 13 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.983189:0:10390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e502297b00) 00010000:00010000:2.0:1788572248.983203:0:10390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788572248.983224:0:10390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b832674b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb47066 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.983431:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b8326752 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.983450:0:10390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b8326752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.983469:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b8326752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.983482:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b8326759 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.983490:0:10390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b8326759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.983496:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b8326759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.984714:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8326760 lrc: 3/1,0 mode: --/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.984737:0:10390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8326760 lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.984746:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8326760 lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572248.984762:0:10390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000182d1:0x643:0x0]: returning size 0 00010000:00010000:2.0:1788572248.984879:0:10390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b8326752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.984888:0:10390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b8326752 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.984895:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b8326752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.984901:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572248.984906:0:10390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b8326752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.984915:0:10390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b8326752 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.985363:0:10390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e613194c00) 00010000:00010000:2.0:1788572248.985368:0:10390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572248.985375:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b8326752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.985384:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702200/0xdb7edb52b8326752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.985399:0:10390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b8326759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.985407:0:10390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b8326759 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.985413:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b8326759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.985419:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e703c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572248.985421:0:10390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b8326759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.985428:0:10390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b8326759 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.985436:0:10390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c0755f3 (ffff94e613194200) 00010000:00010000:2.0:1788572248.985439:0:10390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572248.985442:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b8326759 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572248.985448:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703c00/0xdb7edb52b8326759 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572248.990363:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e703e00/0xdb7edb52b832674b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47066 expref: 15 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572248.990420:0:10390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8326760 lrc: 3/0,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47066 expref: 14 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572248.990432:0:10390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x643:0x0].0x0 (ffff94e502297c00) 00010000:00010000:3.0:1788572248.990436:0:10390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788572248.990441:0:10390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61e702e00, rc 0) 00000100:00100000:3.0:1788572248.990657:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+14:87616:x1875449615413760:12345-192.168.202.13@tcp:101:dd.0 Request processed in 7568us (7868us total) trans 219043332501 rc 0/0 00000100:00100000:3.0:1788572248.990668:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12265 00000100:00100000:3.0:1788572248.995787:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572248.996161:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615413888 00000100:00100000:0.0:1788572248.996175:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615413888 00000100:00100000:0.0:1788572248.996290:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12266 00000100:00100000:0.0:1788572248.996316:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+14:87616:x1875449615413888:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:0.0:1788572248.996351:0:95742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572248.996379:0:95742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b832676e lrc: 2/0,0 mode: --/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4706d expref: -99 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.996428:0:95742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b8326775 lrc: 3/1,0 mode: --/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.996448:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b8326775 lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.996466:0:95742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b8326775 lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.996647:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80400/0xdb7edb52b832676e lrc: 0/0,0 mode: --/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4706d expref: 16 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.996671:0:95742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b8326775 lrc: 3/0,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4706d expref: 15 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572248.996682:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x643:0x0].0x0 (ffff94e502297c00) 00010000:00010000:0.0:1788572248.996686:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788572248.996690:0:95742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ac80a00, rc 0) 00000100:00100000:0.0:1788572248.996773:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+15:87616:x1875449615413888:12345-192.168.202.13@tcp:101:dd.0 Request processed in 462us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572248.996782:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12266 00000100:00100000:3.0:1788572249.000973:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572249.002088:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615414144 00000100:00100000:1.0:1788572249.002104:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615414144 00000100:00100000:1.0:1788572249.002191:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12267 00000100:00100000:1.0:1788572249.002203:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+15:87616:x1875449615414144:12345-192.168.202.13@tcp:36:dd.0 00010000:00010000:1.0:1788572249.002280:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572249.002324:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702e00/0xdb7edb52b8326760 lrc: 0/0,0 mode: --/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47066 expref: 15 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572249.002352:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x643:0x0].0x0 (ffff94e502297c00) 00010000:00010000:1.0:1788572249.002359:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572249.003763:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 3/0,1 mode: --/PW res: [0x2000182d1:0x643:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572249.003794:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 3/0,1 mode: PW/PW res: [0x2000182d1:0x643:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572249.003809:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 3/0,1 mode: PW/PW res: [0x2000182d1:0x643:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788572249.003902:0:6552:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 219043332502 00000004:00010000:1.0:1788572249.003972:0:6552:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edd0d7ec reply state 0000000084e24357 transno 219043332503 ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 3/0,1 mode: PW/PW res: [0x2000182d1:0x643:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572249.003988:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 3/0,1 mode: TXN/TXN res: [0x2000182d1:0x643:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572249.003998:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x643:0x0].0x0 (ffff94e502297c00) 00010000:00010000:1.0:1788572249.004644:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572249.004653:0:6552:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572249.004909:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+17:87616:x1875449615414144:12345-192.168.202.13@tcp:36:dd.0 Request processed in 2699us (3943us total) trans 219043332503 rc 0/0 00000100:00100000:1.0:1788572249.004930:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12267 00000020:00080000:1.0:1788572249.004938:0:6552:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788572249.010675:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572249.010763:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615414272 00000100:00100000:0.0:1788572249.010776:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615414272 00000100:00100000:0.0:1788572249.010867:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3403 00000100:00100000:0.0:1788572249.010881:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35eb2d60-2de0-4b00-9815-d5153edd0057+10:87616:x1875449615414272:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:0.0:1788572249.010906:0:43970:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572249.010946:0:43970:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b8326783 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb47074 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572249.010981:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572249.011042:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a2:0x0].0x0 since=4166s v=(0 0) 00010000:00010000:0.0:1788572249.011048:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a2:0x0].0x0 since=0s v=(0 0) 00000100:00080000:2.0:1788572249.011959:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788572249.012241:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b8326783 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47074 expref: 11 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572249.012277:0:43970:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b8326783 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47074 expref: 11 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572249.012306:0:43970:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ac80400, rc 0) 00000100:00100000:0.0:1788572249.012676:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35eb2d60-2de0-4b00-9815-d5153edd0057+11:87616:x1875449615414272:12345-192.168.202.13@tcp:101:dd.0 Request processed in 1796us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572249.012686:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3403 00000100:00100000:3.0:1788572249.015541:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572249.015627:0:42806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615414400 00000100:00100000:2.0:1788572249.015644:0:42806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615414400 00002000:00010000:2.0:1788572249.015709:0:42806:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2466 (0->18446744073709551615) 00002000:00100000:2.0:1788572249.015714:0:42806:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94e63779b480 with x1875449615414400 ext(0->18446744073709551615) 00002000:00010000:2.0:1788572249.015731:0:42806:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94e63779b480. 00000100:00100000:2.0:1788572249.015774:0:42806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 480 00000100:00100000:2.0:1788572249.015786:0:42806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:35eb2d60-2de0-4b00-9815-d5153edd0057+11:2384:x1875449615414400:12345-192.168.202.13@tcp:10:dd.0 00002000:00010000:2.0:1788572249.018562:0:42806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9a2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788572249.018574:0:42806:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x9a2:0x0] updating lvb mtime from disk: 0 -> 1788572249 00002000:00010000:2.0:1788572249.018578:0:42806:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x9a2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788572249.018581:0:42806:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x9a2:0x0] updating lvb ctime from disk: 0 -> 1788572249 00002000:00010000:2.0:1788572249.018583:0:42806:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9a2:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788572249.018695:0:42806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:35eb2d60-2de0-4b00-9815-d5153edd0057+12:2384:x1875449615414400:12345-192.168.202.13@tcp:10:dd.0 Request processed in 2903us (3158us total) trans 8589935762 rc 0/0 00000100:00100000:2.0:1788572249.018709:0:42806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 480 00002000:00010000:2.0:1788572249.018716:0:42806:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/2466 (0->18446744073709551615) 00002000:00100000:2.0:1788572249.018720:0:42806:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94e63779b480 with x1875449615414400 ext(0->18446744073709551615) 00002000:00010000:2.0:1788572249.018728:0:42806:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94e63779b480. 00000100:00100000:3.0:1788572249.022818:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572249.023052:0:6553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615414656 00000100:00100000:0.0:1788572249.023069:0:6553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615414656 00000100:00100000:0.0:1788572249.023154:0:6553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2450 00000100:00100000:0.0:1788572249.023166:0:6553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e640e6a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+17:87616:x1875449615414656:12345-192.168.202.13@tcp:35:dd.0 00000100:00100000:0.0:1788572249.023655:0:6553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e640e6a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+18:87616:x1875449615414656:12345-192.168.202.13@tcp:35:dd.0 Request processed in 489us (852us total) trans 219043332504 rc 0/0 00000100:00100000:0.0:1788572249.023665:0:6553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2450 00000100:00100000:3.0:1788572249.060480:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572249.060970:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615414784 00000100:00100000:0.0:1788572249.060984:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615414784 00000100:00100000:0.0:1788572249.061134:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 281 00000100:00100000:0.0:1788572249.061149:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+9:15204:x1875449615414784:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572249.061172:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00002000:00010000:0.0:1788572249.061198:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x302:0x0] updating lvb size from disk: 0 -> 4 00002000:00010000:0.0:1788572249.061203:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x302:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788572249.061238:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab292159/0xdb7edb52b82ee2f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb3c357 expref: 9 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572249.061280:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x184:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:0.0:1788572249.061283:0:6535:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x184:0x0] updating lvb mtime from disk: 0 -> 1788569511 00002000:00010000:0.0:1788572249.061286:0:6535:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x184:0x0] updating lvb ctime from disk: 0 -> 1788569511 00002000:00010000:0.0:1788572249.061288:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x184:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788572249.061307:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000daa6e83/0xdb7edb52b82e1bf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb3a003 expref: 8 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572249.061331:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x183:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:0.0:1788572249.061334:0:6535:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x183:0x0] updating lvb mtime from disk: 0 -> 1788569511 00002000:00010000:0.0:1788572249.061337:0:6535:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x183:0x0] updating lvb ctime from disk: 0 -> 1788569511 00002000:00010000:0.0:1788572249.061339:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x183:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788572249.061348:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c2a1869/0xdb7edb52b82e1b80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb39fd9 expref: 7 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788572249.061366:0:6535:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x182:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:0.0:1788572249.061369:0:6535:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x182:0x0] updating lvb mtime from disk: 0 -> 1788569510 00002000:00010000:0.0:1788572249.061372:0:6535:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x182:0x0] updating lvb ctime from disk: 0 -> 1788569510 00002000:00010000:0.0:1788572249.061375:0:6535:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x182:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788572249.061383:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a3142fc/0xdb7edb52b82e1b10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x182:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb39faf expref: 6 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572249.061403:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1788572249.061668:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572249.061839:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+5:15204:x1875449615414784:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 693us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572249.061850:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 281 00000100:00100000:0.0:1788572249.066699:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572249.066806:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615414912 00000100:00100000:2.0:1788572249.066820:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615414912 00002000:00100000:2.0:1788572249.066883:0:8470:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a2:0x0] (0->4095) req@ffff94e506550e00 x1875449615414912/t0(0) o4->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:665/0 lens 4584/0 e 0 to 0 dl 1788572260 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788572249.066910:0:8470:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94e506550e00 with x1875449615414912 ext(0->4095) 00002000:00010000:2.0:1788572249.066924:0:8470:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94e506550e00 00000100:00100000:2.0:1788572249.066963:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 481 00000100:00100000:2.0:1788572249.066974:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+12:2384:x1875449615414912:12345-192.168.202.13@tcp:4:dd.0 00000100:00100000:2.0:1788572249.070472:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+14:2384:x1875449615414912:12345-192.168.202.13@tcp:4:dd.0 Request processed in 3480us (3770us total) trans 8589935763 rc 0/0 00000100:00100000:2.0:1788572249.070491:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 481 00002000:00100000:2.0:1788572249.070508:0:8470:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a2:0x0] (0->4095) req@ffff94e506550e00 x1875449615414912/t8589935763(0) o4->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:665/0 lens 4584/448 e 0 to 0 dl 1788572260 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788572249.070526:0:8470:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94e506550e00 with x1875449615414912 ext(0->4095) 00002000:00010000:2.0:1788572249.070535:0:8470:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94e506550e00 00000100:00100000:0.0:1788572249.077404:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572249.077693:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615415040 00000100:00100000:1.0:1788572249.077707:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615415040 00000100:00100000:1.0:1788572249.077793:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 282 00000100:00100000:1.0:1788572249.077805:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+14:33423:x1875449615415040:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788572249.077826:0:43971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 6 locks, starting at 0 00002000:00010000:1.0:1788572249.077852:0:43971:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x402:0x0] updating lvb size from disk: 0 -> 4 00002000:00010000:1.0:1788572249.077856:0:43971:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x402:0x0] updating lvb mtime from disk: 1788570669 -> 1788570670 00002000:00010000:1.0:1788572249.077859:0:43971:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x402:0x0] updating lvb atime from disk: 0 -> 1788570670 00002000:00010000:1.0:1788572249.077861:0:43971:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x402:0x0] updating lvb ctime from disk: 1788570669 -> 1788570670 00002000:00010000:1.0:1788572249.077864:0:43971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x402:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788572249.078267:0:43971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a250efa/0xdb7edb52b82f10d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x402:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb3c747 expref: 14 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572249.078325:0:43971:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb size from disk: 0 -> 4 00002000:00010000:1.0:1788572249.078328:0:43971:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb mtime from disk: 0 -> 1788570136 00002000:00010000:1.0:1788572249.078330:0:43971:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb atime from disk: 0 -> 1788570136 00002000:00010000:1.0:1788572249.078333:0:43971:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb ctime from disk: 0 -> 1788570136 00002000:00010000:1.0:1788572249.078335:0:43971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788572249.078347:0:43971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b59fa070/0xdb7edb52b82ee3e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb3c396 expref: 13 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572249.078369:0:43971:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x184:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:1.0:1788572249.078372:0:43971:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x184:0x0] updating lvb mtime from disk: 0 -> 1788569511 00002000:00010000:1.0:1788572249.078374:0:43971:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x184:0x0] updating lvb ctime from disk: 0 -> 1788569511 00002000:00010000:1.0:1788572249.078377:0:43971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x184:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788572249.078384:0:43971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000447bb0cf/0xdb7edb52b82e1c28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb3a018 expref: 12 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572249.078405:0:43971:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x183:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:1.0:1788572249.078408:0:43971:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x183:0x0] updating lvb mtime from disk: 0 -> 1788569511 00002000:00010000:1.0:1788572249.078410:0:43971:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x183:0x0] updating lvb ctime from disk: 0 -> 1788569511 00002000:00010000:1.0:1788572249.078413:0:43971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x183:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788572249.078420:0:43971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d2eb006/0xdb7edb52b82e1bb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x183:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb39fee expref: 11 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572249.078439:0:43971:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x182:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:1.0:1788572249.078442:0:43971:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x182:0x0] updating lvb mtime from disk: 0 -> 1788569510 00002000:00010000:1.0:1788572249.078445:0:43971:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x182:0x0] updating lvb ctime from disk: 0 -> 1788569510 00002000:00010000:1.0:1788572249.078447:0:43971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x182:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788572249.078454:0:43971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f4a2c49/0xdb7edb52b82e1b48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x182:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb39fc4 expref: 10 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572249.078472:0:43971:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x9a2:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1788572249.078475:0:43971:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x9a2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788572249.078481:0:43971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3e9ee1/0xdb7edb52b8326783 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47074 expref: 9 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572249.078497:0:43971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572249.078811:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+8:33423:x1875449615415040:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 1006us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572249.078823:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 282 00000100:00100000:0.0:1788572249.094750:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639004416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572249.094849:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572249.095190:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639004416 00000100:00100000:3.0:1788572249.095201:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639004416 00000100:00100000:3.0:1788572249.095290:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00100000:3.0:1788572249.095312:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639004416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572249.095346:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484879296 pending 28672 free 3923480576 avail 3691958272 00000100:00100000:3.0:1788572249.095420:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639004416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572249.095428:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00000100:00080000:2.0:1788572249.095533:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572249.095617:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639004416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572249.617372:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639004544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572249.617487:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572249.617561:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639004544 00000100:00100000:0.0:1788572249.617571:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639004544 00000100:00100000:0.0:1788572249.617635:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:0.0:1788572249.617659:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d80f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639004544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572249.617707:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572249.617736:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639004672:0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.617759:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d80f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639004544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572249.617766:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00100000:1.0:1788572249.617772:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572249.617804:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639005184:0@lo:400:kworker.0 00000100:00100000:1.0:1788572249.617829:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572249.617847:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639005696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572249.617867:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572249.617885:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788572249.617890:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639004800:0@lo:400:kworker.0 00000100:00100000:1.0:1788572249.617910:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572249.617924:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639005312:0@lo:400:kworker.0 00000100:00100000:1.0:1788572249.617956:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572249.617970:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639005824:0@lo:400:kworker.0 00000100:00100000:1.0:1788572249.617988:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572249.618033:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639005184 00000100:00100000:1.0:1788572249.618037:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639005184 00000100:00100000:1.0:1788572249.618080:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4426 00000100:00100000:1.0:1788572249.618086:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639005184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572249.618121:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639005184:12345-0@lo:400:kworker.0 Request processed in 35us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572249.618127:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4426 00000100:00100000:0.0:1788572249.618158:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639004800 00000100:00100000:0.0:1788572249.618162:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639004800 00000100:00100000:1.0:1788572249.618171:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639005184:0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618185:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:0.0:1788572249.618190:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639004800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618228:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639004800:12345-0@lo:400:kworker.0 Request processed in 37us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572249.618238:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:0.0:1788572249.618268:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639004672 00000100:00100000:0.0:1788572249.618272:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639004672 00000100:00100000:0.0:1788572249.618313:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788572249.618320:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639004672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618351:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639004672:12345-0@lo:400:kworker.0 Request processed in 33us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572249.618358:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788572249.618395:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639004928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618422:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572249.618447:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639005440:0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618468:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572249.618485:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639005952:0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618506:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572249.618525:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788572249.618530:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639005056:0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618552:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572249.618569:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639005568:0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618587:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572249.618608:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639004928 00000100:00100000:0.0:1788572249.618611:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639004928 00000100:00100000:0.0:1788572249.618632:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639005440 00000100:00100000:0.0:1788572249.618634:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639005440 00000100:00100000:0.0:1788572249.618647:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639005952 00000100:00100000:0.0:1788572249.618649:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639005952 00000100:00100000:0.0:1788572249.618658:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639005056 00000100:00100000:0.0:1788572249.618661:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639005056 00000100:00100000:0.0:1788572249.618671:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639005568 00000100:00100000:0.0:1788572249.618672:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639005568 00000100:00100000:0.0:1788572249.618684:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4427 00000100:00100000:0.0:1788572249.618690:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639004928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618719:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639004928:12345-0@lo:400:kworker.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572249.618726:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4427 00000100:00100000:0.0:1788572249.618736:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4428 00000100:00100000:0.0:1788572249.618741:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639005440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618761:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639005440:12345-0@lo:400:kworker.0 Request processed in 20us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572249.618766:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4428 00000100:00100000:0.0:1788572249.618775:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4429 00000100:00100000:0.0:1788572249.618779:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639005952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618798:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639005952:12345-0@lo:400:kworker.0 Request processed in 19us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572249.618803:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4429 00000100:00100000:0.0:1788572249.618811:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4430 00000100:00100000:0.0:1788572249.618816:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639005056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618834:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639005056:12345-0@lo:400:kworker.0 Request processed in 19us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572249.618840:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4430 00000100:00100000:0.0:1788572249.618848:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4431 00000100:00100000:0.0:1788572249.618853:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639005568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618871:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639005568:12345-0@lo:400:kworker.0 Request processed in 18us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572249.618877:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4431 00000100:00100000:0.0:1788572249.618910:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639004544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572249.618931:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639005056:0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618939:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639005568:0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618948:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639004928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618956:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639005440:0@lo:400:kworker.0 00000100:00100000:0.0:1788572249.618964:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639005952:0@lo:400:kworker.0 00000100:00100000:2.0:1788572249.619452:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639005696 00000100:00100000:1.0:1788572249.619453:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639004800:0@lo:400:kworker.0 00000100:00100000:2.0:1788572249.619457:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639005696 00000100:00100000:1.0:1788572249.619464:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639004672:0@lo:400:kworker.0 00000100:00100000:2.0:1788572249.619492:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639005312 00000100:00100000:2.0:1788572249.619495:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639005312 00000100:00100000:2.0:1788572249.619529:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639005824 00000100:00100000:2.0:1788572249.619533:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639005824 00000100:00100000:2.0:1788572249.619555:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3629 00000100:00100000:2.0:1788572249.619562:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639005696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572249.619619:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639005696:12345-0@lo:400:kworker.0 Request processed in 58us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572249.619626:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3629 00000100:00100000:2.0:1788572249.619652:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3630 00000100:00100000:2.0:1788572249.619660:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639005312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572249.619664:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3631 00000100:00100000:1.0:1788572249.619671:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639005824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572249.619688:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639005312:12345-0@lo:400:kworker.0 Request processed in 30us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572249.619693:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3630 00000100:00100000:1.0:1788572249.619701:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639005824:12345-0@lo:400:kworker.0 Request processed in 31us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572249.619707:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3631 00000100:00080000:2.0:1788572249.619717:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572249.619722:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572249.619725:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572249.619767:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639005312:0@lo:400:kworker.0 00000100:00100000:2.0:1788572249.619779:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639005824:0@lo:400:kworker.0 00000100:00100000:2.0:1788572249.619789:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639005696:0@lo:400:kworker.0 00010000:00010000:3.0:1788572249.797951:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572250.018412:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572250.018471:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572250.018506:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572250.018533:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572250.018565:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572250.018602:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615415680 00000100:00100000:3.0:1788572250.018615:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615415680 00000100:00100000:3.0:1788572250.018685:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615415552 00000100:00100000:3.0:1788572250.018689:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615415552 00000100:00100000:3.0:1788572250.018716:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3632 00000100:00100000:3.0:1788572250.018729:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449615415680:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572250.018834:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449615415680:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 107us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572250.018843:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3632 00000100:00100000:3.0:1788572250.018864:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3633 00000100:00100000:3.0:1788572250.018871:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+8:2385:x1875449615415552:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572250.018918:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+8:2385:x1875449615415552:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 48us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572250.018925:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3633 00000100:00100000:3.0:1788572250.018949:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615415424 00000100:00100000:3.0:1788572250.018953:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615415424 00000100:00100000:3.0:1788572250.018999:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615415296 00000100:00100000:3.0:1788572250.019036:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615415296 00000100:00100000:3.0:1788572250.019065:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4432 00000100:00100000:3.0:1788572250.019073:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449615415424:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572250.019103:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449615415424:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 31us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572250.019109:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4432 00000100:00100000:3.0:1788572250.019122:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4433 00000100:00100000:3.0:1788572250.019128:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+18:2385:x1875449615415296:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572250.019158:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+18:2385:x1875449615415296:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572250.019164:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4433 00000100:00080000:3.0:1788572250.019340:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572250.019345:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572250.019441:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615415168 00000100:00100000:1.0:1788572250.019446:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615415168 00000100:00100000:1.0:1788572250.019490:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 87 00000100:00100000:1.0:1788572250.019498:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50330ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449615415168:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572250.019534:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50330ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449615415168:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 38us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572250.019542:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 87 00000100:00100000:2.0:1788572250.115448:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572250.115483:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639006080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572250.115584:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572250.115834:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639006080 00000100:00100000:1.0:1788572250.115849:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639006080 00000100:00100000:1.0:1788572250.115963:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00100000:1.0:1788572250.115976:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639006080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572250.116044:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572250.116116:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639006080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 142us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572250.116125:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00000100:00100000:2.0:1788572250.116210:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639006080:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788572250.822357:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572251.845404:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572252.053751:0:113058:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=4240666a len=0 uarg=00007ffec707cb30 00000004:00000080:0.0:1788572252.053781:0:113058:0:(osp_dev.c:1694:osp_iocontrol()) lustre-OST0001-osc-MDT0000: cmd=4240666a len=576 karg=ffff94e64128c800 uarg=0000000000000000 00000100:02000400:0.0:1788572252.053789:0:113058:0:(recover.c:249:ptlrpc_set_import_active()) setting import lustre-OST0001_UUID INACTIVE by administrator request 00000100:00080000:0.0:1788572252.064817:0:113058:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788572252.064829:0:113058:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968464 gen 3 00000004:00080000:0.0:1788572252.064892:0:113058:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788572252.064897:0:113058:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788572252.218958:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572252.219076:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615415808 00000100:00100000:1.0:1788572252.219095:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615415808 00000100:00100000:1.0:1788572252.219318:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12268 00000100:00100000:1.0:1788572252.219341:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+18:87653:x1875449615415808:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:1.0:1788572252.219372:0:6550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572252.219406:0:6550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b832678a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4707b expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572252.219511:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8326791 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572252.219528:0:6550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8326791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572252.219544:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8326791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572252.219607:0:6550:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572252.219613:0:6550:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572252.219639:0:6550:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8326791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572252.219669:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c600/0xdb7edb52b832678a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4707b expref: 20 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572252.219693:0:6550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0de00/0xdb7edb52b8326791 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4707b expref: 19 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572252.219703:0:6550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e618898e00) 00010000:00010000:1.0:1788572252.219707:0:6550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572252.219712:0:6550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e605d0de00, rc 0) 00000100:00100000:1.0:1788572252.219813:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+19:87653:x1875449615415808:12345-192.168.202.13@tcp:101:dd.0 Request processed in 484us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572252.219821:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12268 00000100:00080000:3.0:1788572252.225418:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572252.233492:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572252.234554:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615416064 00000100:00100000:0.0:1788572252.234568:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615416064 00000100:00100000:0.0:1788572252.234651:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12269 00000100:00100000:0.0:1788572252.234664:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+19:87653:x1875449615416064:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:0.0:1788572252.234698:0:10390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572252.234729:0:10390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81000/0xdb7edb52b8326798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb47082 expref: -99 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.234841:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b832679f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.234863:0:10390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b832679f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.234881:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b832679f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.234895:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b83267a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.234904:0:10390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b83267a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.234910:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b83267a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235133:0:10390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b83267ad lrc: 3/1,0 mode: --/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235143:0:10390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b83267ad lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235150:0:10390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b83267ad lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572252.235162:0:10390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000182d1:0x643:0x0]: returning size 4096 00010000:00010000:0.0:1788572252.235265:0:10390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b832679f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235284:0:10390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b832679f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235291:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b832679f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235299:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572252.235304:0:10390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b832679f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235313:0:10390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b832679f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235328:0:10390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e618898e00) 00010000:00010000:0.0:1788572252.235344:0:10390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572252.235351:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b832679f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235358:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81600/0xdb7edb52b832679f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235371:0:10390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b83267a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235376:0:10390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b83267a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235382:0:10390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b83267a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235386:0:10390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572252.235389:0:10390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b83267a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235394:0:10390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b83267a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235404:0:10390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c0755f3 (ffff94e613194200) 00010000:00010000:0.0:1788572252.235406:0:10390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572252.235409:0:10390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b83267a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235414:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81c00/0xdb7edb52b83267a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235462:0:10390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81000/0xdb7edb52b8326798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47082 expref: 22 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235477:0:10390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b83267ad lrc: 3/0,0 mode: PR/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47082 expref: 21 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572252.235484:0:10390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x643:0x0].0x0 (ffff94e502297c00) 00010000:00010000:0.0:1788572252.235487:0:10390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788572252.235489:0:10390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ac80200, rc 0) 00000100:00100000:0.0:1788572252.235581:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+21:87653:x1875449615416064:12345-192.168.202.13@tcp:101:dd.0 Request processed in 919us (2100us total) trans 219043332505 rc 0/0 00000100:00100000:0.0:1788572252.235590:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12269 00000100:00100000:1.0:1788572252.252588:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572252.253361:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615416192 00000100:00100000:3.0:1788572252.253377:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615416192 00000100:00100000:3.0:1788572252.253471:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3404 00000100:00100000:3.0:1788572252.253487:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+8:87653:x1875449615416192:12345-192.168.202.13@tcp:101:dd.0 00010000:00010000:3.0:1788572252.253522:0:43975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572252.253551:0:43975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003da7d80a/0xdb7edb52b83267bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb47089 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572252.253584:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a2:0x0] initial LVB size: 4096, mtime: 0x6a9b7259, atime: 0x0, ctime: 0x6a9b7259, blocks: 0x8 00010000:00010000:3.0:1788572252.253613:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a2:0x0].0x0 since=4169s v=(0 0) 00010000:00010000:3.0:1788572252.253620:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572252.253633:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003da7d80a/0xdb7edb52b83267bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47089 expref: 9 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572252.253656:0:43975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003da7d80a/0xdb7edb52b83267bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47089 expref: 9 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572252.253673:0:43975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61a3f9800, rc 0) 00000100:00100000:3.0:1788572252.253755:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+9:87653:x1875449615416192:12345-192.168.202.13@tcp:101:dd.0 Request processed in 273us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572252.253762:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3404 00000100:00080000:0.0:1788572252.254120:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572252.263853:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572252.265093:0:42799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615416320 00000100:00100000:0.0:1788572252.265111:0:42799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615416320 00002000:00100000:0.0:1788572252.265335:0:42799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a2:0x0] (0->4095) req@ffff94e506551c00 x1875449615416320/t0(0) o3->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:668/0 lens 488/0 e 0 to 0 dl 1788572263 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788572252.265348:0:42799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94e506551c00 with x1875449615416320 ext(0->4095) 00002000:00010000:0.0:1788572252.265356:0:42799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94e506551c00 00000100:00100000:0.0:1788572252.265397:0:42799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 482 00000100:00100000:0.0:1788572252.265408:0:42799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2384:x1875449615416320:12345-192.168.202.13@tcp:3:dd.0 00000100:00100000:0.0:1788572252.267123:0:42799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2384:x1875449615416320:12345-192.168.202.13@tcp:3:dd.0 Request processed in 1112us (2684us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788572252.267139:0:42799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 482 00002000:00100000:0.0:1788572252.267154:0:42799:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a2:0x0] (0->4095) req@ffff94e506551c00 x1875449615416320/t0(0) o3->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:668/0 lens 488/4536 e 0 to 0 dl 1788572263 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788572252.267165:0:42799:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94e506551c00 with x1875449615416320 ext(0->4095) 00002000:00010000:0.0:1788572252.267173:0:42799:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94e506551c00 00000100:00100000:0.0:1788572252.275875:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572252.275927:0:6554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615416576 00000100:00100000:0.0:1788572252.275940:0:6554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615416576 00000100:00100000:0.0:1788572252.276039:0:6554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2451 00000100:00100000:0.0:1788572252.276055:0:6554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+21:87653:x1875449615416576:12345-192.168.202.13@tcp:35:dd.0 00000100:00100000:0.0:1788572252.280665:0:6554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+22:87653:x1875449615416576:12345-192.168.202.13@tcp:35:dd.0 Request processed in 4597us (4789us total) trans 219043332506 rc 0/0 00000100:00100000:0.0:1788572252.280684:0:6554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2451 00010000:00010000:1.0:1788572252.869595:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572253.187251:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639006336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572253.187367:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572253.187457:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572253.187467:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639006208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572253.187486:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639006336 00000100:00100000:3.0:1788572253.187498:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639006336 00000100:00100000:0.0:1788572253.187504:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572253.187567:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639006208 00000100:00100000:0.0:1788572253.187574:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639006208 00000100:00100000:3.0:1788572253.187599:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796 00000100:00100000:3.0:1788572253.187615:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639006336:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572253.187633:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:0.0:1788572253.187643:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639006208:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:3.0:1788572253.187663:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484879296 pending 28672 free 3923476480 avail 3691954176 00000004:00000024:0.0:1788572253.187683:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572253.187773:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639006336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572253.187782:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796 00000100:00080000:3.0:1788572253.187807:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572253.191162:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639006208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3505us (3642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572253.191182:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:3.0:1788572253.192053:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639006208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572253.192080:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639006336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572253.192218:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572253.192243:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:0:1875449639006464:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1788572253.332921:0:113106:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=4240666a len=0 uarg=00007fffba798220 00000004:00000080:3.0:1788572253.332945:0:113106:0:(osp_dev.c:1694:osp_iocontrol()) lustre-OST0001-osc-MDT0000: cmd=4240666a len=576 karg=ffff94e634b5cc00 uarg=0000000000000000 00000100:00080000:3.0:1788572253.332952:0:113106:0:(recover.c:264:ptlrpc_set_import_active()) setting import lustre-OST0001_UUID VALID 00000100:00080000:3.0:1788572253.332957:0:113106:0:(import.c:65:import_set_state_nolock()) ffff94e63ae1a800 lustre-OST0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788572253.332965:0:113106:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1788572253.333245:0:113106:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1788572253.333250:0:113106:0:(import.c:65:import_set_state_nolock()) ffff94e63ae1a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572253.333255:0:113106:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4125 00000100:00080000:3.0:1788572253.333277:0:113106:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94e63ae1a800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788572253.333328:0:113106:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e634ad6d80 x1875449639006592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572253.333407:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639006592:0@lo:8:lctl.0 00000100:00100000:1.0:1788572253.333503:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572253.333603:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639006592 00000100:00100000:2.0:1788572253.333614:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639006592 00000100:00100000:2.0:1788572253.333690:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3634 00000100:00100000:2.0:1788572253.333700:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3649:x1875449639006592:12345-0@lo:8:lctl.0 00010000:02000400:2.0:1788572253.333739:0:43976:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-OST0001: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting 00010000:00080000:2.0:1788572253.337151:0:43976:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp ffff94e641362000 cur 4170 last 1788572253 00002000:00100000:2.0:1788572253.337187:0:43976:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94e641362000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788572253.337193:0:43976:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788572253.337198:0:43976:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli 0@lo does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1788572253.337221:0:43976:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1788572253.337233:0:43976:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788572253.337468:0:113106:0:(recover.c:337:ptlrpc_recover_import()) lustre-OST0001_UUID: recovery started, waiting 20 seconds 00000100:00080000:3.0:1788572253.337549:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572253.340785:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3649:x1875449639006592:12345-0@lo:8:lctl.0 Request processed in 7072us (7268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572253.340804:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3634 00000100:00080000:1.0:1788572253.342440:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788572253.342469:0:3649:0:(import.c:1341:ptlrpc_connect_interpret()) reconnected to lustre-OST0001_UUID@0@lo after partition 00000100:00080000:1.0:1788572253.342472:0:3649:0:(import.c:1346:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: reconnected but import is invalid; marking evicted 00000100:00080000:1.0:1788572253.342476:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e63ae1a800 lustre-OST0001_UUID: changing import state from CONNECTING to EVICTED 00000100:02020000:1.0:1788572253.342484:0:3649:0:(import.c:1707:ptlrpc_import_recovery_state_machine()) lustre-OST0001-osc-MDT0000: This client was evicted by lustre-OST0001; in progress operations using this service will fail. 00000100:00080000:1.0:1788572253.352795:0:3649:0:(import.c:1718:ptlrpc_import_recovery_state_machine()) evicted from lustre-OST0001_UUID@0@lo; invalidating 00000100:00100000:1.0:1788572253.353326:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639006592:0@lo:8:lctl.0 00000100:00080000:3.0:1788572253.353420:0:113107:0:(import.c:1642:ptlrpc_invalidate_import_thread()) thread invalidate import lustre-OST0001-osc-MDT0000 to lustre-OST0001_UUID@0@lo 00000100:00100000:3.0:1788572253.353426:0:113107:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788572253.353500:0:113107:0:(import.c:65:import_set_state_nolock()) ffff94e63ae1a800 lustre-OST0001_UUID: changing import state from EVICTED to RECOVER 00000100:00080000:3.0:1788572253.353629:0:113107:0:(import.c:65:import_set_state_nolock()) ffff94e63ae1a800 lustre-OST0001_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1788572253.353649:0:113107:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1788572253.353653:0:113107:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-OST0001-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788572253.353866:0:112001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:112001:1875449639006848:0@lo:7:osp-pre-1-0.0 00000100:00100000:1.0:1788572253.353953:0:112001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572253.353993:0:112001:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e64129be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572253.354091:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639006848 00000100:00100000:2.0:1788572253.354101:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639006848 00000100:00100000:2.0:1788572253.354172:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3405 00000100:00100000:2.0:1788572253.354184:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:112001:x1875449639006848:12345-0@lo:7:osp-pre-1-0.0 00002000:00080000:2.0:1788572253.354215:0:8466:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000401:0x9c1:0x0] 00000100:00100000:2.0:1788572253.354280:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:112001:x1875449639006848:12345-0@lo:7:osp-pre-1-0.0 Request processed in 97us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572253.354291:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3405 00000100:00080000:2.0:1788572253.354321:0:113106:0:(recover.c:348:ptlrpc_recover_import()) lustre-OST0001_UUID: recovery finished FULL, rc = 0 00000100:00100000:1.0:1788572253.354521:0:112001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:112001:1875449639006848:0@lo:7:osp-pre-1-0.0 00000004:00080000:1.0:1788572253.354534:0:112001:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x2c0000401:0x9c1:0x0] 00000100:00100000:3.0:1788572253.355546:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639006720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572253.355611:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572253.355672:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639006720 00000100:00100000:3.0:1788572253.355678:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639006720 00000100:00100000:3.0:1788572253.355727:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:3.0:1788572253.355736:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639006720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572253.355770:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572253.355812:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639006720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572253.355823:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00100000:3.0:1788572253.355872:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639006720:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788572253.721280:0:111978:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 219043332506 is committed 00010000:00010000:0.0:1788572253.721345:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721359:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721369:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721376:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e702600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572253.721383:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721393:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721416:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c0755f3 (ffff94e613194200) 00010000:00010000:0.0:1788572253.721420:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572253.721427:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721434:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e702600/0xdb7edb52b832670c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1c0755f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721471:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 3/0,1 mode: TXN/TXN res: [0x2000182d1:0x643:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721478:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 2/0,0 mode: TXN/TXN res: [0x2000182d1:0x643:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721485:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 3/0,0 mode: TXN/TXN res: [0x2000182d1:0x643:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721491:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0c400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572253.721494:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 3/0,0 mode: TXN/TXN res: [0x2000182d1:0x643:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721500:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 4/0,0 mode: TXN/TXN res: [0x2000182d1:0x643:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721521:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x643:0x0].0x0 (ffff94e502297c00) 00010000:00010000:0.0:1788572253.721524:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572253.721527:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 2/0,0 mode: --/TXN res: [0x2000182d1:0x643:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572253.721533:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0c400/0xdb7edb52b832677c lrc: 0/0,0 mode: --/TXN res: [0x2000182d1:0x643:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572253.891434:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572254.218124:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639006976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572254.218226:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572254.218994:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639006976 00000100:00100000:2.0:1788572254.219033:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639006976 00000100:00100000:2.0:1788572254.219132:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:2.0:1788572254.219145:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639006976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572254.219178:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484879296 pending 28672 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572254.219266:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639006976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572254.219274:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:2.0:1788572254.219339:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639006976:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572254.219571:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572254.724482:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639007104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572254.724561:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572254.724693:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639007104 00000100:00100000:0.0:1788572254.724702:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639007104 00000100:00100000:0.0:1788572254.724758:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:0.0:1788572254.724768:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639007104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572254.724804:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572254.724861:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639007104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572254.724868:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:0.0:1788572254.724917:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639007104:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1788572254.729596:0:16234:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589935763 is committed 00000100:00100000:0.0:1788572254.730974:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639007360:0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.731063:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639007232:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.731083:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572254.731142:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639007872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.731153:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572254.731191:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572254.731216:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639007744:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.731236:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639008384:0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.731272:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572254.731289:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572254.731310:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639008256:0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.731350:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572254.731361:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639007360 00000100:00100000:0.0:1788572254.731370:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639007360 00000100:00100000:3.0:1788572254.731409:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639007232 00000100:00100000:0.0:1788572254.731426:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:3.0:1788572254.731431:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639007232 00000100:00100000:0.0:1788572254.731438:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639007360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.731511:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639007360:12345-0@lo:400:kworker.0 Request processed in 75us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572254.731519:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788572254.731526:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:3.0:1788572254.731534:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50330d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639007232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.731559:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639007872 00000100:00100000:0.0:1788572254.731566:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639007872 00000100:00100000:3.0:1788572254.731604:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50330d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639007232:12345-0@lo:400:kworker.0 Request processed in 73us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572254.731615:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788572254.731620:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639008384 00000100:00100000:0.0:1788572254.731625:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639008384 00000100:00100000:0.0:1788572254.731656:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639008256 00000100:00100000:0.0:1788572254.731660:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639008256 00000100:00100000:3.0:1788572254.731668:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639007744 00000100:00100000:3.0:1788572254.731675:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639007744 00000100:00100000:0.0:1788572254.731687:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3635 00000100:00100000:0.0:1788572254.731701:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639007872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.731729:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4434 00000100:00100000:3.0:1788572254.731743:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639007744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.731754:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639007872:12345-0@lo:400:kworker.0 Request processed in 57us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572254.731765:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3635 00000100:00100000:0.0:1788572254.731788:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3636 00000100:00100000:3.0:1788572254.731805:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639007744:12345-0@lo:400:kworker.0 Request processed in 60us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572254.731806:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639008384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.731827:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4434 00000100:00100000:3.0:1788572254.731862:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3637 00000100:00100000:0.0:1788572254.731872:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639008384:12345-0@lo:400:kworker.0 Request processed in 74us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572254.731876:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639008256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.731894:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3636 00000100:00080000:0.0:1788572254.731937:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572254.731940:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639008256:12345-0@lo:400:kworker.0 Request processed in 68us (587us total) trans 0 rc 0/0 00000100:00080000:0.0:1788572254.731944:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572254.731952:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3637 00000100:00100000:0.0:1788572254.731970:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639007616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.732052:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639007232:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732055:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572254.732085:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639007744:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732094:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639008128:0@lo:400:kworker.0 00000100:00100000:3.0:1788572254.732102:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639008256:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732123:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572254.732153:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572254.732164:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639007488:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732186:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572254.732208:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639008000:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732227:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572254.732243:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639008512:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732273:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572254.732301:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639007616 00000100:00100000:0.0:1788572254.732306:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639007616 00000100:00100000:0.0:1788572254.732336:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639008128 00000100:00100000:0.0:1788572254.732339:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639008128 00000100:00100000:0.0:1788572254.732353:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639007488 00000100:00100000:0.0:1788572254.732355:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639007488 00000100:00100000:0.0:1788572254.732364:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639008000 00000100:00100000:0.0:1788572254.732366:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639008000 00000100:00100000:0.0:1788572254.732375:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639008512 00000100:00100000:0.0:1788572254.732377:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639008512 00000100:00100000:0.0:1788572254.732388:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4435 00000100:00100000:0.0:1788572254.732394:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639007616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732429:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639007616:12345-0@lo:400:kworker.0 Request processed in 35us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572254.732436:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4435 00000100:00100000:0.0:1788572254.732449:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4436 00000100:00100000:0.0:1788572254.732456:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639008128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732481:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639008128:12345-0@lo:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572254.732487:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4436 00000100:00100000:0.0:1788572254.732496:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4437 00000100:00100000:0.0:1788572254.732502:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639007488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732524:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639007488:12345-0@lo:400:kworker.0 Request processed in 23us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572254.732530:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4437 00000100:00100000:0.0:1788572254.732539:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4438 00000100:00100000:0.0:1788572254.732544:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639008000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732565:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639008000:12345-0@lo:400:kworker.0 Request processed in 21us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572254.732572:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4438 00000100:00100000:0.0:1788572254.732581:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4439 00000100:00100000:0.0:1788572254.732586:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639008512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732607:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639008512:12345-0@lo:400:kworker.0 Request processed in 22us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572254.732612:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4439 00000100:00080000:0.0:1788572254.732629:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572254.732632:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572254.732660:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639007360:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732673:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639007872:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732682:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639008384:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732710:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639007488:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732720:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639008000:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732728:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639008512:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732737:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639007616:0@lo:400:kworker.0 00000100:00100000:0.0:1788572254.732746:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639008128:0@lo:400:kworker.0 00010000:00010000:2.0:1788572254.915600:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572255.146325:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572255.146370:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572255.146440:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615416704 00000100:00100000:3.0:1788572255.146450:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615416704 00000100:00100000:3.0:1788572255.146521:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 89 00000100:00100000:3.0:1788572255.146532:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50330c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615416704:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572255.146600:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50330c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615416704:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 71us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572255.146608:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 89 00000100:00100000:0.0:1788572255.151419:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572255.151459:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572255.155816:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615417216 00000100:00100000:3.0:1788572255.155835:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615417216 00000100:00100000:3.0:1788572255.155926:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3638 00000100:00100000:3.0:1788572255.155937:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449615417216:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572255.156041:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449615417216:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 105us (4632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572255.156049:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3638 00000100:00080000:0.0:1788572255.161112:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572255.168953:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615416960 00000100:00100000:2.0:1788572255.168970:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615416960 00000100:00100000:2.0:1788572255.169108:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615416832 00000100:00100000:2.0:1788572255.169112:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615416832 00000100:00100000:2.0:1788572255.169150:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4440 00000100:00100000:2.0:1788572255.169159:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615416960:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572255.169258:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615416960:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 99us (22886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572255.169265:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4440 00000100:00100000:2.0:1788572255.169283:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4441 00000100:00100000:2.0:1788572255.169289:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2386:x1875449615416832:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572255.169321:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2386:x1875449615416832:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 32us (17861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572255.169331:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4441 00000100:00100000:2.0:1788572255.169396:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572255.169530:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615417088 00000100:00100000:2.0:1788572255.169534:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615417088 00000100:00100000:2.0:1788572255.169568:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3639 00000100:00100000:2.0:1788572255.169574:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615417088:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572255.169608:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615417088:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 33us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572255.169614:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3639 00000100:00080000:3.0:1788572255.171109:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572255.171118:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572255.171121:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572255.241632:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572255.241665:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639008640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572255.241731:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572255.241860:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639008640 00000100:00100000:3.0:1788572255.241869:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639008640 00000100:00100000:3.0:1788572255.241921:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:3.0:1788572255.241931:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639008640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572255.241962:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572255.242042:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639008640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572255.242049:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00100000:0.0:1788572255.243533:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639008640:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788572255.939117:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572256.978206:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572257.992365:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572258.307274:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572258.307306:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639008768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572258.307398:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572258.307662:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572258.307674:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639008896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572258.307709:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572258.307786:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639008768 00000100:00100000:1.0:1788572258.307794:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639008768 00000100:00100000:1.0:1788572258.307869:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800 00000100:00100000:1.0:1788572258.307879:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639008768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572258.307918:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572258.307965:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639008768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572258.307972:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800 00000100:00080000:1.0:1788572258.308036:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572258.308238:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639008896 00000100:00100000:0.0:1788572258.308243:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639008896 00000100:00100000:0.0:1788572258.308278:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:0.0:1788572258.308286:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639008896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572258.308316:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:0.0:1788572258.308363:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639008896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572258.308370:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00100000:3.0:1788572258.308679:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639008768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572258.308932:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639008896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572258.821236:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639009024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572258.821339:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572258.821449:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639009024 00000100:00100000:2.0:1788572258.821461:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639009024 00000100:00100000:2.0:1788572258.821539:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:2.0:1788572258.821551:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639009024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572258.821590:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572258.821650:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639009024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572258.821657:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00080000:1.0:1788572258.821733:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572258.821786:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639009024:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572259.012419:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572259.331466:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572259.339767:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639009152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572259.339900:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.340571:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639009152 00000100:00100000:2.0:1788572259.340585:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639009152 00000100:00100000:2.0:1788572259.340680:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802 00000100:00100000:2.0:1788572259.340692:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639009152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572259.340727:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572259.340805:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639009152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572259.340813:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802 00000100:00100000:0.0:1788572259.341102:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639009152:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788572259.341329:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572259.847222:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639009408:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.847330:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.847408:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639009920:0@lo:400:kworker.0 00000100:00100000:1.0:1788572259.847431:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639009408 00000100:00100000:1.0:1788572259.847443:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639009408 00000100:00100000:2.0:1788572259.847445:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572259.847505:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:1.0:1788572259.847515:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639009408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572259.847601:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639009408:12345-0@lo:400:kworker.0 Request processed in 88us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572259.847609:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00100000:0.0:1788572259.847783:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639009280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.847831:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572259.847875:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639009792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.848187:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639010432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.848295:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.848361:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639009408:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.848400:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639009536:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.848437:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572259.848454:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639009280 00000100:00100000:1.0:1788572259.848461:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639009280 00000100:00100000:1.0:1788572259.848502:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788572259.848509:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50330f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639009280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572259.857320:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639009920 00000100:00100000:3.0:1788572259.857338:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639009920 00000100:00100000:3.0:1788572259.857403:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639010432 00000100:00100000:3.0:1788572259.857407:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639010432 00000100:00100000:3.0:1788572259.857432:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3640 00000100:00100000:3.0:1788572259.857441:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639009920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572259.857624:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639009536 00000100:00100000:1.0:1788572259.857629:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639009536 00000100:00100000:1.0:1788572259.857660:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4442 00000100:00100000:1.0:1788572259.857667:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639009536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572259.857723:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639009536:12345-0@lo:400:kworker.0 Request processed in 56us (9286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572259.857730:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4442 00000100:00100000:0.0:1788572259.860920:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572259.860984:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639010304:0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.861036:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572259.861055:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639010816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572259.861075:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572259.861139:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639010304 00000100:00100000:0.0:1788572259.861146:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639010304 00000100:00100000:0.0:1788572259.861190:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639010816 00000100:00100000:0.0:1788572259.861193:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639010816 00000100:00100000:0.0:1788572259.861220:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:0.0:1788572259.861230:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639010304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.861295:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639010304:12345-0@lo:400:kworker.0 Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572259.861302:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:0.0:1788572259.861318:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:0.0:1788572259.861325:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639010816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572259.861351:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572259.861380:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639010816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572259.861386:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:0.0:1788572259.861418:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639010304:0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.861431:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639010816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572259.862697:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639009792 00000100:00100000:2.0:1788572259.862714:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639009792 00000100:00100000:2.0:1788572259.862802:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4443 00000100:00100000:2.0:1788572259.862815:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639009792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.863116:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639009792:12345-0@lo:400:kworker.0 Request processed in 305us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572259.863125:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4443 00000100:00100000:2.0:1788572259.863168:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639009664:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.863225:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.863253:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639010176:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.863277:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.863295:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639010688:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.863318:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572259.863364:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3641 00000100:00100000:2.0:1788572259.863375:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639010432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.863420:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639010432:12345-0@lo:400:kworker.0 Request processed in 48us (15125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572259.863436:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3641 00000100:00100000:2.0:1788572259.863814:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639010432:0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.864688:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639009664 00000100:00100000:0.0:1788572259.864705:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639009664 00000100:00100000:0.0:1788572259.864770:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639010176 00000100:00100000:0.0:1788572259.864774:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639010176 00000100:00100000:0.0:1788572259.864794:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639010688 00000100:00100000:0.0:1788572259.864796:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639010688 00000100:00100000:0.0:1788572259.864813:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4444 00000100:00100000:0.0:1788572259.864823:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639009664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.864918:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639009664:12345-0@lo:400:kworker.0 Request processed in 97us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572259.864925:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4444 00000100:00100000:0.0:1788572259.864942:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4445 00000100:00100000:0.0:1788572259.864948:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639010176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.864977:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639010176:12345-0@lo:400:kworker.0 Request processed in 30us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572259.864983:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4445 00000100:00100000:0.0:1788572259.864995:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4446 00000100:00100000:0.0:1788572259.865001:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639010688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.865047:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639010688:12345-0@lo:400:kworker.0 Request processed in 46us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572259.865054:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4446 00000100:00100000:0.0:1788572259.865109:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639009792:0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.865154:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639009664:0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.865166:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639010176:0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.865176:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639010688:0@lo:400:kworker.0 00000100:00100000:3.0:1788572259.866493:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639009920:12345-0@lo:400:kworker.0 Request processed in 9044us (19040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572259.866505:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3640 00000100:00100000:2.0:1788572259.866621:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639009536:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.866639:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6411e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639010048:0@lo:400:kworker.0 00000100:00080000:3.0:1788572259.866727:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572259.866733:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572259.866737:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572259.866788:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639009920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572259.866991:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572259.869749:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639010560:0@lo:400:kworker.0 00000100:00100000:3.0:1788572259.869827:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572259.869876:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639010560 00000100:00100000:3.0:1788572259.869885:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639010560 00000100:00100000:3.0:1788572259.869935:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3642 00000100:00100000:3.0:1788572259.869944:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639010560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572259.869993:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639010560:12345-0@lo:400:kworker.0 Request processed in 50us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572259.870000:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3642 00000100:00100000:3.0:1788572259.870056:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639010560:0@lo:400:kworker.0 00000100:00100000:3.0:1788572259.870126:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50330f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639009280:12345-0@lo:400:kworker.0 Request processed in 21617us (22294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572259.870134:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788572259.872191:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639010048 00000100:00100000:0.0:1788572259.872213:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639010048 00000100:00100000:0.0:1788572259.872565:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4447 00000100:00100000:0.0:1788572259.872577:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639010048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.872660:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639010048:12345-0@lo:400:kworker.0 Request processed in 86us (5670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572259.872667:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4447 00000100:00100000:0.0:1788572259.872716:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639009280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572259.872761:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639010048:0@lo:400:kworker.0 00000100:00080000:3.0:1788572259.872816:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788572260.048223:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572260.263415:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572260.263453:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572260.263472:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572260.263490:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572260.263512:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572260.263539:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615417344 00000100:00100000:0.0:1788572260.263548:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615417344 00000100:00100000:0.0:1788572260.263599:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 91 00000100:00100000:0.0:1788572260.263609:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50330c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449615417344:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572260.263679:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50330c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449615417344:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572260.263687:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 91 00000100:00100000:0.0:1788572260.263718:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615417600 00000100:00100000:0.0:1788572260.263721:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615417600 00000100:00100000:0.0:1788572260.263754:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615417472 00000100:00100000:0.0:1788572260.263757:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615417472 00000100:00100000:0.0:1788572260.263779:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4448 00000100:00100000:0.0:1788572260.263786:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449615417600:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572260.263815:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449615417600:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572260.263822:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4448 00000100:00100000:0.0:1788572260.263835:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4449 00000100:00100000:0.0:1788572260.263841:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2384:x1875449615417472:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572260.263864:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2384:x1875449615417472:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572260.263870:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4449 00000100:00100000:0.0:1788572260.263888:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615417856 00000100:00100000:0.0:1788572260.263892:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615417856 00000100:00100000:0.0:1788572260.263917:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615417728 00000100:00100000:0.0:1788572260.263919:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615417728 00000100:00100000:0.0:1788572260.263938:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3643 00000100:00100000:0.0:1788572260.263945:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449615417856:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572260.263970:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449615417856:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572260.263980:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3643 00000100:00100000:0.0:1788572260.263991:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3644 00000100:00100000:0.0:1788572260.263997:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449615417728:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572260.264040:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449615417728:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 43us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572260.264046:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3644 00000100:00080000:3.0:1788572260.268399:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572260.268406:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572260.268410:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572260.268413:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572260.355458:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572260.355482:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639010944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572260.355552:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572260.356514:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639010944 00000100:00100000:0.0:1788572260.356525:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639010944 00000100:00100000:0.0:1788572260.356586:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:0.0:1788572260.356596:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639010944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572260.356628:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572260.356691:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639010944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572260.356698:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:2.0:1788572260.356867:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639010944:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788572260.746968:0:113302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 42: recovery after ost failure ===== 21:37:39 (1788572259) 00000100:00100000:3.0:1788572260.849295:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572260.849375:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615417984 00000100:00100000:1.0:1788572260.849386:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615417984 00000100:00100000:1.0:1788572260.849449:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 12270 00000100:00100000:1.0:1788572260.849460:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+10:88240:x1875449615417984:12345-192.168.202.13@tcp:41:df.0 00000004:00000024:1.0:1788572260.849513:0:6551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846981632 avail 7383937024 00000100:00100000:1.0:1788572260.849608:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+10:88240:x1875449615417984:12345-192.168.202.13@tcp:41:df.0 Request processed in 150us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572260.849616:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 12270 00010000:00010000:0.0:1788572261.061386:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572262.084364:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572263.109220:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572263.427390:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572263.427420:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639011072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572263.427503:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572263.427906:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639011072 00000100:00100000:0.0:1788572263.427914:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639011072 00000100:00100000:0.0:1788572263.427980:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:0.0:1788572263.427991:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639011072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572263.428071:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:0.0:1788572263.428135:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639011072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572263.428142:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:3.0:1788572263.428282:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639011072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572263.430960:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572263.430987:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639011200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572263.431096:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572263.431445:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639011200 00000100:00100000:0.0:1788572263.431456:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639011200 00000100:00100000:0.0:1788572263.431531:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804 00000100:00100000:0.0:1788572263.431542:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639011200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572263.431573:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484850624 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572263.431626:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639011200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572263.431633:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804 00000100:00080000:0.0:1788572263.431655:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572263.431705:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639011200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572263.939237:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639011328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572263.939308:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572263.939363:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639011328 00000100:00100000:1.0:1788572263.939371:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639011328 00000100:00100000:1.0:1788572263.939437:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:1.0:1788572263.939447:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639011328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572263.939484:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491794752 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572263.939527:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639011328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572263.939534:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00080000:1.0:1788572263.939554:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572263.939591:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639011328:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788572264.143519:0:6552:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x992:0x0], count =16 00000004:00080000:1.0:1788572264.143533:0:6552:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x992:0x0]+16 in llog 00000004:00080000:1.0:1788572264.143543:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9a2:0x0], index 1: 0 00000100:00080000:0.0:1788572264.145678:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788572264.161796:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9a3:0x0], index 0: 0 00000004:00080000:3.0:1788572264.192700:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9a3:0x0], index 1: 0 00000004:00080000:2.0:1788572264.223993:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9a4:0x0], index 0: 0 00000004:00080000:3.0:1788572264.267937:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9a4:0x0], index 1: 0 00000004:00080000:3.0:1788572264.281128:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9a5:0x0], index 0: 0 00000004:00080000:2.0:1788572264.296298:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9a5:0x0], index 1: 0 00000004:00080000:2.0:1788572264.314717:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9a6:0x0], index 0: 0 00000004:00080000:2.0:1788572264.328278:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9a6:0x0], index 1: 0 00000004:00080000:2.0:1788572264.345853:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9a7:0x0], index 0: 0 00000004:00080000:2.0:1788572264.367229:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9a7:0x0], index 1: 0 00000004:00080000:2.0:1788572264.401859:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9a8:0x0], index 0: 0 00000004:00080000:0.0:1788572264.439626:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9a8:0x0], index 1: 0 00000004:00080000:0.0:1788572264.452927:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9a9:0x0], index 0: 0 00000100:00080000:2.0:1788572264.453582:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788572264.470953:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9a9:0x0], index 1: 0 00000004:00080000:1.0:1788572264.503351:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9aa:0x0], index 0: 0 00000004:00080000:3.0:1788572264.519895:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9aa:0x0], index 1: 0 00000004:00080000:1.0:1788572264.544373:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ab:0x0], index 0: 0 00000004:00080000:1.0:1788572264.569769:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ab:0x0], index 1: 0 00000004:00080000:1.0:1788572264.596568:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ac:0x0], index 0: 0 00000004:00080000:2.0:1788572264.625820:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ac:0x0], index 1: 0 00000004:00080000:3.0:1788572264.657639:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ad:0x0], index 0: 0 00000004:00080000:1.0:1788572264.674835:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ad:0x0], index 1: 0 00000004:00080000:2.0:1788572264.689601:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ae:0x0], index 0: 0 00000004:00080000:3.0:1788572264.720909:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ae:0x0], index 1: 0 00000004:00080000:0.0:1788572264.741693:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9af:0x0], index 0: 0 00000004:00080000:3.0:1788572264.762395:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9af:0x0], index 1: 0 00000004:00080000:1.0:1788572264.783918:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9b0:0x0], index 0: 0 00000004:00080000:2.0:1788572264.796314:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9b0:0x0], index 1: 0 00000004:00080000:2.0:1788572264.816295:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9b1:0x0], index 0: 0 00000004:00080000:1.0:1788572264.835263:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9b1:0x0], index 1: 0 00000004:00080000:2.0:1788572264.852596:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9b2:0x0], index 0: 0 00002000:00080000:2.0:1788572264.853431:0:43968:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2498 00000004:00080000:1.0:1788572264.880480:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9b2:0x0]-[0x280000401:0x9e1:0x0] 00000004:00080000:2.0:1788572264.881155:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9b2:0x0], index 1: 0 00002000:00080000:1.0:1788572264.881877:0:43964:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2498 00000004:00080000:0.0:1788572264.887813:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9b2:0x0]-[0x2c0000401:0x9e1:0x0] 00000004:00080000:1.0:1788572264.898546:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9b3:0x0], index 0: 0 00000004:00080000:0.0:1788572264.916941:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9b3:0x0], index 1: 0 00000004:00080000:3.0:1788572264.928611:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9b4:0x0], index 0: 0 00000004:00080000:1.0:1788572264.940894:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9b4:0x0], index 1: 0 00000004:00080000:3.0:1788572264.957867:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9b5:0x0], index 0: 0 00000100:00080000:1.0:1788572264.967324:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572264.978252:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572264.978260:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788572264.993682:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9b5:0x0], index 1: 0 00000004:00080000:2.0:1788572265.018937:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9b6:0x0], index 0: 0 00000004:00080000:2.0:1788572265.036399:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9b6:0x0], index 1: 0 00000004:00080000:2.0:1788572265.056998:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9b7:0x0], index 0: 0 00000004:00080000:3.0:1788572265.072664:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9b7:0x0], index 1: 0 00000004:00080000:1.0:1788572265.094351:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9b8:0x0], index 0: 0 00000004:00080000:2.0:1788572265.130791:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9b8:0x0], index 1: 0 00000004:00080000:3.0:1788572265.165451:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9b9:0x0], index 0: 0 00000004:00080000:0.0:1788572265.216633:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9b9:0x0], index 1: 0 00000004:00080000:1.0:1788572265.270745:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ba:0x0], index 0: 0 00000004:00080000:0.0:1788572265.311580:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ba:0x0], index 1: 0 00000004:00080000:3.0:1788572265.356853:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9bb:0x0], index 0: 0 00000100:00080000:3.0:1788572265.389669:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572265.389679:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572265.389682:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788572265.394529:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9bb:0x0], index 1: 0 00000004:00080000:0.0:1788572265.409579:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9bc:0x0], index 0: 0 00000004:00080000:1.0:1788572265.439050:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9bc:0x0], index 1: 0 00000004:00080000:1.0:1788572265.464336:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9bd:0x0], index 0: 0 00000004:00080000:0.0:1788572265.492260:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9bd:0x0], index 1: 0 00000004:00080000:0.0:1788572265.531812:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9be:0x0], index 0: 0 00000004:00080000:1.0:1788572265.574498:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9be:0x0], index 1: 0 00000004:00080000:3.0:1788572265.606342:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9bf:0x0], index 0: 0 00000004:00080000:1.0:1788572265.633518:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9bf:0x0], index 1: 0 00000004:00080000:1.0:1788572265.657598:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c0:0x0], index 0: 0 00000004:00080000:3.0:1788572265.678765:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c0:0x0], index 1: 0 00000004:00080000:2.0:1788572265.726268:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c1:0x0], index 0: 0 00000004:00080000:1.0:1788572265.752321:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c1:0x0], index 1: 0 00000004:00080000:0.0:1788572265.784099:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c2:0x0], index 0: 0 00000004:00080000:2.0:1788572265.802546:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c2:0x0], index 1: 0 00000004:00080000:1.0:1788572265.834696:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c3:0x0], index 0: 0 00000004:00080000:0.0:1788572265.855507:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c3:0x0], index 1: 0 00000004:00080000:3.0:1788572265.915983:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c4:0x0], index 0: 0 00000004:00080000:0.0:1788572265.939517:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c4:0x0], index 1: 0 00000004:00080000:1.0:1788572265.965052:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c5:0x0], index 0: 0 00000100:00080000:0.0:1788572266.003293:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788572266.004280:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c5:0x0], index 1: 0 00000004:00080000:0.0:1788572266.034928:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c6:0x0], index 0: 0 00000004:00080000:2.0:1788572266.068955:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c6:0x0], index 1: 0 00000004:00080000:1.0:1788572266.133368:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c7:0x0], index 0: 0 00000004:00080000:0.0:1788572266.148808:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c7:0x0], index 1: 0 00000004:00080000:1.0:1788572266.170686:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c8:0x0], index 0: 0 00000004:00080000:1.0:1788572266.196001:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c8:0x0], index 1: 0 00000004:00080000:2.0:1788572266.263558:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9c9:0x0], index 0: 0 00000004:00080000:0.0:1788572266.312714:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9c9:0x0], index 1: 0 00000004:00080000:3.0:1788572266.341684:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ca:0x0], index 0: 0 00000004:00080000:0.0:1788572266.368771:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ca:0x0], index 1: 0 00000004:00080000:2.0:1788572266.403572:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cb:0x0], index 0: 0 00000004:00080000:3.0:1788572266.422626:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cb:0x0], index 1: 0 00000004:00080000:1.0:1788572266.457541:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cc:0x0], index 0: 0 00000004:00080000:2.0:1788572266.516636:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cc:0x0], index 1: 0 00000004:00080000:2.0:1788572266.551707:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cd:0x0], index 0: 0 00000004:00080000:0.0:1788572266.606200:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cd:0x0], index 1: 0 00000004:00080000:2.0:1788572266.642880:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ce:0x0], index 0: 0 00000004:00080000:2.0:1788572266.667408:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ce:0x0], index 1: 0 00000004:00080000:2.0:1788572266.695374:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9cf:0x0], index 0: 0 00000004:00080000:1.0:1788572266.711574:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9cf:0x0], index 1: 0 00000004:00080000:1.0:1788572266.740922:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d0:0x0], index 0: 0 00000004:00080000:0.0:1788572266.757957:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d0:0x0], index 1: 0 00000004:00080000:2.0:1788572266.787208:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d1:0x0], index 0: 0 00000004:00080000:2.0:1788572266.801930:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d1:0x0], index 1: 0 00000004:00080000:2.0:1788572266.818875:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d2:0x0], index 0: 0 00000100:00080000:0.0:1788572266.835298:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788572266.836183:0:43975:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2530 00000004:00080000:1.0:1788572266.841266:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d2:0x0], index 1: 0 00002000:00080000:2.0:1788572266.843937:0:43967:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2530 00000100:00080000:0.0:1788572266.844666:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788572266.850855:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9d2:0x0]-[0x280000401:0xa01:0x0] 00000004:00080000:3.0:1788572266.851725:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9d2:0x0]-[0x2c0000401:0xa01:0x0] 00000004:00080000:1.0:1788572266.866966:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d3:0x0], index 0: 0 00000004:00080000:0.0:1788572266.883710:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d3:0x0], index 1: 0 00000004:00080000:2.0:1788572266.900576:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d4:0x0], index 0: 0 00000004:00080000:1.0:1788572266.910976:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d4:0x0], index 1: 0 00000004:00080000:0.0:1788572266.924855:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d5:0x0], index 0: 0 00000004:00080000:0.0:1788572266.934771:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d5:0x0], index 1: 0 00000004:00080000:3.0:1788572266.944631:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d6:0x0], index 0: 0 00000004:00080000:2.0:1788572266.955565:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d6:0x0], index 1: 0 00000004:00080000:2.0:1788572266.968507:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d7:0x0], index 0: 0 00000004:00080000:0.0:1788572266.982870:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d7:0x0], index 1: 0 00000004:00080000:3.0:1788572266.998622:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d8:0x0], index 0: 0 00000004:00080000:3.0:1788572267.013909:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d8:0x0], index 1: 0 00000004:00080000:0.0:1788572267.025260:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9d9:0x0], index 0: 0 00000004:00080000:0.0:1788572267.035736:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9d9:0x0], index 1: 0 00000004:00080000:2.0:1788572267.044829:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9da:0x0], index 0: 0 00000004:00080000:2.0:1788572267.054614:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9da:0x0], index 1: 0 00000004:00080000:3.0:1788572267.065619:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9db:0x0], index 0: 0 00000004:00080000:0.0:1788572267.078149:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9db:0x0], index 1: 0 00000004:00080000:2.0:1788572267.089817:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9dc:0x0], index 0: 0 00000004:00080000:3.0:1788572267.101513:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9dc:0x0], index 1: 0 00000004:00080000:0.0:1788572267.119773:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9dd:0x0], index 0: 0 00000004:00080000:1.0:1788572267.130793:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9dd:0x0], index 1: 0 00000004:00080000:3.0:1788572267.152782:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9de:0x0], index 0: 0 00000004:00080000:2.0:1788572267.164720:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9de:0x0], index 1: 0 00000004:00080000:0.0:1788572267.180510:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9df:0x0], index 0: 0 00000004:00080000:2.0:1788572267.199652:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9df:0x0], index 1: 0 00000004:00080000:2.0:1788572267.226294:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e0:0x0], index 0: 0 00000004:00080000:0.0:1788572267.267318:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e0:0x0], index 1: 0 00000004:00080000:3.0:1788572267.291937:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e1:0x0], index 0: 0 00000004:00080000:3.0:1788572267.335302:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e1:0x0], index 1: 0 00000004:00080000:3.0:1788572267.364373:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e2:0x0], index 0: 0 00000004:00080000:3.0:1788572267.381894:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e2:0x0], index 1: 0 00000004:00080000:3.0:1788572267.407878:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e3:0x0], index 0: 0 00000004:00080000:3.0:1788572267.418568:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e3:0x0], index 1: 0 00000004:00080000:2.0:1788572267.434881:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e4:0x0], index 0: 0 00000004:00080000:3.0:1788572267.444755:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e4:0x0], index 1: 0 00000004:00080000:0.0:1788572267.456360:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e5:0x0], index 0: 0 00000004:00080000:3.0:1788572267.467625:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e5:0x0], index 1: 0 00000004:00080000:3.0:1788572267.477089:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e6:0x0], index 0: 0 00000004:00080000:0.0:1788572267.487478:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e6:0x0], index 1: 0 00000004:00080000:2.0:1788572267.502541:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e7:0x0], index 0: 0 00000004:00080000:1.0:1788572267.513148:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e7:0x0], index 1: 0 00000004:00080000:1.0:1788572267.527851:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e8:0x0], index 0: 0 00000004:00080000:0.0:1788572267.541532:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e8:0x0], index 1: 0 00000004:00080000:1.0:1788572267.551959:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9e9:0x0], index 0: 0 00000004:00080000:1.0:1788572267.573274:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9e9:0x0], index 1: 0 00000004:00080000:0.0:1788572267.593625:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ea:0x0], index 0: 0 00000004:00080000:1.0:1788572267.612158:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ea:0x0], index 1: 0 00000004:00080000:1.0:1788572267.636354:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9eb:0x0], index 0: 0 00000004:00080000:2.0:1788572267.653503:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9eb:0x0], index 1: 0 00000004:00080000:3.0:1788572267.670586:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ec:0x0], index 0: 0 00000004:00080000:0.0:1788572267.694685:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ec:0x0], index 1: 0 00000004:00080000:2.0:1788572267.753449:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ed:0x0], index 0: 0 00000004:00080000:0.0:1788572267.805595:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ed:0x0], index 1: 0 00000004:00080000:2.0:1788572267.823886:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ee:0x0], index 0: 0 00000004:00080000:2.0:1788572267.837055:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ee:0x0], index 1: 0 00000004:00080000:2.0:1788572267.867086:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ef:0x0], index 0: 0 00000004:00080000:2.0:1788572267.879106:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ef:0x0], index 1: 0 00000004:00080000:2.0:1788572267.896571:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f0:0x0], index 0: 0 00000004:00080000:1.0:1788572267.915822:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f0:0x0], index 1: 0 00000004:00080000:2.0:1788572267.946311:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f1:0x0], index 0: 0 00000004:00080000:0.0:1788572267.975636:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f1:0x0], index 1: 0 00000004:00080000:2.0:1788572267.999078:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f2:0x0], index 0: 0 00002000:00080000:2.0:1788572268.001348:0:8466:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2562 00000004:00080000:3.0:1788572268.003847:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x9f2:0x0]-[0x280000401:0xa21:0x0] 00000100:00080000:0.0:1788572268.014049:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572268.014060:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788572268.025461:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f2:0x0], index 1: 0 00002000:00080000:0.0:1788572268.026684:0:17011:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2562 00000100:00080000:3.0:1788572268.032793:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788572268.040730:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x9f2:0x0]-[0x2c0000401:0xa21:0x0] 00000004:00080000:2.0:1788572268.055307:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f3:0x0], index 0: 0 00000004:00080000:1.0:1788572268.083947:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f3:0x0], index 1: 0 00000004:00080000:1.0:1788572268.116868:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f4:0x0], index 0: 0 00000004:00080000:3.0:1788572268.150818:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f4:0x0], index 1: 0 00000004:00080000:3.0:1788572268.169843:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f5:0x0], index 0: 0 00000004:00080000:0.0:1788572268.209094:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f5:0x0], index 1: 0 00000004:00080000:1.0:1788572268.248674:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f6:0x0], index 0: 0 00000004:00080000:1.0:1788572268.270953:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f6:0x0], index 1: 0 00000004:00080000:1.0:1788572268.294261:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f7:0x0], index 0: 0 00000004:00080000:1.0:1788572268.312569:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f7:0x0], index 1: 0 00000004:00080000:2.0:1788572268.332934:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f8:0x0], index 0: 0 00000004:00080000:2.0:1788572268.349958:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f8:0x0], index 1: 0 00000004:00080000:0.0:1788572268.369554:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9f9:0x0], index 0: 0 00000004:00080000:0.0:1788572268.391811:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9f9:0x0], index 1: 0 00000004:00080000:1.0:1788572268.405485:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fa:0x0], index 0: 0 00000004:00080000:2.0:1788572268.419675:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fa:0x0], index 1: 0 00000004:00080000:3.0:1788572268.447891:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fb:0x0], index 0: 0 00000004:00080000:0.0:1788572268.469448:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fb:0x0], index 1: 0 00000004:00080000:2.0:1788572268.493638:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fc:0x0], index 0: 0 00000004:00080000:3.0:1788572268.508910:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fc:0x0], index 1: 0 00000004:00080000:3.0:1788572268.524956:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fd:0x0], index 0: 0 00000004:00080000:3.0:1788572268.537639:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fd:0x0], index 1: 0 00000004:00080000:2.0:1788572268.557513:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9fe:0x0], index 0: 0 00000004:00080000:3.0:1788572268.576348:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9fe:0x0], index 1: 0 00000004:00080000:0.0:1788572268.593597:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x9ff:0x0], index 0: 0 00000004:00080000:2.0:1788572268.608665:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x9ff:0x0], index 1: 0 00000004:00080000:3.0:1788572268.622327:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa00:0x0], index 0: 0 00000004:00080000:2.0:1788572268.640867:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa00:0x0], index 1: 0 00000004:00080000:2.0:1788572268.665578:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa01:0x0], index 0: 0 00000004:00080000:0.0:1788572268.692987:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa01:0x0], index 1: 0 00000004:00080000:1.0:1788572268.707328:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa02:0x0], index 0: 0 00000004:00080000:2.0:1788572268.723272:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa02:0x0], index 1: 0 00000004:00080000:2.0:1788572268.736920:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa03:0x0], index 0: 0 00000004:00080000:0.0:1788572268.750302:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa03:0x0], index 1: 0 00000004:00080000:3.0:1788572268.762361:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa04:0x0], index 0: 0 00000004:00080000:0.0:1788572268.775839:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa04:0x0], index 1: 0 00000004:00080000:0.0:1788572268.789795:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa05:0x0], index 0: 0 00000004:00080000:3.0:1788572268.807613:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa05:0x0], index 1: 0 00000004:00080000:0.0:1788572268.820968:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa06:0x0], index 0: 0 00000004:00080000:3.0:1788572268.837529:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa06:0x0], index 1: 0 00000004:00080000:2.0:1788572268.848822:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa07:0x0], index 0: 0 00000004:00080000:0.0:1788572268.863944:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa07:0x0], index 1: 0 00000004:00080000:1.0:1788572268.875106:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa08:0x0], index 0: 0 00000004:00080000:2.0:1788572268.909373:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa08:0x0], index 1: 0 00000004:00080000:1.0:1788572268.936226:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa09:0x0], index 0: 0 00000004:00080000:2.0:1788572268.969880:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa09:0x0], index 1: 0 00000004:00080000:3.0:1788572268.985735:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa0a:0x0], index 0: 0 00000004:00080000:2.0:1788572269.008895:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa0a:0x0], index 1: 0 00000004:00080000:1.0:1788572269.034569:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa0b:0x0], index 0: 0 00000004:00080000:3.0:1788572269.048876:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa0b:0x0], index 1: 0 00000004:00080000:1.0:1788572269.061453:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa0c:0x0], index 0: 0 00000004:00080000:2.0:1788572269.072674:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa0c:0x0], index 1: 0 00000004:00080000:3.0:1788572269.086261:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa0d:0x0], index 0: 0 00000004:00080000:1.0:1788572269.098386:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa0d:0x0], index 1: 0 00000004:00080000:0.0:1788572269.109874:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa0e:0x0], index 0: 0 00000004:00080000:3.0:1788572269.132359:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa0e:0x0], index 1: 0 00000004:00080000:3.0:1788572269.149630:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa0f:0x0], index 0: 0 00000001:00080000:0.0:1788572269.158166:0:111978:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 219043332941 is committed 00000004:00080000:1.0:1788572269.171307:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa0f:0x0], index 1: 0 00000004:00080000:1.0:1788572269.184518:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa10:0x0], index 0: 0 00000004:00080000:0.0:1788572269.225608:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa10:0x0], index 1: 0 00000004:00080000:3.0:1788572269.253587:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa11:0x0], index 0: 0 00000004:00080000:0.0:1788572269.289706:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa11:0x0], index 1: 0 00000004:00080000:2.0:1788572269.306226:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa12:0x0], index 0: 0 00002000:00080000:0.0:1788572269.311635:0:43965:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2594 00000004:00080000:1.0:1788572269.315345:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xa12:0x0]-[0x280000401:0xa41:0x0] 00002000:00080000:1.0:1788572269.327703:0:43964:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2594 00000004:00080000:3.0:1788572269.330141:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa12:0x0], index 1: 0 00000004:00080000:2.0:1788572269.338564:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xa12:0x0]-[0x2c0000401:0xa41:0x0] 00000004:00080000:2.0:1788572269.353874:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa13:0x0], index 0: 0 00000004:00080000:2.0:1788572269.379171:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa13:0x0], index 1: 0 00000004:00080000:3.0:1788572269.395708:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa14:0x0], index 0: 0 00000004:00080000:0.0:1788572269.418145:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa14:0x0], index 1: 0 00000004:00080000:2.0:1788572269.431731:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa15:0x0], index 0: 0 00000004:00080000:3.0:1788572269.456386:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa15:0x0], index 1: 0 00000004:00080000:2.0:1788572269.484929:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa16:0x0], index 0: 0 00000004:00080000:2.0:1788572269.505354:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa16:0x0], index 1: 0 00000004:00080000:0.0:1788572269.521096:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa17:0x0], index 0: 0 00000004:00080000:0.0:1788572269.545361:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa17:0x0], index 1: 0 00000100:00080000:3.0:1788572269.576509:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788572269.578111:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa18:0x0], index 0: 0 00000004:00080000:0.0:1788572269.597072:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa18:0x0], index 1: 0 00000004:00080000:2.0:1788572269.611828:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa19:0x0], index 0: 0 00000004:00080000:2.0:1788572269.625153:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa19:0x0], index 1: 0 00000004:00080000:2.0:1788572269.639985:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa1a:0x0], index 0: 0 00000004:00080000:2.0:1788572269.663754:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa1a:0x0], index 1: 0 00000004:00080000:2.0:1788572269.683702:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa1b:0x0], index 0: 0 00000004:00080000:2.0:1788572269.698471:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa1b:0x0], index 1: 0 00000004:00080000:0.0:1788572269.713310:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa1c:0x0], index 0: 0 00000004:00080000:1.0:1788572269.747582:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa1c:0x0], index 1: 0 00000004:00080000:1.0:1788572269.770678:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa1d:0x0], index 0: 0 00000004:00080000:3.0:1788572269.816250:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa1d:0x0], index 1: 0 00000004:00080000:1.0:1788572269.878952:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa1e:0x0], index 0: 0 00000004:00080000:0.0:1788572269.917951:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa1e:0x0], index 1: 0 00000004:00080000:0.0:1788572269.965749:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa1f:0x0], index 0: 0 00000004:00080000:2.0:1788572269.992595:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa1f:0x0], index 1: 0 00000100:00080000:3.0:1788572270.008337:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788572270.020312:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa20:0x0], index 0: 0 00000004:00080000:0.0:1788572270.055561:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa20:0x0], index 1: 0 00000004:00080000:2.0:1788572270.071657:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa21:0x0], index 0: 0 00000100:00080000:1.0:1788572270.093537:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572270.093548:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572270.095219:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572270.095225:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572270.096310:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572270.098464:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572270.098472:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788572270.138690:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa21:0x0], index 1: 0 00000004:00080000:0.0:1788572270.200001:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa22:0x0], index 0: 0 00000004:00080000:0.0:1788572270.238979:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa22:0x0], index 1: 0 00000004:00080000:3.0:1788572270.280309:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa23:0x0], index 0: 0 00000004:00080000:0.0:1788572270.323326:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa23:0x0], index 1: 0 00000004:00080000:3.0:1788572270.367233:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa24:0x0], index 0: 0 00000004:00080000:1.0:1788572270.402641:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa24:0x0], index 1: 0 00000004:00080000:0.0:1788572270.463989:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa25:0x0], index 0: 0 00000100:00080000:1.0:1788572270.507123:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572270.521732:0:8466:0:(import.c:65:import_set_state_nolock()) ffff94e612c10000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788572270.523861:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572270.532730:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788572270.533414:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa25:0x0], index 1: 0 00000004:00080000:3.0:1788572270.553462:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa26:0x0], index 0: 0 00000001:00080000:1.0:1788572270.556720:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968468 is committed 00000004:00080000:1.0:1788572270.596554:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa26:0x0], index 1: 0 00000004:00080000:3.0:1788572270.627504:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa27:0x0], index 0: 0 00000004:00080000:3.0:1788572270.658169:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa27:0x0], index 1: 0 00000004:00080000:0.0:1788572270.683415:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa28:0x0], index 0: 0 00000004:00080000:0.0:1788572270.710642:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa28:0x0], index 1: 0 00000004:00080000:0.0:1788572270.743354:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa29:0x0], index 0: 0 00000004:00080000:0.0:1788572270.776388:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa29:0x0], index 1: 0 00000004:00080000:2.0:1788572270.835613:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa2a:0x0], index 0: 0 00000004:00080000:3.0:1788572270.878612:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa2a:0x0], index 1: 0 00000004:00080000:3.0:1788572270.913334:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa2b:0x0], index 0: 0 00000004:00080000:0.0:1788572270.936301:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa2b:0x0], index 1: 0 00000004:00080000:1.0:1788572270.957790:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa2c:0x0], index 0: 0 00000004:00080000:0.0:1788572271.016586:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa2c:0x0], index 1: 0 00000004:00080000:0.0:1788572271.038265:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa2d:0x0], index 0: 0 00000004:00080000:3.0:1788572271.083340:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa2d:0x0], index 1: 0 00000004:00080000:3.0:1788572271.101925:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa2e:0x0], index 0: 0 00000001:00080000:3.0:1788572271.118986:0:16234:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589935767 is committed 00000004:00080000:1.0:1788572271.134692:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa2e:0x0], index 1: 0 00000004:00080000:3.0:1788572271.172899:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa2f:0x0], index 0: 0 00000004:00080000:1.0:1788572271.212216:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa2f:0x0], index 1: 0 00000004:00080000:0.0:1788572271.230172:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa30:0x0], index 0: 0 00000004:00080000:1.0:1788572271.260778:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa30:0x0], index 1: 0 00000004:00080000:1.0:1788572271.297546:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa31:0x0], index 0: 0 00000004:00080000:2.0:1788572271.317167:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa31:0x0], index 1: 0 00000004:00080000:1.0:1788572271.333981:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa32:0x0], index 0: 0 00002000:00080000:0.0:1788572271.334442:0:8464:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2626 00000004:00080000:0.0:1788572271.336775:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xa32:0x0]-[0x280000401:0xa61:0x0] 00000004:00080000:3.0:1788572271.381183:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa32:0x0], index 1: 0 00002000:00080000:2.0:1788572271.381699:0:43968:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2626 00000004:00080000:2.0:1788572271.383416:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xa32:0x0]-[0x2c0000401:0xa61:0x0] 00000004:00080000:1.0:1788572271.405652:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa33:0x0], index 0: 0 00000004:00080000:3.0:1788572271.418433:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa33:0x0], index 1: 0 00000004:00080000:1.0:1788572271.438917:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa34:0x0], index 0: 0 00000004:00080000:1.0:1788572271.466075:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa34:0x0], index 1: 0 00000004:00080000:1.0:1788572271.484194:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa35:0x0], index 0: 0 00000004:00080000:1.0:1788572271.499885:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa35:0x0], index 1: 0 00000004:00080000:2.0:1788572271.541178:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa36:0x0], index 0: 0 00000004:00080000:3.0:1788572271.557768:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa36:0x0], index 1: 0 00000004:00080000:0.0:1788572271.583294:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa37:0x0], index 0: 0 00000004:00080000:2.0:1788572271.605585:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa37:0x0], index 1: 0 00000004:00080000:2.0:1788572271.639457:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa38:0x0], index 0: 0 00000004:00080000:1.0:1788572271.655432:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa38:0x0], index 1: 0 00000004:00080000:1.0:1788572271.698062:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa39:0x0], index 0: 0 00000004:00080000:0.0:1788572271.723250:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa39:0x0], index 1: 0 00000004:00080000:1.0:1788572271.749280:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa3a:0x0], index 0: 0 00000004:00080000:2.0:1788572271.795864:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa3a:0x0], index 1: 0 00000004:00080000:1.0:1788572271.808200:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa3b:0x0], index 0: 0 00000004:00080000:0.0:1788572271.827923:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa3b:0x0], index 1: 0 00000004:00080000:0.0:1788572271.842875:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa3c:0x0], index 0: 0 00000004:00080000:2.0:1788572271.860524:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa3c:0x0], index 1: 0 00000004:00080000:3.0:1788572271.875669:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa3d:0x0], index 0: 0 00000004:00080000:0.0:1788572271.895636:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa3d:0x0], index 1: 0 00000004:00080000:3.0:1788572271.924996:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa3e:0x0], index 0: 0 00000004:00080000:3.0:1788572271.959823:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa3e:0x0], index 1: 0 00000004:00080000:1.0:1788572271.990455:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa3f:0x0], index 0: 0 00000100:00080000:2.0:1788572272.001042:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788572272.014739:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa3f:0x0], index 1: 0 00000004:00080000:3.0:1788572272.033621:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa40:0x0], index 0: 0 00000004:00080000:1.0:1788572272.058435:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa40:0x0], index 1: 0 00000004:00080000:0.0:1788572272.077792:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa41:0x0], index 0: 0 00000004:00080000:3.0:1788572272.104965:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa41:0x0], index 1: 0 00000004:00080000:1.0:1788572272.132293:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa42:0x0], index 0: 0 00000004:00080000:2.0:1788572272.159406:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa42:0x0], index 1: 0 00000004:00080000:3.0:1788572272.220848:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa43:0x0], index 0: 0 00000004:00080000:0.0:1788572272.246725:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa43:0x0], index 1: 0 00000004:00080000:3.0:1788572272.281379:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa44:0x0], index 0: 0 00000004:00080000:3.0:1788572272.299240:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa44:0x0], index 1: 0 00000004:00080000:2.0:1788572272.345416:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa45:0x0], index 0: 0 00000004:00080000:3.0:1788572272.394164:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa45:0x0], index 1: 0 00000004:00080000:2.0:1788572272.419055:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa46:0x0], index 0: 0 00000004:00080000:2.0:1788572272.456809:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa46:0x0], index 1: 0 00000004:00080000:1.0:1788572272.499443:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa47:0x0], index 0: 0 00000004:00080000:0.0:1788572272.525394:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa47:0x0], index 1: 0 00000004:00080000:3.0:1788572272.560669:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa48:0x0], index 0: 0 00000004:00080000:1.0:1788572272.581849:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa48:0x0], index 1: 0 00000004:00080000:2.0:1788572272.611163:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa49:0x0], index 0: 0 00000004:00080000:0.0:1788572272.656234:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa49:0x0], index 1: 0 00000004:00080000:0.0:1788572272.673867:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa4a:0x0], index 0: 0 00000004:00080000:2.0:1788572272.698634:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa4a:0x0], index 1: 0 00000004:00080000:0.0:1788572272.715495:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa4b:0x0], index 0: 0 00000004:00080000:3.0:1788572272.736397:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa4b:0x0], index 1: 0 00000004:00080000:1.0:1788572272.755992:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa4c:0x0], index 0: 0 00000004:00080000:0.0:1788572272.770167:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa4c:0x0], index 1: 0 00000004:00080000:2.0:1788572272.785231:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa4d:0x0], index 0: 0 00000004:00080000:2.0:1788572272.823676:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa4d:0x0], index 1: 0 00000004:00080000:3.0:1788572272.837776:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa4e:0x0], index 0: 0 00000004:00080000:2.0:1788572272.872140:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa4e:0x0], index 1: 0 00000004:00080000:0.0:1788572272.886972:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa4f:0x0], index 0: 0 00000004:00080000:1.0:1788572272.910431:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa4f:0x0], index 1: 0 00000004:00080000:1.0:1788572272.924392:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa50:0x0], index 0: 0 00000004:00080000:2.0:1788572272.943615:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa50:0x0], index 1: 0 00000004:00080000:0.0:1788572272.960943:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa51:0x0], index 0: 0 00000004:00080000:2.0:1788572272.992839:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa51:0x0], index 1: 0 00000004:00080000:1.0:1788572273.004375:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa52:0x0], index 0: 0 00002000:00080000:2.0:1788572273.005690:0:43972:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2658 00000100:00080000:3.0:1788572273.008455:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788572273.008533:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xa52:0x0]-[0x280000401:0xa81:0x0] 00000004:00080000:0.0:1788572273.021801:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa52:0x0], index 1: 0 00002000:00080000:2.0:1788572273.023046:0:8465:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2658 00000100:00080000:0.0:1788572273.027525:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788572273.027746:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xa52:0x0]-[0x2c0000401:0xa81:0x0] 00000004:00080000:0.0:1788572273.045323:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa53:0x0], index 0: 0 00000004:00080000:2.0:1788572273.065484:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa53:0x0], index 1: 0 00000004:00080000:2.0:1788572273.087131:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa54:0x0], index 0: 0 00000004:00080000:2.0:1788572273.108829:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa54:0x0], index 1: 0 00000004:00080000:0.0:1788572273.122808:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa55:0x0], index 0: 0 00000004:00080000:3.0:1788572273.141977:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa55:0x0], index 1: 0 00000004:00080000:0.0:1788572273.162216:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa56:0x0], index 0: 0 00000004:00080000:1.0:1788572273.188082:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa56:0x0], index 1: 0 00000004:00080000:3.0:1788572273.210898:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa57:0x0], index 0: 0 00000004:00080000:3.0:1788572273.229662:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa57:0x0], index 1: 0 00000004:00080000:2.0:1788572273.252147:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa58:0x0], index 0: 0 00000004:00080000:3.0:1788572273.266219:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa58:0x0], index 1: 0 00000004:00080000:2.0:1788572273.292235:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa59:0x0], index 0: 0 00000004:00080000:0.0:1788572273.320325:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa59:0x0], index 1: 0 00000004:00080000:0.0:1788572273.357069:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa5a:0x0], index 0: 0 00000004:00080000:2.0:1788572273.378299:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa5a:0x0], index 1: 0 00000004:00080000:0.0:1788572273.406592:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa5b:0x0], index 0: 0 00000004:00080000:0.0:1788572273.435832:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa5b:0x0], index 1: 0 00000004:00080000:3.0:1788572273.451890:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa5c:0x0], index 0: 0 00000004:00080000:2.0:1788572273.477551:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa5c:0x0], index 1: 0 00000004:00080000:1.0:1788572273.517797:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa5d:0x0], index 0: 0 00000004:00080000:1.0:1788572273.537216:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa5d:0x0], index 1: 0 00000004:00080000:0.0:1788572273.554976:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa5e:0x0], index 0: 0 00000004:00080000:1.0:1788572273.592553:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa5e:0x0], index 1: 0 00000004:00080000:1.0:1788572273.626952:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa5f:0x0], index 0: 0 00000004:00080000:0.0:1788572273.650823:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa5f:0x0], index 1: 0 00000004:00080000:0.0:1788572273.674170:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa60:0x0], index 0: 0 00000004:00080000:0.0:1788572273.691743:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa60:0x0], index 1: 0 00000004:00080000:2.0:1788572273.713743:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa61:0x0], index 0: 0 00000004:00080000:2.0:1788572273.732422:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa61:0x0], index 1: 0 00000004:00080000:0.0:1788572273.756264:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa62:0x0], index 0: 0 00000004:00080000:1.0:1788572273.781634:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa62:0x0], index 1: 0 00000004:00080000:0.0:1788572273.807337:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa63:0x0], index 0: 0 00000004:00080000:1.0:1788572273.835732:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa63:0x0], index 1: 0 00000004:00080000:1.0:1788572273.857493:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa64:0x0], index 0: 0 00000004:00080000:0.0:1788572273.887938:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa64:0x0], index 1: 0 00000004:00080000:1.0:1788572273.910874:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa65:0x0], index 0: 0 00000004:00080000:1.0:1788572273.939651:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa65:0x0], index 1: 0 00000004:00080000:3.0:1788572273.961309:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa66:0x0], index 0: 0 00000004:00080000:1.0:1788572273.995785:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa66:0x0], index 1: 0 00000100:00080000:0.0:1788572274.010747:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788572274.028941:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa67:0x0], index 0: 0 00000004:00080000:2.0:1788572274.047877:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa67:0x0], index 1: 0 00000004:00080000:1.0:1788572274.068920:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa68:0x0], index 0: 0 00000004:00080000:1.0:1788572274.086638:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa68:0x0], index 1: 0 00000004:00080000:2.0:1788572274.104870:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa69:0x0], index 0: 0 00000004:00080000:0.0:1788572274.137758:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa69:0x0], index 1: 0 00000004:00080000:3.0:1788572274.171969:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa6a:0x0], index 0: 0 00000001:00080000:0.0:1788572274.176842:0:111978:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 219043333305 is committed 00000004:00080000:2.0:1788572274.234098:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa6a:0x0], index 1: 0 00000004:00080000:1.0:1788572274.260848:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa6b:0x0], index 0: 0 00000004:00080000:3.0:1788572274.297533:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa6b:0x0], index 1: 0 00000004:00080000:2.0:1788572274.325283:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa6c:0x0], index 0: 0 00000004:00080000:2.0:1788572274.352646:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa6c:0x0], index 1: 0 00000004:00080000:0.0:1788572274.364834:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa6d:0x0], index 0: 0 00000004:00080000:0.0:1788572274.385351:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa6d:0x0], index 1: 0 00000004:00080000:0.0:1788572274.408564:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa6e:0x0], index 0: 0 00000004:00080000:0.0:1788572274.464489:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa6e:0x0], index 1: 0 00000004:00080000:1.0:1788572274.508665:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa6f:0x0], index 0: 0 00000004:00080000:0.0:1788572274.580257:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa6f:0x0], index 1: 0 00000004:00080000:2.0:1788572274.610542:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa70:0x0], index 0: 0 00000004:00080000:2.0:1788572274.667284:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa70:0x0], index 1: 0 00000004:00080000:0.0:1788572274.695269:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa71:0x0], index 0: 0 00000100:00080000:0.0:1788572274.699281:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788572274.720267:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa71:0x0], index 1: 0 00000004:00080000:1.0:1788572274.740463:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa72:0x0], index 0: 0 00002000:00080000:3.0:1788572274.741788:0:43969:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2690 00000004:00080000:0.0:1788572274.748834:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xa72:0x0]-[0x280000401:0xaa1:0x0] 00000004:00080000:0.0:1788572274.764693:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa72:0x0], index 1: 0 00002000:00080000:2.0:1788572274.765478:0:43966:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2690 00000004:00080000:1.0:1788572274.768945:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xa72:0x0]-[0x2c0000401:0xaa1:0x0] 00000004:00080000:3.0:1788572274.797546:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa73:0x0], index 0: 0 00000004:00080000:3.0:1788572274.836199:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa73:0x0], index 1: 0 00000004:00080000:0.0:1788572274.869526:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa74:0x0], index 0: 0 00000004:00080000:0.0:1788572274.904353:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa74:0x0], index 1: 0 00000004:00080000:2.0:1788572274.946671:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa75:0x0], index 0: 0 00000004:00080000:1.0:1788572274.974826:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa75:0x0], index 1: 0 00000004:00080000:2.0:1788572274.998077:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa76:0x0], index 0: 0 00000004:00080000:0.0:1788572275.034283:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa76:0x0], index 1: 0 00000004:00080000:1.0:1788572275.062849:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa77:0x0], index 0: 0 00000004:00080000:2.0:1788572275.081864:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa77:0x0], index 1: 0 00000004:00080000:1.0:1788572275.118252:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa78:0x0], index 0: 0 00000004:00080000:0.0:1788572275.149725:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa78:0x0], index 1: 0 00000004:00080000:2.0:1788572275.186181:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa79:0x0], index 0: 0 00000004:00080000:1.0:1788572275.199927:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa79:0x0], index 1: 0 00000100:00080000:0.0:1788572275.204408:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572275.205554:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572275.205562:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572275.206306:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572275.206311:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788572275.220701:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa7a:0x0], index 0: 0 00000004:00080000:1.0:1788572275.248704:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa7a:0x0], index 1: 0 00000004:00080000:2.0:1788572275.267293:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa7b:0x0], index 0: 0 00000004:00080000:0.0:1788572275.284596:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa7b:0x0], index 1: 0 00000004:00080000:2.0:1788572275.302763:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa7c:0x0], index 0: 0 00000004:00080000:3.0:1788572275.321877:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa7c:0x0], index 1: 0 00000004:00080000:1.0:1788572275.343882:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa7d:0x0], index 0: 0 00000004:00080000:3.0:1788572275.395187:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa7d:0x0], index 1: 0 00000004:00080000:0.0:1788572275.435675:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa7e:0x0], index 0: 0 00000004:00080000:2.0:1788572275.466194:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa7e:0x0], index 1: 0 00000004:00080000:0.0:1788572275.513979:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa7f:0x0], index 0: 0 00000004:00080000:2.0:1788572275.546580:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa7f:0x0], index 1: 0 00000004:00080000:0.0:1788572275.569051:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa80:0x0], index 0: 0 00000004:00080000:0.0:1788572275.602476:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa80:0x0], index 1: 0 00000100:00080000:3.0:1788572275.623256:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572275.632826:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788572275.645695:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa81:0x0], index 0: 0 00000004:00080000:3.0:1788572275.661476:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa81:0x0], index 1: 0 00000004:00080000:2.0:1788572275.696540:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa82:0x0], index 0: 0 00000004:00080000:1.0:1788572275.714406:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa82:0x0], index 1: 0 00000004:00080000:2.0:1788572275.730621:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa83:0x0], index 0: 0 00000004:00080000:2.0:1788572275.742796:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa83:0x0], index 1: 0 00000004:00080000:0.0:1788572275.754929:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa84:0x0], index 0: 0 00000004:00080000:2.0:1788572275.781469:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa84:0x0], index 1: 0 00000004:00080000:1.0:1788572275.797529:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa85:0x0], index 0: 0 00000004:00080000:2.0:1788572275.810205:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa85:0x0], index 1: 0 00000004:00080000:0.0:1788572275.837409:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa86:0x0], index 0: 0 00000004:00080000:2.0:1788572275.861880:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa86:0x0], index 1: 0 00000004:00080000:0.0:1788572275.882582:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa87:0x0], index 0: 0 00000004:00080000:0.0:1788572275.904865:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa87:0x0], index 1: 0 00000004:00080000:3.0:1788572275.925563:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa88:0x0], index 0: 0 00000004:00080000:1.0:1788572275.947581:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa88:0x0], index 1: 0 00000004:00080000:3.0:1788572275.996422:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa89:0x0], index 0: 0 00000100:00080000:0.0:1788572276.011464:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788572276.025237:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa89:0x0], index 1: 0 00000004:00080000:0.0:1788572276.059294:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa8a:0x0], index 0: 0 00000004:00080000:2.0:1788572276.088276:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa8a:0x0], index 1: 0 00000004:00080000:1.0:1788572276.112568:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa8b:0x0], index 0: 0 00000004:00080000:0.0:1788572276.127932:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa8b:0x0], index 1: 0 00000004:00080000:3.0:1788572276.146668:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa8c:0x0], index 0: 0 00000004:00080000:1.0:1788572276.167650:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa8c:0x0], index 1: 0 00000004:00080000:0.0:1788572276.183378:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa8d:0x0], index 0: 0 00000004:00080000:3.0:1788572276.205955:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa8d:0x0], index 1: 0 00000004:00080000:2.0:1788572276.225957:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa8e:0x0], index 0: 0 00000004:00080000:3.0:1788572276.248319:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa8e:0x0], index 1: 0 00000004:00080000:2.0:1788572276.273473:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa8f:0x0], index 0: 0 00000004:00080000:1.0:1788572276.329490:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa8f:0x0], index 1: 0 00000004:00080000:3.0:1788572276.344449:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa90:0x0], index 0: 0 00000004:00080000:2.0:1788572276.370821:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa90:0x0], index 1: 0 00000004:00080000:2.0:1788572276.392368:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa91:0x0], index 0: 0 00000004:00080000:0.0:1788572276.411260:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa91:0x0], index 1: 0 00002000:00080000:0.0:1788572276.440220:0:43972:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2722 00000004:00080000:3.0:1788572276.448443:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa92:0x0], index 0: 0 00000004:00080000:0.0:1788572276.449649:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xa92:0x0]-[0x280000401:0xac1:0x0] 00000001:00080000:0.0:1788572276.455051:0:16234:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589935771 is committed 00000004:00080000:0.0:1788572276.474581:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa92:0x0], index 1: 0 00002000:00080000:3.0:1788572276.474991:0:8465:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2722 00000004:00080000:2.0:1788572276.479656:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xa92:0x0]-[0x2c0000401:0xac1:0x0] 00000001:00080000:1.0:1788572276.495104:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968472 is committed 00000004:00080000:1.0:1788572276.504144:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa93:0x0], index 0: 0 00000004:00080000:2.0:1788572276.537876:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa93:0x0], index 1: 0 00000004:00080000:0.0:1788572276.555644:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa94:0x0], index 0: 0 00000004:00080000:2.0:1788572276.587957:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa94:0x0], index 1: 0 00000004:00080000:0.0:1788572276.609896:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa95:0x0], index 0: 0 00000004:00080000:2.0:1788572276.628975:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa95:0x0], index 1: 0 00000004:00080000:0.0:1788572276.650244:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa96:0x0], index 0: 0 00000004:00080000:1.0:1788572276.688996:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa96:0x0], index 1: 0 00000004:00080000:0.0:1788572276.710540:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa97:0x0], index 0: 0 00000004:00080000:3.0:1788572276.742836:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa97:0x0], index 1: 0 00000004:00080000:1.0:1788572276.760985:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa98:0x0], index 0: 0 00000004:00080000:3.0:1788572276.782982:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa98:0x0], index 1: 0 00000004:00080000:1.0:1788572276.812567:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa99:0x0], index 0: 0 00000004:00080000:1.0:1788572276.828515:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa99:0x0], index 1: 0 00000004:00080000:0.0:1788572276.848803:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa9a:0x0], index 0: 0 00000004:00080000:1.0:1788572276.864462:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa9a:0x0], index 1: 0 00000004:00080000:1.0:1788572276.873221:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa9b:0x0], index 0: 0 00000004:00080000:0.0:1788572276.890416:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa9b:0x0], index 1: 0 00000004:00080000:1.0:1788572276.910226:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa9c:0x0], index 0: 0 00000004:00080000:1.0:1788572276.942568:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa9c:0x0], index 1: 0 00000004:00080000:0.0:1788572276.958283:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa9d:0x0], index 0: 0 00000004:00080000:2.0:1788572276.971532:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa9d:0x0], index 1: 0 00000004:00080000:0.0:1788572276.988870:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa9e:0x0], index 0: 0 00000004:00080000:3.0:1788572277.002915:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa9e:0x0], index 1: 0 00000004:00080000:2.0:1788572277.015792:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xa9f:0x0], index 0: 0 00000004:00080000:0.0:1788572277.027644:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xa9f:0x0], index 1: 0 00000004:00080000:2.0:1788572277.042872:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaa0:0x0], index 0: 0 00000004:00080000:2.0:1788572277.057557:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaa0:0x0], index 1: 0 00000004:00080000:2.0:1788572277.076846:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaa1:0x0], index 0: 0 00000004:00080000:2.0:1788572277.093461:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaa1:0x0], index 1: 0 00000004:00080000:2.0:1788572277.113455:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaa2:0x0], index 0: 0 00000004:00080000:0.0:1788572277.132699:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaa2:0x0], index 1: 0 00000004:00080000:3.0:1788572277.143592:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaa3:0x0], index 0: 0 00000004:00080000:0.0:1788572277.159703:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaa3:0x0], index 1: 0 00000004:00080000:2.0:1788572277.168218:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaa4:0x0], index 0: 0 00000004:00080000:3.0:1788572277.176788:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaa4:0x0], index 1: 0 00000004:00080000:2.0:1788572277.188824:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaa5:0x0], index 0: 0 00000004:00080000:2.0:1788572277.219987:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaa5:0x0], index 1: 0 00000004:00080000:3.0:1788572277.242887:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaa6:0x0], index 0: 0 00000004:00080000:0.0:1788572277.260834:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaa6:0x0], index 1: 0 00000004:00080000:0.0:1788572277.279942:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaa7:0x0], index 0: 0 00000004:00080000:2.0:1788572277.295959:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaa7:0x0], index 1: 0 00000004:00080000:0.0:1788572277.308840:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaa8:0x0], index 0: 0 00000004:00080000:0.0:1788572277.327184:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaa8:0x0], index 1: 0 00000004:00080000:3.0:1788572277.353353:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaa9:0x0], index 0: 0 00000004:00080000:2.0:1788572277.372944:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaa9:0x0], index 1: 0 00000004:00080000:2.0:1788572277.400562:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaaa:0x0], index 0: 0 00000004:00080000:2.0:1788572277.435089:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaaa:0x0], index 1: 0 00000004:00080000:0.0:1788572277.450959:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaab:0x0], index 0: 0 00000004:00080000:3.0:1788572277.474020:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaab:0x0], index 1: 0 00000004:00080000:2.0:1788572277.504771:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaac:0x0], index 0: 0 00000004:00080000:0.0:1788572277.546745:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaac:0x0], index 1: 0 00000004:00080000:0.0:1788572277.575914:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaad:0x0], index 0: 0 00000004:00080000:1.0:1788572277.602107:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaad:0x0], index 1: 0 00000004:00080000:1.0:1788572277.655650:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaae:0x0], index 0: 0 00000004:00080000:1.0:1788572277.685699:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaae:0x0], index 1: 0 00000004:00080000:1.0:1788572277.693673:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaaf:0x0], index 0: 0 00000004:00080000:1.0:1788572277.702648:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaaf:0x0], index 1: 0 00000004:00080000:1.0:1788572277.710754:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xab0:0x0], index 0: 0 00000004:00080000:1.0:1788572277.717618:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xab0:0x0], index 1: 0 00000004:00080000:1.0:1788572277.724598:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xab1:0x0], index 0: 0 00000004:00080000:3.0:1788572277.731314:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xab1:0x0], index 1: 0 00000004:00080000:1.0:1788572277.738188:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xab2:0x0], index 0: 0 00002000:00080000:2.0:1788572277.738864:0:43974:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2754 00000100:00080000:0.0:1788572277.739154:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788572277.741146:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xab2:0x0]-[0x280000401:0xae1:0x0] 00000004:00080000:1.0:1788572277.745527:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xab2:0x0], index 1: 0 00002000:00080000:3.0:1788572277.745646:0:43975:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2754 00000004:00080000:2.0:1788572277.746881:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xab2:0x0]-[0x2c0000401:0xae1:0x0] 00000100:00080000:0.0:1788572277.747388:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788572277.754555:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xab3:0x0], index 0: 0 00000004:00080000:3.0:1788572277.762824:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xab3:0x0], index 1: 0 00000004:00080000:2.0:1788572277.769939:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xab4:0x0], index 0: 0 00000004:00080000:3.0:1788572277.776935:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xab4:0x0], index 1: 0 00000004:00080000:0.0:1788572277.784362:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xab5:0x0], index 0: 0 00000004:00080000:0.0:1788572277.792761:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xab5:0x0], index 1: 0 00000004:00080000:2.0:1788572277.806694:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xab6:0x0], index 0: 0 00000004:00080000:0.0:1788572277.814164:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xab6:0x0], index 1: 0 00000004:00080000:0.0:1788572277.821613:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xab7:0x0], index 0: 0 00000004:00080000:1.0:1788572277.828422:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xab7:0x0], index 1: 0 00000004:00080000:0.0:1788572277.835441:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xab8:0x0], index 0: 0 00000004:00080000:1.0:1788572277.846637:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xab8:0x0], index 1: 0 00000004:00080000:2.0:1788572277.859394:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xab9:0x0], index 0: 0 00000004:00080000:0.0:1788572277.887932:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xab9:0x0], index 1: 0 00000004:00080000:2.0:1788572277.903382:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaba:0x0], index 0: 0 00000004:00080000:1.0:1788572277.922334:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaba:0x0], index 1: 0 00000004:00080000:0.0:1788572277.937452:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xabb:0x0], index 0: 0 00000004:00080000:2.0:1788572277.948552:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xabb:0x0], index 1: 0 00000004:00080000:1.0:1788572277.959126:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xabc:0x0], index 0: 0 00000004:00080000:1.0:1788572277.969174:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xabc:0x0], index 1: 0 00000004:00080000:1.0:1788572277.983087:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xabd:0x0], index 0: 0 00000004:00080000:1.0:1788572277.998900:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xabd:0x0], index 1: 0 00000100:00080000:0.0:1788572278.002648:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788572278.011854:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xabe:0x0], index 0: 0 00000004:00080000:0.0:1788572278.025384:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xabe:0x0], index 1: 0 00000004:00080000:2.0:1788572278.039529:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xabf:0x0], index 0: 0 00000004:00080000:3.0:1788572278.053378:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xabf:0x0], index 1: 0 00000004:00080000:3.0:1788572278.066072:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xac0:0x0], index 0: 0 00000004:00080000:2.0:1788572278.080645:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xac0:0x0], index 1: 0 00000004:00080000:1.0:1788572278.092279:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xac1:0x0], index 0: 0 00000004:00080000:3.0:1788572278.103897:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xac1:0x0], index 1: 0 00000004:00080000:3.0:1788572278.117417:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xac2:0x0], index 0: 0 00000004:00080000:2.0:1788572278.129886:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xac2:0x0], index 1: 0 00000004:00080000:2.0:1788572278.143870:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xac3:0x0], index 0: 0 00000004:00080000:0.0:1788572278.160593:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xac3:0x0], index 1: 0 00000004:00080000:0.0:1788572278.173446:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xac4:0x0], index 0: 0 00000004:00080000:0.0:1788572278.190162:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xac4:0x0], index 1: 0 00000004:00080000:2.0:1788572278.209106:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xac5:0x0], index 0: 0 00000004:00080000:1.0:1788572278.226601:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xac5:0x0], index 1: 0 00000004:00080000:0.0:1788572278.238751:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xac6:0x0], index 0: 0 00000004:00080000:3.0:1788572278.249244:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xac6:0x0], index 1: 0 00000004:00080000:2.0:1788572278.264209:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xac7:0x0], index 0: 0 00000004:00080000:2.0:1788572278.283555:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xac7:0x0], index 1: 0 00000004:00080000:2.0:1788572278.300268:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xac8:0x0], index 0: 0 00000004:00080000:1.0:1788572278.330219:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xac8:0x0], index 1: 0 00000004:00080000:2.0:1788572278.343512:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xac9:0x0], index 0: 0 00000004:00080000:2.0:1788572278.354868:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xac9:0x0], index 1: 0 00000004:00080000:0.0:1788572278.368281:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaca:0x0], index 0: 0 00000004:00080000:3.0:1788572278.379839:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaca:0x0], index 1: 0 00000004:00080000:3.0:1788572278.390392:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xacb:0x0], index 0: 0 00000004:00080000:0.0:1788572278.402502:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xacb:0x0], index 1: 0 00000004:00080000:2.0:1788572278.410954:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xacc:0x0], index 0: 0 00000004:00080000:3.0:1788572278.419649:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xacc:0x0], index 1: 0 00000004:00080000:1.0:1788572278.434137:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xacd:0x0], index 0: 0 00000004:00080000:3.0:1788572278.440584:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xacd:0x0], index 1: 0 00000004:00080000:2.0:1788572278.446656:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xace:0x0], index 0: 0 00000004:00080000:0.0:1788572278.457385:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xace:0x0], index 1: 0 00000004:00080000:0.0:1788572278.472867:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xacf:0x0], index 0: 0 00000004:00080000:2.0:1788572278.495576:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xacf:0x0], index 1: 0 00000004:00080000:1.0:1788572278.518869:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xad0:0x0], index 0: 0 00000004:00080000:2.0:1788572278.547600:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xad0:0x0], index 1: 0 00000004:00080000:2.0:1788572278.578806:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xad1:0x0], index 0: 0 00000004:00080000:2.0:1788572278.619527:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xad1:0x0], index 1: 0 00000004:00080000:2.0:1788572278.634599:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xad2:0x0], index 0: 0 00002000:00080000:2.0:1788572278.636035:0:43973:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2786 00000004:00080000:0.0:1788572278.637804:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xad2:0x0]-[0x280000401:0xb01:0x0] 00000004:00080000:3.0:1788572278.647953:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xad2:0x0], index 1: 0 00002000:00080000:1.0:1788572278.651533:0:43967:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2786 00000004:00080000:1.0:1788572278.653073:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xad2:0x0]-[0x2c0000401:0xb01:0x0] 00000004:00080000:3.0:1788572278.669480:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xad3:0x0], index 0: 0 00000004:00080000:1.0:1788572278.692739:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xad3:0x0], index 1: 0 00000004:00080000:2.0:1788572278.718253:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xad4:0x0], index 0: 0 00000004:00080000:0.0:1788572278.742268:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xad4:0x0], index 1: 0 00000004:00080000:2.0:1788572278.763593:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xad5:0x0], index 0: 0 00000004:00080000:2.0:1788572278.778604:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xad5:0x0], index 1: 0 00000004:00080000:1.0:1788572278.795765:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xad6:0x0], index 0: 0 00000004:00080000:1.0:1788572278.811512:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xad6:0x0], index 1: 0 00000004:00080000:0.0:1788572278.826536:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xad7:0x0], index 0: 0 00000004:00080000:1.0:1788572278.839227:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xad7:0x0], index 1: 0 00000004:00080000:0.0:1788572278.852241:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xad8:0x0], index 0: 0 00000004:00080000:3.0:1788572278.863764:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xad8:0x0], index 1: 0 00000004:00080000:3.0:1788572278.880552:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xad9:0x0], index 0: 0 00000004:00080000:1.0:1788572278.899168:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xad9:0x0], index 1: 0 00000004:00080000:3.0:1788572278.920326:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xada:0x0], index 0: 0 00000004:00080000:2.0:1788572278.940623:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xada:0x0], index 1: 0 00000004:00080000:1.0:1788572278.952995:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xadb:0x0], index 0: 0 00000004:00080000:3.0:1788572278.968468:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xadb:0x0], index 1: 0 00000004:00080000:1.0:1788572278.980880:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xadc:0x0], index 0: 0 00000004:00080000:1.0:1788572278.993334:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xadc:0x0], index 1: 0 00000004:00080000:3.0:1788572279.005347:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xadd:0x0], index 0: 0 00000004:00080000:2.0:1788572279.018122:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xadd:0x0], index 1: 0 00000004:00080000:0.0:1788572279.030874:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xade:0x0], index 0: 0 00000004:00080000:1.0:1788572279.044193:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xade:0x0], index 1: 0 00000004:00080000:1.0:1788572279.055860:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xadf:0x0], index 0: 0 00000004:00080000:1.0:1788572279.069802:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xadf:0x0], index 1: 0 00000004:00080000:1.0:1788572279.087762:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xae0:0x0], index 0: 0 00000004:00080000:2.0:1788572279.101574:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xae0:0x0], index 1: 0 00000004:00080000:1.0:1788572279.120327:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xae1:0x0], index 0: 0 00000004:00080000:1.0:1788572279.138478:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xae1:0x0], index 1: 0 00000004:00080000:1.0:1788572279.170831:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xae2:0x0], index 0: 0 00000004:00080000:1.0:1788572279.184376:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xae2:0x0], index 1: 0 00000004:00080000:0.0:1788572279.197896:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xae3:0x0], index 0: 0 00000001:00080000:3.0:1788572279.209092:0:111978:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 219043333789 is committed 00000004:00080000:3.0:1788572279.241668:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xae3:0x0], index 1: 0 00000004:00080000:2.0:1788572279.276291:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xae4:0x0], index 0: 0 00000004:00080000:0.0:1788572279.291369:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xae4:0x0], index 1: 0 00000004:00080000:3.0:1788572279.302115:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xae5:0x0], index 0: 0 00000100:00080000:0.0:1788572279.303466:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788572279.311049:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xae5:0x0], index 1: 0 00000004:00080000:2.0:1788572279.326633:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xae6:0x0], index 0: 0 00000004:00080000:0.0:1788572279.339881:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xae6:0x0], index 1: 0 00000004:00080000:2.0:1788572279.352229:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xae7:0x0], index 0: 0 00000004:00080000:1.0:1788572279.368332:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xae7:0x0], index 1: 0 00000004:00080000:3.0:1788572279.379411:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xae8:0x0], index 0: 0 00000004:00080000:2.0:1788572279.391127:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xae8:0x0], index 1: 0 00000004:00080000:3.0:1788572279.402287:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xae9:0x0], index 0: 0 00000004:00080000:1.0:1788572279.414616:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xae9:0x0], index 1: 0 00000004:00080000:0.0:1788572279.426831:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaea:0x0], index 0: 0 00000004:00080000:3.0:1788572279.444487:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaea:0x0], index 1: 0 00000004:00080000:0.0:1788572279.457343:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaeb:0x0], index 0: 0 00000004:00080000:0.0:1788572279.469848:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaeb:0x0], index 1: 0 00000004:00080000:2.0:1788572279.481104:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaec:0x0], index 0: 0 00000004:00080000:2.0:1788572279.497509:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaec:0x0], index 1: 0 00000004:00080000:3.0:1788572279.509782:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaed:0x0], index 0: 0 00000004:00080000:2.0:1788572279.521682:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaed:0x0], index 1: 0 00000004:00080000:2.0:1788572279.533687:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaee:0x0], index 0: 0 00000004:00080000:0.0:1788572279.545671:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaee:0x0], index 1: 0 00000004:00080000:0.0:1788572279.558898:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaef:0x0], index 0: 0 00000004:00080000:0.0:1788572279.573270:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaef:0x0], index 1: 0 00000004:00080000:3.0:1788572279.584888:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaf0:0x0], index 0: 0 00000004:00080000:2.0:1788572279.600505:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaf0:0x0], index 1: 0 00000004:00080000:2.0:1788572279.618946:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaf1:0x0], index 0: 0 00000004:00080000:2.0:1788572279.631791:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaf1:0x0], index 1: 0 00000004:00080000:3.0:1788572279.645243:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaf2:0x0], index 0: 0 00002000:00080000:0.0:1788572279.645957:0:17011:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2818 00000004:00080000:0.0:1788572279.647634:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xaf2:0x0]-[0x280000401:0xb21:0x0] 00000004:00080000:0.0:1788572279.658597:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaf2:0x0], index 1: 0 00000100:00080000:1.0:1788572279.659786:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788572279.662896:0:43976:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2818 00000004:00080000:2.0:1788572279.666340:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xaf2:0x0]-[0x2c0000401:0xb21:0x0] 00000004:00080000:1.0:1788572279.673266:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaf3:0x0], index 0: 0 00000004:00080000:2.0:1788572279.691610:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaf3:0x0], index 1: 0 00000004:00080000:3.0:1788572279.713236:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaf4:0x0], index 0: 0 00000004:00080000:2.0:1788572279.745109:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaf4:0x0], index 1: 0 00000004:00080000:0.0:1788572279.785972:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaf5:0x0], index 0: 0 00000004:00080000:3.0:1788572279.811516:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaf5:0x0], index 1: 0 00000100:00080000:1.0:1788572279.830931:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788572279.852594:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaf6:0x0], index 0: 0 00000004:00080000:1.0:1788572279.881951:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaf6:0x0], index 1: 0 00000004:00080000:0.0:1788572279.906501:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaf7:0x0], index 0: 0 00000004:00080000:0.0:1788572279.925300:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaf7:0x0], index 1: 0 00000004:00080000:0.0:1788572279.943863:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaf8:0x0], index 0: 0 00000004:00080000:0.0:1788572279.959669:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaf8:0x0], index 1: 0 00000004:00080000:0.0:1788572279.984739:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaf9:0x0], index 0: 0 00000100:00080000:1.0:1788572280.002515:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788572280.003517:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaf9:0x0], index 1: 0 00000004:00080000:0.0:1788572280.078524:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xafa:0x0], index 0: 0 00000004:00080000:0.0:1788572280.093568:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xafa:0x0], index 1: 0 00000004:00080000:1.0:1788572280.108518:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xafb:0x0], index 0: 0 00000004:00080000:1.0:1788572280.119944:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xafb:0x0], index 1: 0 00000004:00080000:1.0:1788572280.129093:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xafc:0x0], index 0: 0 00000004:00080000:1.0:1788572280.138726:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xafc:0x0], index 1: 0 00000004:00080000:1.0:1788572280.150075:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xafd:0x0], index 0: 0 00000004:00080000:0.0:1788572280.159568:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xafd:0x0], index 1: 0 00000004:00080000:3.0:1788572280.171822:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xafe:0x0], index 0: 0 00000004:00080000:0.0:1788572280.184233:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xafe:0x0], index 1: 0 00000004:00080000:0.0:1788572280.190476:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xaff:0x0], index 0: 0 00000004:00080000:3.0:1788572280.195925:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xaff:0x0], index 1: 0 00000004:00080000:0.0:1788572280.202583:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb00:0x0], index 0: 0 00000004:00080000:3.0:1788572280.209161:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb00:0x0], index 1: 0 00000004:00080000:0.0:1788572280.215599:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb01:0x0], index 0: 0 00000004:00080000:0.0:1788572280.222872:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb01:0x0], index 1: 0 00000004:00080000:0.0:1788572280.230267:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb02:0x0], index 0: 0 00000004:00080000:1.0:1788572280.237000:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb02:0x0], index 1: 0 00000004:00080000:2.0:1788572280.248265:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb03:0x0], index 0: 0 00000004:00080000:0.0:1788572280.254519:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb03:0x0], index 1: 0 00000004:00080000:0.0:1788572280.261202:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb04:0x0], index 0: 0 00000004:00080000:2.0:1788572280.272048:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb04:0x0], index 1: 0 00000004:00080000:0.0:1788572280.279511:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb05:0x0], index 0: 0 00000004:00080000:0.0:1788572280.290803:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb05:0x0], index 1: 0 00000004:00080000:1.0:1788572280.298196:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb06:0x0], index 0: 0 00000004:00080000:0.0:1788572280.304625:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb06:0x0], index 1: 0 00000004:00080000:0.0:1788572280.311902:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb07:0x0], index 0: 0 00000004:00080000:0.0:1788572280.319165:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb07:0x0], index 1: 0 00000100:00080000:1.0:1788572280.323494:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572280.323635:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572280.325383:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572280.328305:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572280.329579:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788572280.329856:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb08:0x0], index 0: 0 00000004:00080000:1.0:1788572280.336200:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb08:0x0], index 1: 0 00000004:00080000:0.0:1788572280.343145:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb09:0x0], index 0: 0 00000004:00080000:0.0:1788572280.349560:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb09:0x0], index 1: 0 00000004:00080000:0.0:1788572280.356388:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb0a:0x0], index 0: 0 00000004:00080000:1.0:1788572280.363903:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb0a:0x0], index 1: 0 00000004:00080000:0.0:1788572280.370207:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb0b:0x0], index 0: 0 00000004:00080000:0.0:1788572280.377109:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb0b:0x0], index 1: 0 00000004:00080000:1.0:1788572280.383911:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb0c:0x0], index 0: 0 00000004:00080000:0.0:1788572280.390565:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb0c:0x0], index 1: 0 00000004:00080000:1.0:1788572280.397386:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb0d:0x0], index 0: 0 00000004:00080000:0.0:1788572280.404128:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb0d:0x0], index 1: 0 00000004:00080000:0.0:1788572280.411489:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb0e:0x0], index 0: 0 00000004:00080000:1.0:1788572280.418805:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb0e:0x0], index 1: 0 00000004:00080000:0.0:1788572280.430854:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb0f:0x0], index 0: 0 00000004:00080000:0.0:1788572280.444800:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb0f:0x0], index 1: 0 00000004:00080000:0.0:1788572280.460546:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb10:0x0], index 0: 0 00000004:00080000:0.0:1788572280.472771:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb10:0x0], index 1: 0 00000004:00080000:1.0:1788572280.485250:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb11:0x0], index 0: 0 00000004:00080000:0.0:1788572280.493186:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb11:0x0], index 1: 0 00002000:00080000:0.0:1788572280.505860:0:43966:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2850 00000004:00080000:1.0:1788572280.511742:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xb11:0x0]-[0x280000401:0xb41:0x0] 00000004:00080000:0.0:1788572280.511983:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb12:0x0], index 0: 0 00000004:00080000:1.0:1788572280.524366:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb12:0x0], index 1: 0 00002000:00080000:1.0:1788572280.525415:0:43967:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2850 00000004:00080000:3.0:1788572280.528447:0:112001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xb12:0x0]-[0x2c0000401:0xb41:0x0] 00000004:00080000:0.0:1788572280.546788:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb13:0x0], index 0: 0 00000004:00080000:2.0:1788572280.573920:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb13:0x0], index 1: 0 00000004:00080000:0.0:1788572280.591920:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb14:0x0], index 0: 0 00000004:00080000:1.0:1788572280.609651:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb14:0x0], index 1: 0 00000004:00080000:1.0:1788572280.629786:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb15:0x0], index 0: 0 00000004:00080000:0.0:1788572280.657942:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb15:0x0], index 1: 0 00000004:00080000:0.0:1788572280.693286:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb16:0x0], index 0: 0 00000004:00080000:2.0:1788572280.716074:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb16:0x0], index 1: 0 00000100:00080000:2.0:1788572280.737034:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572280.737475:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788572280.753229:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb17:0x0], index 0: 0 00000004:00080000:1.0:1788572280.792894:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb17:0x0], index 1: 0 00000004:00080000:1.0:1788572280.806844:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb18:0x0], index 0: 0 00000004:00080000:1.0:1788572280.820316:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb18:0x0], index 1: 0 00000004:00080000:1.0:1788572280.833302:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb19:0x0], index 0: 0 00000004:00080000:1.0:1788572280.873214:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb19:0x0], index 1: 0 00000004:00080000:1.0:1788572280.898996:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb1a:0x0], index 0: 0 00000004:00080000:1.0:1788572280.919715:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb1a:0x0], index 1: 0 00000004:00080000:1.0:1788572280.949553:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb1b:0x0], index 0: 0 00000004:00080000:0.0:1788572280.971386:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb1b:0x0], index 1: 0 00000004:00080000:1.0:1788572281.002625:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb1c:0x0], index 0: 0 00000004:00080000:3.0:1788572281.021628:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb1c:0x0], index 1: 0 00000004:00080000:1.0:1788572281.047554:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb1d:0x0], index 0: 0 00000004:00080000:3.0:1788572281.066436:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb1d:0x0], index 1: 0 00000004:00080000:3.0:1788572281.080236:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb1e:0x0], index 0: 0 00000004:00080000:0.0:1788572281.094793:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb1e:0x0], index 1: 0 00000004:00080000:0.0:1788572281.105873:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb1f:0x0], index 0: 0 00000004:00080000:0.0:1788572281.117807:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb1f:0x0], index 1: 0 00000004:00080000:0.0:1788572281.136932:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb20:0x0], index 0: 0 00000004:00080000:0.0:1788572281.149906:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb20:0x0], index 1: 0 00000004:00080000:0.0:1788572281.158369:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb21:0x0], index 0: 0 00000004:00080000:2.0:1788572281.167550:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb21:0x0], index 1: 0 00000004:00080000:0.0:1788572281.179502:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb22:0x0], index 0: 0 00000004:00080000:3.0:1788572281.190616:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb22:0x0], index 1: 0 00000004:00080000:0.0:1788572281.203083:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb23:0x0], index 0: 0 00000004:00080000:3.0:1788572281.216716:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb23:0x0], index 1: 0 00000004:00080000:3.0:1788572281.225637:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb24:0x0], index 0: 0 00000004:00080000:3.0:1788572281.233499:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb24:0x0], index 1: 0 00000004:00080000:3.0:1788572281.248251:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb25:0x0], index 0: 0 00000004:00080000:0.0:1788572281.267838:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb25:0x0], index 1: 0 00000004:00080000:3.0:1788572281.279787:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb26:0x0], index 0: 0 00000004:00080000:2.0:1788572281.290997:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb26:0x0], index 1: 0 00000004:00080000:2.0:1788572281.300927:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb27:0x0], index 0: 0 00000004:00080000:3.0:1788572281.309433:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb27:0x0], index 1: 0 00000004:00080000:2.0:1788572281.319225:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb28:0x0], index 0: 0 00000004:00080000:0.0:1788572281.335530:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb28:0x0], index 1: 0 00000004:00080000:3.0:1788572281.351471:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb29:0x0], index 0: 0 00000004:00080000:1.0:1788572281.368570:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb29:0x0], index 1: 0 00000004:00080000:1.0:1788572281.382735:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb2a:0x0], index 0: 0 00000004:00080000:3.0:1788572281.394140:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb2a:0x0], index 1: 0 00000004:00080000:3.0:1788572281.407478:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb2b:0x0], index 0: 0 00000004:00080000:2.0:1788572281.422272:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb2b:0x0], index 1: 0 00000004:00080000:3.0:1788572281.434284:0:6551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb2c:0x0], index 0: 0 00000004:00080000:3.0:1788572281.445906:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb2c:0x0], index 1: 0 00000004:00080000:0.0:1788572281.464997:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb2d:0x0], index 0: 0 00000004:00080000:1.0:1788572281.479952:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb2d:0x0], index 1: 0 00000004:00080000:0.0:1788572281.515313:0:95742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb2e:0x0], index 0: 0 00000004:00080000:0.0:1788572281.527889:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb2e:0x0], index 1: 0 00000004:00080000:1.0:1788572281.550466:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb2f:0x0], index 0: 0 00000004:00080000:2.0:1788572281.565668:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb2f:0x0], index 1: 0 00000004:00080000:0.0:1788572281.590462:0:6552:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb30:0x0], index 0: 0 00000004:00080000:1.0:1788572281.607380:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb30:0x0], index 1: 0 00000004:00080000:2.0:1788572281.617620:0:6550:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb31:0x0], index 0: 0 00000004:00080000:2.0:1788572281.635069:0:9276:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0xb31:0x0], index 1: 0 00000004:00080000:0.0:1788572281.659964:0:10390:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0xb32:0x0], index 0: 0 00002000:00080000:3.0:1788572281.660599:0:17011:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2882 00000100:00080000:2.0:1788572281.661231:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788572281.668294:0:111999:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xb32:0x0]-[0x280000401:0xb61:0x0] 00010000:00010000:1.0:1788572283.587320:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572283.913127:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572283.913149:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639023488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572283.913216:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572283.913284:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639023488 00000100:00100000:0.0:1788572283.913291:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639023488 00000100:00100000:0.0:1788572283.913342:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:0.0:1788572283.913353:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3653:x1875449639023488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572283.913380:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484838976 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572283.913427:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3653:x1875449639023488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572283.913433:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00000100:00080000:0.0:1788572283.913459:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572283.913525:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639023488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572283.916129:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639023616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572283.916235:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572283.916988:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639023616 00000100:00100000:2.0:1788572283.917033:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639023616 00000100:00100000:2.0:1788572283.917095:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703 00000100:00100000:2.0:1788572283.917106:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639023616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572283.917141:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:2.0:1788572283.917221:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639023616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572283.917228:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703 00000100:00100000:2.0:1788572283.917279:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639023616:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788572283.918701:0:16234:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589935776 is committed 00000001:00080000:2.0:1788572283.920472:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968476 is committed 00000001:00080000:3.0:1788572284.092110:0:111978:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 219043334106 is committed 00010000:00010000:0.0:1788572284.102929:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642200/0xdb7edb52b832e2b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e9806f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.102963:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642200/0xdb7edb52b832e2b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e9806f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.102973:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642200/0xdb7edb52b832e2b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e9806f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.102979:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637642200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.102985:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642200/0xdb7edb52b832e2b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e9806f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.108197:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642200/0xdb7edb52b832e2b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e9806f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.108230:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4e9806f1 (ffff94e64167e900) 00010000:00010000:0.0:1788572284.108234:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.108312:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642200/0xdb7edb52b832e2b2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4e9806f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.108321:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642200/0xdb7edb52b832e2b2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4e9806f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.108370:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f400/0xdb7edb52b832e2e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6db2fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.108379:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f400/0xdb7edb52b832e2e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6db2fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.108386:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f400/0xdb7edb52b832e2e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6db2fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.108392:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64158f400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.108396:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f400/0xdb7edb52b832e2e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6db2fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.108402:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f400/0xdb7edb52b832e2e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6db2fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.108411:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6db2fb94 (ffff94e61ebcdd00) 00010000:00010000:0.0:1788572284.108413:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.108417:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f400/0xdb7edb52b832e2e3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6db2fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.108422:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f400/0xdb7edb52b832e2e3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6db2fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.109325:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778aa00/0xdb7edb52b832e314 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabf6a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.109338:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778aa00/0xdb7edb52b832e314 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabf6a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.109344:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778aa00/0xdb7edb52b832e314 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabf6a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.109350:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63778aa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.109354:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778aa00/0xdb7edb52b832e314 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabf6a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.109361:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778aa00/0xdb7edb52b832e314 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabf6a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.109372:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xabf6a63 (ffff94e63ab4b300) 00010000:00010000:0.0:1788572284.109376:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.109379:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778aa00/0xdb7edb52b832e314 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xabf6a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.109385:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778aa00/0xdb7edb52b832e314 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xabf6a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.109412:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643c00/0xdb7edb52b832e345 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc796446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.109418:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643c00/0xdb7edb52b832e345 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc796446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.109423:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643c00/0xdb7edb52b832e345 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc796446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110205:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637643c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110215:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643c00/0xdb7edb52b832e345 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc796446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110225:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643c00/0xdb7edb52b832e345 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc796446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110247:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc796446 (ffff94e64167e500) 00010000:00010000:0.0:1788572284.110250:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.110255:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643c00/0xdb7edb52b832e345 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc796446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110261:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643c00/0xdb7edb52b832e345 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc796446 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110290:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b832e376 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e166895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110297:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b832e376 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e166895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110304:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b832e376 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e166895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110309:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172f600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110312:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b832e376 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e166895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110317:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b832e376 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e166895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110325:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e166895 (ffff94e64167e800) 00010000:00010000:0.0:1788572284.110327:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.110330:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b832e376 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e166895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110336:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b832e376 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e166895 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110351:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f400/0xdb7edb52b832e3a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6fcf67b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110362:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f400/0xdb7edb52b832e3a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6fcf67b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110368:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f400/0xdb7edb52b832e3a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6fcf67b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110373:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172f400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110376:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f400/0xdb7edb52b832e3a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6fcf67b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110382:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f400/0xdb7edb52b832e3a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6fcf67b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110389:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6fcf67b8 (ffff94e64167e400) 00010000:00010000:0.0:1788572284.110391:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.110394:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f400/0xdb7edb52b832e3a7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6fcf67b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110400:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f400/0xdb7edb52b832e3a7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6fcf67b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110415:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778be00/0xdb7edb52b832e3d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd094dfb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110422:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778be00/0xdb7edb52b832e3d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd094dfb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110427:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778be00/0xdb7edb52b832e3d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd094dfb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110445:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63778be00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110450:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778be00/0xdb7edb52b832e3d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd094dfb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110456:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778be00/0xdb7edb52b832e3d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd094dfb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110464:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd094dfb7 (ffff94e63ab4b600) 00010000:00010000:0.0:1788572284.110466:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.110469:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778be00/0xdb7edb52b832e3d8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd094dfb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110475:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778be00/0xdb7edb52b832e3d8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd094dfb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110497:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e200/0xdb7edb52b832e409 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe7aed99a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110503:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e200/0xdb7edb52b832e409 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe7aed99a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110508:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e200/0xdb7edb52b832e409 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe7aed99a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110513:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64158e200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110515:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e200/0xdb7edb52b832e409 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe7aed99a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110521:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e200/0xdb7edb52b832e409 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe7aed99a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110541:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe7aed99a (ffff94e61ebcd600) 00010000:00010000:0.0:1788572284.110543:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.110554:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e200/0xdb7edb52b832e409 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe7aed99a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110560:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e200/0xdb7edb52b832e409 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe7aed99a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110577:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb800/0xdb7edb52b832e43a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6e57c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110584:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb800/0xdb7edb52b832e43a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6e57c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110590:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb800/0xdb7edb52b832e43a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6e57c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110595:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6349fb800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110597:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb800/0xdb7edb52b832e43a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6e57c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110603:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb800/0xdb7edb52b832e43a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6e57c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110611:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6e57c6 (ffff94e60fef1800) 00010000:00010000:0.0:1788572284.110613:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.110616:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb800/0xdb7edb52b832e43a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6e57c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110621:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb800/0xdb7edb52b832e43a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6e57c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110637:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b832e46b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde7356e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110648:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b832e46b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde7356e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110653:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b832e46b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde7356e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110658:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172fc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110661:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b832e46b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde7356e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110666:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b832e46b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde7356e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110673:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xde7356e9 (ffff94e64167e700) 00010000:00010000:0.0:1788572284.110676:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.110678:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b832e46b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xde7356e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110684:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b832e46b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xde7356e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110698:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fc00/0xdb7edb52b832e49c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8e0c078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110705:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fc00/0xdb7edb52b832e49c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8e0c078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110710:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fc00/0xdb7edb52b832e49c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8e0c078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110716:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64158fc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110719:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fc00/0xdb7edb52b832e49c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8e0c078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110724:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fc00/0xdb7edb52b832e49c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa8e0c078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110731:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa8e0c078 (ffff94e61ebcd200) 00010000:00010000:0.0:1788572284.110733:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.110736:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fc00/0xdb7edb52b832e49c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa8e0c078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110740:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fc00/0xdb7edb52b832e49c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa8e0c078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110756:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e400/0xdb7edb52b832e4cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7fbb51b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110761:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e400/0xdb7edb52b832e4cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7fbb51b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110767:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e400/0xdb7edb52b832e4cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7fbb51b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110772:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172e400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110775:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e400/0xdb7edb52b832e4cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7fbb51b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110781:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e400/0xdb7edb52b832e4cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc7fbb51b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110787:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc7fbb51b (ffff94e64167ec00) 00010000:00010000:0.0:1788572284.110789:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.110793:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e400/0xdb7edb52b832e4cd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc7fbb51b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110798:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e400/0xdb7edb52b832e4cd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc7fbb51b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110814:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fba00/0xdb7edb52b832e4fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x779299ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110821:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fba00/0xdb7edb52b832e4fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x779299ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110826:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fba00/0xdb7edb52b832e4fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x779299ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110831:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6349fba00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110834:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fba00/0xdb7edb52b832e4fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x779299ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110840:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fba00/0xdb7edb52b832e4fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x779299ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110847:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x779299ea (ffff94e60fef1500) 00010000:00010000:0.0:1788572284.110850:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.110853:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fba00/0xdb7edb52b832e4fe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x779299ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110858:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fba00/0xdb7edb52b832e4fe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x779299ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110872:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ac00/0xdb7edb52b832e52f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x78f893cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110884:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ac00/0xdb7edb52b832e52f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x78f893cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110890:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ac00/0xdb7edb52b832e52f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x78f893cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110895:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63778ac00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110899:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ac00/0xdb7edb52b832e52f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x78f893cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110904:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ac00/0xdb7edb52b832e52f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x78f893cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110912:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x78f893cd (ffff94e63ab4ba00) 00010000:00010000:0.0:1788572284.110914:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.110917:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ac00/0xdb7edb52b832e52f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x78f893cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110923:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ac00/0xdb7edb52b832e52f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x78f893cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110940:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642800/0xdb7edb52b832e560 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b66f81c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110958:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642800/0xdb7edb52b832e560 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b66f81c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110963:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642800/0xdb7edb52b832e560 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b66f81c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110969:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637642800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.110972:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642800/0xdb7edb52b832e560 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b66f81c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110978:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642800/0xdb7edb52b832e560 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b66f81c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.110986:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4b66f81c (ffff94e64167e600) 00010000:00010000:0.0:1788572284.110998:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111001:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642800/0xdb7edb52b832e560 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4b66f81c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111032:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642800/0xdb7edb52b832e560 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4b66f81c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111053:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b832e591 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb51ff73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111060:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b832e591 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb51ff73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111066:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b832e591 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb51ff73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111070:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e524800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111073:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b832e591 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb51ff73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111079:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b832e591 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb51ff73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111087:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb51ff73f (ffff94e63ab4be00) 00010000:00010000:0.0:1788572284.111089:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111093:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b832e591 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb51ff73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111100:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b832e591 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb51ff73f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111117:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b832e5c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf1290f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111123:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b832e5c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf1290f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111129:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b832e5c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf1290f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111135:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e525400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111137:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b832e5c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf1290f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111143:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b832e5c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf1290f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111150:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf1290f3e (ffff94e63ab4bb00) 00010000:00010000:0.0:1788572284.111152:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111155:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b832e5c2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf1290f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111161:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b832e5c2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf1290f3e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111181:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fe00/0xdb7edb52b832e5f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x60430921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111190:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fe00/0xdb7edb52b832e5f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x60430921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111196:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fe00/0xdb7edb52b832e5f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x60430921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111201:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64158fe00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111204:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fe00/0xdb7edb52b832e5f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x60430921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111209:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fe00/0xdb7edb52b832e5f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x60430921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111217:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x60430921 (ffff94e61ebcd100) 00010000:00010000:0.0:1788572284.111220:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111223:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fe00/0xdb7edb52b832e5f3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x60430921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111228:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158fe00/0xdb7edb52b832e5f3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x60430921 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111244:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f800/0xdb7edb52b832e624 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabe2b4be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111250:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f800/0xdb7edb52b832e624 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabe2b4be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111255:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f800/0xdb7edb52b832e624 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabe2b4be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111260:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64158f800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111263:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f800/0xdb7edb52b832e624 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabe2b4be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111269:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f800/0xdb7edb52b832e624 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xabe2b4be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111276:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xabe2b4be (ffff94e61ebcd800) 00010000:00010000:0.0:1788572284.111278:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111280:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f800/0xdb7edb52b832e624 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xabe2b4be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111286:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158f800/0xdb7edb52b832e624 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xabe2b4be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111300:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643200/0xdb7edb52b832e655 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2aa8aea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111307:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643200/0xdb7edb52b832e655 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2aa8aea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111313:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643200/0xdb7edb52b832e655 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2aa8aea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111318:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637643200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111322:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643200/0xdb7edb52b832e655 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2aa8aea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111329:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643200/0xdb7edb52b832e655 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2aa8aea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111337:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2aa8aea1 (ffff94e64167ef00) 00010000:00010000:0.0:1788572284.111340:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111344:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643200/0xdb7edb52b832e655 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2aa8aea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111351:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637643200/0xdb7edb52b832e655 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2aa8aea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111368:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80000/0xdb7edb52b832e686 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe05f9d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111375:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80000/0xdb7edb52b832e686 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe05f9d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111381:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80000/0xdb7edb52b832e686 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe05f9d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111387:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa80000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111390:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80000/0xdb7edb52b832e686 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe05f9d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111397:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80000/0xdb7edb52b832e686 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe05f9d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111405:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe05f9d70 (ffff94e63a8b3d00) 00010000:00010000:0.0:1788572284.111408:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111411:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80000/0xdb7edb52b832e686 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe05f9d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111418:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80000/0xdb7edb52b832e686 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe05f9d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111438:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80400/0xdb7edb52b832e6b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa77a9213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111449:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80400/0xdb7edb52b832e6b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa77a9213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111454:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80400/0xdb7edb52b832e6b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa77a9213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111459:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa80400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111463:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80400/0xdb7edb52b832e6b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa77a9213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111470:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80400/0xdb7edb52b832e6b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa77a9213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111477:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa77a9213 (ffff94e63a8b3f00) 00010000:00010000:0.0:1788572284.111480:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111483:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80400/0xdb7edb52b832e6b7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa77a9213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111490:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80400/0xdb7edb52b832e6b7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa77a9213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111506:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525200/0xdb7edb52b832e6e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x196a9ba2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111513:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525200/0xdb7edb52b832e6e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x196a9ba2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111519:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525200/0xdb7edb52b832e6e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x196a9ba2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111524:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e525200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111529:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525200/0xdb7edb52b832e6e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x196a9ba2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111535:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525200/0xdb7edb52b832e6e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x196a9ba2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111543:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x196a9ba2 (ffff94e63ab4b400) 00010000:00010000:0.0:1788572284.111545:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111548:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525200/0xdb7edb52b832e6e8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x196a9ba2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111554:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525200/0xdb7edb52b832e6e8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x196a9ba2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111570:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524000/0xdb7edb52b832e719 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed6f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111577:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524000/0xdb7edb52b832e719 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed6f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111584:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524000/0xdb7edb52b832e719 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed6f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111589:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e524000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111592:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524000/0xdb7edb52b832e719 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed6f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111598:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524000/0xdb7edb52b832e719 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed6f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111606:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed6f9ac5 (ffff94e63ab4bc00) 00010000:00010000:0.0:1788572284.111608:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111611:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524000/0xdb7edb52b832e719 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed6f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111617:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524000/0xdb7edb52b832e719 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed6f9ac5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111631:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b800/0xdb7edb52b832e74a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbfddff14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111637:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b800/0xdb7edb52b832e74a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbfddff14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111643:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b800/0xdb7edb52b832e74a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbfddff14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111648:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63778b800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111651:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b800/0xdb7edb52b832e74a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbfddff14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111657:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b800/0xdb7edb52b832e74a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbfddff14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111664:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfddff14 (ffff94e615913200) 00010000:00010000:0.0:1788572284.111667:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111670:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b800/0xdb7edb52b832e74a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbfddff14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111676:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b800/0xdb7edb52b832e74a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbfddff14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111710:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642e00/0xdb7edb52b832e77b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2ef7f8f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111721:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642e00/0xdb7edb52b832e77b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2ef7f8f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111728:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642e00/0xdb7edb52b832e77b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2ef7f8f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111733:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637642e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111736:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642e00/0xdb7edb52b832e77b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2ef7f8f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111743:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642e00/0xdb7edb52b832e77b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2ef7f8f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111749:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ef7f8f7 (ffff94e607edda00) 00010000:00010000:0.0:1788572284.111751:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111755:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642e00/0xdb7edb52b832e77b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2ef7f8f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111761:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637642e00/0xdb7edb52b832e77b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2ef7f8f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111777:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e600/0xdb7edb52b832e7ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x84a010f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111784:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e600/0xdb7edb52b832e7ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x84a010f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111791:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e600/0xdb7edb52b832e7ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x84a010f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111795:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64158e600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111799:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e600/0xdb7edb52b832e7ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x84a010f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111806:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e600/0xdb7edb52b832e7ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x84a010f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111814:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x84a010f6 (ffff94e63a8b3600) 00010000:00010000:0.0:1788572284.111816:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111820:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e600/0xdb7edb52b832e7ac lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x84a010f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111825:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e600/0xdb7edb52b832e7ac lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x84a010f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111842:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fc600/0xdb7edb52b832e7dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9227019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111848:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fc600/0xdb7edb52b832e7dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9227019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111853:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fc600/0xdb7edb52b832e7dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9227019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111857:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9fc600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111860:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fc600/0xdb7edb52b832e7dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9227019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111866:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fc600/0xdb7edb52b832e7dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9227019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111873:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9227019 (ffff94e64167d800) 00010000:00010000:0.0:1788572284.111875:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111878:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fc600/0xdb7edb52b832e7dd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9227019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111883:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fc600/0xdb7edb52b832e7dd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9227019 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111899:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fde00/0xdb7edb52b832e80e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b652393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111906:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fde00/0xdb7edb52b832e80e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b652393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111911:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fde00/0xdb7edb52b832e80e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b652393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111916:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9fde00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111919:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fde00/0xdb7edb52b832e80e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b652393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111926:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fde00/0xdb7edb52b832e80e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5b652393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111933:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b652393 (ffff94e64167d900) 00010000:00010000:0.0:1788572284.111935:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.111938:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fde00/0xdb7edb52b832e80e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5b652393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111944:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fde00/0xdb7edb52b832e80e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5b652393 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111960:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6a00/0xdb7edb52b832e83f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca7f1d76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111972:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6a00/0xdb7edb52b832e83f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca7f1d76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111978:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6a00/0xdb7edb52b832e83f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca7f1d76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.111983:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fcd6a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.111986:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6a00/0xdb7edb52b832e83f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca7f1d76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112038:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6a00/0xdb7edb52b832e83f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xca7f1d76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112046:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xca7f1d76 (ffff94e607edd500) 00010000:00010000:0.0:1788572284.112048:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112052:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6a00/0xdb7edb52b832e83f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xca7f1d76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112057:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6a00/0xdb7edb52b832e83f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xca7f1d76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112074:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b832e870 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91ae2c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112080:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b832e870 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91ae2c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112086:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b832e870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91ae2c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112090:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172ec00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112093:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b832e870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91ae2c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112099:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b832e870 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91ae2c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112105:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91ae2c45 (ffff94e6416ac000) 00010000:00010000:0.0:1788572284.112107:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112110:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b832e870 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91ae2c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112114:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b832e870 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91ae2c45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112131:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fac00/0xdb7edb52b832e8a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x614680e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112137:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fac00/0xdb7edb52b832e8a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x614680e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112143:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fac00/0xdb7edb52b832e8a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x614680e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112148:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6349fac00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112150:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fac00/0xdb7edb52b832e8a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x614680e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112154:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fac00/0xdb7edb52b832e8a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x614680e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112161:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x614680e8 (ffff94e60fef1300) 00010000:00010000:0.0:1788572284.112163:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112166:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fac00/0xdb7edb52b832e8a1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x614680e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112171:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fac00/0xdb7edb52b832e8a1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x614680e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112184:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7000/0xdb7edb52b832e8d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2e28a77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112190:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7000/0xdb7edb52b832e8d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2e28a77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112195:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7000/0xdb7edb52b832e8d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2e28a77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112199:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fcd7000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112201:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7000/0xdb7edb52b832e8d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2e28a77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112206:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7000/0xdb7edb52b832e8d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2e28a77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112213:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe2e28a77 (ffff94e607edd200) 00010000:00010000:0.0:1788572284.112215:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112217:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7000/0xdb7edb52b832e8d2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe2e28a77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112222:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7000/0xdb7edb52b832e8d2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe2e28a77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112235:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6c00/0xdb7edb52b832e903 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x12435f9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112244:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6c00/0xdb7edb52b832e903 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x12435f9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112249:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6c00/0xdb7edb52b832e903 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x12435f9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112254:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fcd6c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112256:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6c00/0xdb7edb52b832e903 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x12435f9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112262:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6c00/0xdb7edb52b832e903 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x12435f9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112269:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12435f9a (ffff94e607eddc00) 00010000:00010000:0.0:1788572284.112271:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112273:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6c00/0xdb7edb52b832e903 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x12435f9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112279:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd6c00/0xdb7edb52b832e903 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x12435f9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112292:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fd400/0xdb7edb52b832e934 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc3463e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112297:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fd400/0xdb7edb52b832e934 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc3463e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112302:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fd400/0xdb7edb52b832e934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc3463e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112307:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9fd400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112311:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fd400/0xdb7edb52b832e934 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc3463e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112316:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fd400/0xdb7edb52b832e934 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc3463e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112322:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdc3463e9 (ffff94e64167d400) 00010000:00010000:0.0:1788572284.112324:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112326:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fd400/0xdb7edb52b832e934 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdc3463e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112332:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fd400/0xdb7edb52b832e934 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdc3463e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112348:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fda00/0xdb7edb52b832e965 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbcbbdcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112354:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fda00/0xdb7edb52b832e965 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbcbbdcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112359:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fda00/0xdb7edb52b832e965 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbcbbdcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112363:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9fda00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112366:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fda00/0xdb7edb52b832e965 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbcbbdcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112372:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fda00/0xdb7edb52b832e965 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbcbbdcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112378:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbcbbdcc (ffff94e613542000) 00010000:00010000:0.0:1788572284.112380:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112384:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fda00/0xdb7edb52b832e965 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfbcbbdcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112390:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9fda00/0xdb7edb52b832e965 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfbcbbdcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112409:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7600/0xdb7edb52b832e996 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a73db0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112415:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7600/0xdb7edb52b832e996 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a73db0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112421:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7600/0xdb7edb52b832e996 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a73db0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112426:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fcd7600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112442:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7600/0xdb7edb52b832e996 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a73db0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112450:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7600/0xdb7edb52b832e996 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8a73db0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112458:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a73db0b (ffff94e607edd400) 00010000:00010000:0.0:1788572284.112460:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112463:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7600/0xdb7edb52b832e996 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8a73db0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112469:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7600/0xdb7edb52b832e996 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8a73db0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112485:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa81600/0xdb7edb52b832e9c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf98dd4ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112496:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa81600/0xdb7edb52b832e9c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf98dd4ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112502:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa81600/0xdb7edb52b832e9c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf98dd4ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112508:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa81600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112511:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa81600/0xdb7edb52b832e9c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf98dd4ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112517:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa81600/0xdb7edb52b832e9c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf98dd4ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112525:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf98dd4ee (ffff94e64167d200) 00010000:00010000:0.0:1788572284.112527:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112530:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa81600/0xdb7edb52b832e9c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf98dd4ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112535:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa81600/0xdb7edb52b832e9c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf98dd4ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112550:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349faa00/0xdb7edb52b832e9f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7372d9ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112557:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349faa00/0xdb7edb52b832e9f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7372d9ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112562:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349faa00/0xdb7edb52b832e9f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7372d9ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112568:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6349faa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112571:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349faa00/0xdb7edb52b832e9f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7372d9ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112577:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349faa00/0xdb7edb52b832e9f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7372d9ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112585:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7372d9ac (ffff94e60fef1f00) 00010000:00010000:0.0:1788572284.112588:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112591:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349faa00/0xdb7edb52b832e9f8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7372d9ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112596:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349faa00/0xdb7edb52b832e9f8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7372d9ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112612:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80a00/0xdb7edb52b832ea29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7edce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112617:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80a00/0xdb7edb52b832ea29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7edce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112623:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80a00/0xdb7edb52b832ea29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7edce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112628:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa80a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112630:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80a00/0xdb7edb52b832ea29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7edce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112636:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80a00/0xdb7edb52b832ea29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb7edce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112643:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb7edce4f (ffff94e60fe40000) 00010000:00010000:0.0:1788572284.112645:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112649:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80a00/0xdb7edb52b832ea29 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb7edce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112655:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa80a00/0xdb7edb52b832ea29 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb7edce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112671:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ba00/0xdb7edb52b832ea5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7f1cdd1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112677:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ba00/0xdb7edb52b832ea5a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7f1cdd1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112683:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ba00/0xdb7edb52b832ea5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7f1cdd1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112689:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63778ba00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112692:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ba00/0xdb7edb52b832ea5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7f1cdd1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112698:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ba00/0xdb7edb52b832ea5a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7f1cdd1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112706:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7f1cdd1e (ffff94e60fe40400) 00010000:00010000:0.0:1788572284.112708:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112711:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ba00/0xdb7edb52b832ea5a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7f1cdd1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112717:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778ba00/0xdb7edb52b832ea5a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7f1cdd1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112736:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b832ea8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21543701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112747:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b832ea8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21543701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112754:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b832ea8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21543701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112759:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e525600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112762:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b832ea8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21543701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112769:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b832ea8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x21543701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112777:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x21543701 (ffff94e60fe40500) 00010000:00010000:0.0:1788572284.112780:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112783:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b832ea8b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21543701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112789:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b832ea8b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x21543701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112806:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b832eabc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0513b50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112812:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b832eabc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0513b50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112818:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b832eabc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0513b50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112822:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112826:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b832eabc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0513b50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112832:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b832eabc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0513b50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112839:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd0513b50 (ffff94e63aaaca00) 00010000:00010000:0.0:1788572284.112842:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112844:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b832eabc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd0513b50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112850:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641280c00/0xdb7edb52b832eabc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd0513b50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112869:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa1c000/0xdb7edb52b832eaed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94aa3a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112875:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa1c000/0xdb7edb52b832eaed lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94aa3a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112881:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa1c000/0xdb7edb52b832eaed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94aa3a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112886:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1c000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112889:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa1c000/0xdb7edb52b832eaed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94aa3a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112894:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa1c000/0xdb7edb52b832eaed lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94aa3a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112901:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94aa3a73 (ffff94e60fe40600) 00010000:00010000:0.0:1788572284.112903:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112907:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa1c000/0xdb7edb52b832eaed lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94aa3a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112913:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa1c000/0xdb7edb52b832eaed lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94aa3a73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112929:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e800/0xdb7edb52b832eb1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x893a4402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112936:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e800/0xdb7edb52b832eb1e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x893a4402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112941:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e800/0xdb7edb52b832eb1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x893a4402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112946:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64158e800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.112950:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e800/0xdb7edb52b832eb1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x893a4402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112956:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e800/0xdb7edb52b832eb1e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x893a4402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112963:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x893a4402 (ffff94e64167e000) 00010000:00010000:0.0:1788572284.112966:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.112969:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e800/0xdb7edb52b832eb1e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x893a4402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.112976:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64158e800/0xdb7edb52b832eb1e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x893a4402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114040:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f200/0xdb7edb52b832eb4f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbc3d18a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114062:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f200/0xdb7edb52b832eb4f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbc3d18a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114069:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f200/0xdb7edb52b832eb4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbc3d18a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114075:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172f200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.114079:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f200/0xdb7edb52b832eb4f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbc3d18a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114087:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f200/0xdb7edb52b832eb4f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbc3d18a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114331:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc3d18a5 (ffff94e6416c0300) 00010000:00010000:0.0:1788572284.114335:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.114340:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f200/0xdb7edb52b832eb4f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbc3d18a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114347:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f200/0xdb7edb52b832eb4f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbc3d18a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114374:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b832eb80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x799130a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114380:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b832eb80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x799130a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114387:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b832eb80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x799130a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114392:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.114396:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b832eb80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x799130a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114402:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b832eb80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x799130a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114410:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x799130a4 (ffff94e6416c0200) 00010000:00010000:0.0:1788572284.114413:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.114415:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b832eb80 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x799130a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114421:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641281400/0xdb7edb52b832eb80 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x799130a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114453:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb200/0xdb7edb52b832ebb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3dea2fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114460:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb200/0xdb7edb52b832ebb1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3dea2fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114466:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb200/0xdb7edb52b832ebb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3dea2fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114471:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6349fb200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.114474:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb200/0xdb7edb52b832ebb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3dea2fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114480:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb200/0xdb7edb52b832ebb1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3dea2fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114489:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3dea2fc7 (ffff94e641540300) 00010000:00010000:0.0:1788572284.114491:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.114495:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb200/0xdb7edb52b832ebb1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3dea2fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114501:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fb200/0xdb7edb52b832ebb1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3dea2fc7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114518:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789200/0xdb7edb52b832ebe2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf0f8537 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114524:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789200/0xdb7edb52b832ebe2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf0f8537 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114530:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789200/0xdb7edb52b832ebe2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf0f8537 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114534:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637789200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.114538:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789200/0xdb7edb52b832ebe2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf0f8537 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114544:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789200/0xdb7edb52b832ebe2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf0f8537 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114887:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf0f8537 (ffff94e641540900) 00010000:00010000:0.0:1788572284.114889:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.114893:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789200/0xdb7edb52b832ebe2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf0f8537 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114899:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789200/0xdb7edb52b832ebe2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf0f8537 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114917:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789600/0xdb7edb52b832ec13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e297f1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114927:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789600/0xdb7edb52b832ec13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e297f1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114933:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789600/0xdb7edb52b832ec13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e297f1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114937:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637789600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.114949:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789600/0xdb7edb52b832ec13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e297f1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114955:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789600/0xdb7edb52b832ec13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e297f1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114963:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e297f1a (ffff94e641540400) 00010000:00010000:0.0:1788572284.114966:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.114969:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789600/0xdb7edb52b832ec13 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e297f1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.114975:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789600/0xdb7edb52b832ec13 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e297f1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115000:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789c00/0xdb7edb52b832ec44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5048de9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115050:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789c00/0xdb7edb52b832ec44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5048de9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115055:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789c00/0xdb7edb52b832ec44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5048de9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115060:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637789c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.115063:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789c00/0xdb7edb52b832ec44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5048de9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115069:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789c00/0xdb7edb52b832ec44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5048de9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115076:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5048de9 (ffff94e641540800) 00010000:00010000:0.0:1788572284.115079:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.115081:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789c00/0xdb7edb52b832ec44 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5048de9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115087:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637789c00/0xdb7edb52b832ec44 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5048de9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115116:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fa600/0xdb7edb52b832ec75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x241f828c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115123:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fa600/0xdb7edb52b832ec75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x241f828c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115129:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fa600/0xdb7edb52b832ec75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x241f828c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115134:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6349fa600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.115138:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fa600/0xdb7edb52b832ec75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x241f828c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115143:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fa600/0xdb7edb52b832ec75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x241f828c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115150:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x241f828c (ffff94e641540a00) 00010000:00010000:0.0:1788572284.115152:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.115155:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fa600/0xdb7edb52b832ec75 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x241f828c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115161:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fa600/0xdb7edb52b832ec75 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x241f828c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115178:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b400/0xdb7edb52b832eca6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8826c1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115185:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b400/0xdb7edb52b832eca6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8826c1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115191:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b400/0xdb7edb52b832eca6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8826c1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115196:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63778b400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.115198:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b400/0xdb7edb52b832eca6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8826c1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115203:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b400/0xdb7edb52b832eca6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8826c1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115210:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8826c1b (ffff94e60fe70e00) 00010000:00010000:0.0:1788572284.115212:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.115215:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b400/0xdb7edb52b832eca6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8826c1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115221:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63778b400/0xdb7edb52b832eca6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8826c1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115250:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7200/0xdb7edb52b832ecd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfe3413e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115260:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7200/0xdb7edb52b832ecd7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfe3413e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115265:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7200/0xdb7edb52b832ecd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfe3413e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115269:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fcd7200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.115272:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7200/0xdb7edb52b832ecd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfe3413e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115277:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7200/0xdb7edb52b832ecd7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfe3413e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115284:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfe3413e (ffff94e607edd600) 00010000:00010000:0.0:1788572284.115286:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.115289:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7200/0xdb7edb52b832ecd7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdfe3413e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115294:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7200/0xdb7edb52b832ecd7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdfe3413e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115314:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b832ed08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4734acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115319:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b832ed08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4734acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115325:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b832ed08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4734acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115330:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a973000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.115333:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b832ed08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4734acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115339:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b832ed08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4734acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115345:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd4734acd (ffff94e60fe70200) 00010000:00010000:0.0:1788572284.115348:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.115351:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b832ed08 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd4734acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115356:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a973000/0xdb7edb52b832ed08 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd4734acd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115374:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1fa00/0xdb7edb52b832ed39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x809a3f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115380:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1fa00/0xdb7edb52b832ed39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x809a3f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115386:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1fa00/0xdb7edb52b832ed39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x809a3f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115392:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1fa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.115395:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1fa00/0xdb7edb52b832ed39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x809a3f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115400:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1fa00/0xdb7edb52b832ed39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x809a3f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115407:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x809a3f70 (ffff94e6416c0a00) 00010000:00010000:0.0:1788572284.115408:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.115412:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1fa00/0xdb7edb52b832ed39 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x809a3f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.115418:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1fa00/0xdb7edb52b832ed39 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x809a3f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117260:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780400/0xdb7edb52b832ed6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xefcce16f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117281:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780400/0xdb7edb52b832ed6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xefcce16f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117290:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780400/0xdb7edb52b832ed6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xefcce16f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117297:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.117302:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780400/0xdb7edb52b832ed6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xefcce16f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117312:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780400/0xdb7edb52b832ed6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xefcce16f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117332:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefcce16f (ffff94e607edd300) 00010000:00010000:0.0:1788572284.117335:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.117340:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780400/0xdb7edb52b832ed6a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xefcce16f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117346:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780400/0xdb7edb52b832ed6a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xefcce16f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117384:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b832ed9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72db692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117395:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b832ed9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72db692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117401:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b832ed9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72db692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117406:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61f14ba00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.117408:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b832ed9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72db692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117414:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b832ed9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72db692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117421:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72db692 (ffff94e633d91400) 00010000:00010000:0.0:1788572284.117424:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.117427:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b832ed9b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc72db692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117560:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61f14ba00/0xdb7edb52b832ed9b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc72db692 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117582:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780e00/0xdb7edb52b832edcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e6035bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117588:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780e00/0xdb7edb52b832edcc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e6035bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117593:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780e00/0xdb7edb52b832edcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e6035bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117599:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.117602:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780e00/0xdb7edb52b832edcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e6035bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117609:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780e00/0xdb7edb52b832edcc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6e6035bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117617:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6e6035bc (ffff94e607eddd00) 00010000:00010000:0.0:1788572284.117620:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.117623:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780e00/0xdb7edb52b832edcc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6e6035bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117628:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780e00/0xdb7edb52b832edcc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6e6035bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117642:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1f000/0xdb7edb52b832edfd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa0971a8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117648:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1f000/0xdb7edb52b832edfd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa0971a8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117653:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1f000/0xdb7edb52b832edfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa0971a8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117657:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1f000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.117660:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1f000/0xdb7edb52b832edfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa0971a8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117664:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1f000/0xdb7edb52b832edfd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa0971a8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117671:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa0971a8b (ffff94e633d91100) 00010000:00010000:0.0:1788572284.117673:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.117676:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1f000/0xdb7edb52b832edfd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa0971a8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117682:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633e1f000/0xdb7edb52b832edfd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa0971a8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117697:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7400/0xdb7edb52b832ee2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c3f46e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117703:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7400/0xdb7edb52b832ee2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c3f46e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117708:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7400/0xdb7edb52b832ee2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c3f46e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117712:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fcd7400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.117715:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7400/0xdb7edb52b832ee2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c3f46e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117720:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7400/0xdb7edb52b832ee2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c3f46e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117727:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c3f46e (ffff94e5042eae00) 00010000:00010000:0.0:1788572284.117729:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.117733:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7400/0xdb7edb52b832ee2e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4c3f46e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117738:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fcd7400/0xdb7edb52b832ee2e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4c3f46e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117754:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51e800/0xdb7edb52b832ee5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa414f8bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117764:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51e800/0xdb7edb52b832ee5f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa414f8bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117769:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51e800/0xdb7edb52b832ee5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa414f8bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117774:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e51e800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.117777:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51e800/0xdb7edb52b832ee5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa414f8bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117783:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51e800/0xdb7edb52b832ee5f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa414f8bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117790:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa414f8bd (ffff94e5042ea200) 00010000:00010000:0.0:1788572284.117792:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.117795:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51e800/0xdb7edb52b832ee5f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa414f8bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117801:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51e800/0xdb7edb52b832ee5f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa414f8bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117818:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588200/0xdb7edb52b832ee90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2019f7e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117824:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588200/0xdb7edb52b832ee90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2019f7e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117831:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588200/0xdb7edb52b832ee90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2019f7e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117836:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.117840:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588200/0xdb7edb52b832ee90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2019f7e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117845:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588200/0xdb7edb52b832ee90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2019f7e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117852:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2019f7e0 (ffff94e61e50c800) 00010000:00010000:0.0:1788572284.117855:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.117858:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588200/0xdb7edb52b832ee90 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2019f7e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117863:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588200/0xdb7edb52b832ee90 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2019f7e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117879:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8aa00/0xdb7edb52b832eec1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aa016f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117885:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8aa00/0xdb7edb52b832eec1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aa016f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117890:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8aa00/0xdb7edb52b832eec1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aa016f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117895:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa8aa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.117897:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8aa00/0xdb7edb52b832eec1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aa016f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117903:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8aa00/0xdb7edb52b832eec1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x14aa016f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117910:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aa016f (ffff94e61ebcdf00) 00010000:00010000:0.0:1788572284.117912:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.117916:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8aa00/0xdb7edb52b832eec1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x14aa016f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117922:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8aa00/0xdb7edb52b832eec1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x14aa016f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117939:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad52e00/0xdb7edb52b832eef2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x61a25612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117945:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad52e00/0xdb7edb52b832eef2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x61a25612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117950:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad52e00/0xdb7edb52b832eef2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x61a25612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117956:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad52e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.117958:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad52e00/0xdb7edb52b832eef2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x61a25612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117965:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad52e00/0xdb7edb52b832eef2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x61a25612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.117974:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x61a25612 (ffff94e5042eaf00) 00010000:00010000:0.0:1788572284.117976:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.117985:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad52e00/0xdb7edb52b832eef2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x61a25612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118002:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad52e00/0xdb7edb52b832eef2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x61a25612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118063:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a000/0xdb7edb52b832ef23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28d164e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118074:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a000/0xdb7edb52b832ef23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28d164e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118079:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a000/0xdb7edb52b832ef23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28d164e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118084:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634b1a000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.118087:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a000/0xdb7edb52b832ef23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28d164e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118092:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a000/0xdb7edb52b832ef23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28d164e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118099:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28d164e1 (ffff94e612b14b00) 00010000:00010000:0.0:1788572284.118102:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.118105:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a000/0xdb7edb52b832ef23 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28d164e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118110:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a000/0xdb7edb52b832ef23 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28d164e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118128:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8b800/0xdb7edb52b832ef54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5f646d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118133:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8b800/0xdb7edb52b832ef54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5f646d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118139:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8b800/0xdb7edb52b832ef54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5f646d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118143:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa8b800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.118146:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8b800/0xdb7edb52b832ef54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5f646d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118152:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8b800/0xdb7edb52b832ef54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5f646d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118159:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f646d34 (ffff94e60fa14d00) 00010000:00010000:0.0:1788572284.118161:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.118164:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8b800/0xdb7edb52b832ef54 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5f646d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118169:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8b800/0xdb7edb52b832ef54 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5f646d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118186:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a400/0xdb7edb52b832ef85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbf476c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118191:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a400/0xdb7edb52b832ef85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbf476c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118197:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a400/0xdb7edb52b832ef85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbf476c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118201:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634b1a400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.118203:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a400/0xdb7edb52b832ef85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbf476c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118209:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a400/0xdb7edb52b832ef85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbf476c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118216:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbf476c3 (ffff94e6158d6a00) 00010000:00010000:0.0:1788572284.118218:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.118221:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a400/0xdb7edb52b832ef85 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfbf476c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118227:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1a400/0xdb7edb52b832ef85 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfbf476c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118600:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b832efb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x69332252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118610:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b832efb6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x69332252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118616:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b832efb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x69332252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118621:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a9f9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.118624:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b832efb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x69332252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118630:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b832efb6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x69332252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118639:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x69332252 (ffff94e6415cd000) 00010000:00010000:0.0:1788572284.118642:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.118644:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b832efb6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x69332252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118651:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a9f9400/0xdb7edb52b832efb6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x69332252 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118672:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588a00/0xdb7edb52b832efe7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30623121 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118683:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588a00/0xdb7edb52b832efe7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30623121 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118689:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588a00/0xdb7edb52b832efe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30623121 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118695:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.118697:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588a00/0xdb7edb52b832efe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30623121 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118703:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588a00/0xdb7edb52b832efe7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30623121 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118711:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30623121 (ffff94e61e50c500) 00010000:00010000:0.0:1788572284.118714:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.118717:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588a00/0xdb7edb52b832efe7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x30623121 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118723:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588a00/0xdb7edb52b832efe7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x30623121 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118739:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1b200/0xdb7edb52b832f018 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x72925c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118746:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1b200/0xdb7edb52b832f018 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x72925c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118752:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1b200/0xdb7edb52b832f018 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x72925c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118757:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634b1b200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.118761:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1b200/0xdb7edb52b832f018 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x72925c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118767:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1b200/0xdb7edb52b832f018 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x72925c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118774:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x72925c4 (ffff94e6415cd300) 00010000:00010000:0.0:1788572284.118776:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.118779:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1b200/0xdb7edb52b832f018 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x72925c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118785:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1b200/0xdb7edb52b832f018 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x72925c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118802:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbc00/0xdb7edb52b832f049 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x29968f53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118808:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbc00/0xdb7edb52b832f049 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x29968f53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118814:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbc00/0xdb7edb52b832f049 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x29968f53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118819:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63abbbc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.118822:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbc00/0xdb7edb52b832f049 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x29968f53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118828:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbc00/0xdb7edb52b832f049 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x29968f53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118836:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x29968f53 (ffff94e6415cd400) 00010000:00010000:0.0:1788572284.118839:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.118843:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbc00/0xdb7edb52b832f049 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x29968f53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118849:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abbbc00/0xdb7edb52b832f049 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x29968f53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118867:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0fe00/0xdb7edb52b832f07a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xedef8e76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118873:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0fe00/0xdb7edb52b832f07a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xedef8e76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118878:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0fe00/0xdb7edb52b832f07a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xedef8e76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118883:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633d0fe00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.118886:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0fe00/0xdb7edb52b832f07a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xedef8e76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118893:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0fe00/0xdb7edb52b832f07a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xedef8e76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118901:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xedef8e76 (ffff94e612b14900) 00010000:00010000:0.0:1788572284.118904:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.118907:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0fe00/0xdb7edb52b832f07a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xedef8e76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118913:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0fe00/0xdb7edb52b832f07a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xedef8e76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118934:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e200/0xdb7edb52b832f0ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe27f9805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.118944:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e200/0xdb7edb52b832f0ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe27f9805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.121798:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e200/0xdb7edb52b832f0ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe27f9805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.121817:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633d0e200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.121823:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e200/0xdb7edb52b832f0ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe27f9805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.121834:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e200/0xdb7edb52b832f0ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe27f9805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.121857:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe27f9805 (ffff94e604ddb300) 00010000:00010000:0.0:1788572284.121860:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.121866:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e200/0xdb7edb52b832f0ab lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe27f9805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.121874:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e200/0xdb7edb52b832f0ab lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe27f9805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.121936:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b832f0dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8ea68ca8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122207:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b832f0dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8ea68ca8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122214:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b832f0dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8ea68ca8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122219:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.122223:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b832f0dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8ea68ca8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122229:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b832f0dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8ea68ca8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122250:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8ea68ca8 (ffff94e61e50c600) 00010000:00010000:0.0:1788572284.122253:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.122257:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b832f0dc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8ea68ca8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122263:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b832f0dc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8ea68ca8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122287:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1ba00/0xdb7edb52b832f10d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0dd7177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122293:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1ba00/0xdb7edb52b832f10d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0dd7177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122299:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1ba00/0xdb7edb52b832f10d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0dd7177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122305:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e634b1ba00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.122308:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1ba00/0xdb7edb52b832f10d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0dd7177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122314:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1ba00/0xdb7edb52b832f10d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc0dd7177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122322:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc0dd7177 (ffff94e613194b00) 00010000:00010000:0.0:1788572284.122324:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.122327:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1ba00/0xdb7edb52b832f10d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc0dd7177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122333:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e634b1ba00/0xdb7edb52b832f10d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc0dd7177 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122351:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f800/0xdb7edb52b832f13e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x592503ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122357:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f800/0xdb7edb52b832f13e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x592503ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122362:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f800/0xdb7edb52b832f13e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x592503ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122367:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633d0f800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.122369:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f800/0xdb7edb52b832f13e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x592503ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122375:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f800/0xdb7edb52b832f13e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x592503ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122381:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x592503ca (ffff94e6415cd500) 00010000:00010000:0.0:1788572284.122382:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.122384:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f800/0xdb7edb52b832f13e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x592503ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122389:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f800/0xdb7edb52b832f13e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x592503ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122407:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef200/0xdb7edb52b832f16f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7b160819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122416:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef200/0xdb7edb52b832f16f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7b160819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122421:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef200/0xdb7edb52b832f16f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7b160819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.122425:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633eef200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.122427:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef200/0xdb7edb52b832f16f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7b160819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123706:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef200/0xdb7edb52b832f16f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7b160819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123728:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7b160819 (ffff94e613194c00) 00010000:00010000:0.0:1788572284.123731:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.123736:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef200/0xdb7edb52b832f16f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7b160819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123743:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef200/0xdb7edb52b832f16f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7b160819 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123786:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b832f1a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f9fa94b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123794:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b832f1a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f9fa94b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123801:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b832f1a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f9fa94b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123808:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637675600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.123813:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b832f1a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f9fa94b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123818:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b832f1a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1f9fa94b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123826:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1f9fa94b (ffff94e61e50c300) 00010000:00010000:0.0:1788572284.123828:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.123831:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b832f1a0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1f9fa94b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123836:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637675600/0xdb7edb52b832f1a0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1f9fa94b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123854:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee400/0xdb7edb52b832f1d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x142fb2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123861:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee400/0xdb7edb52b832f1d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x142fb2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123867:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee400/0xdb7edb52b832f1d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x142fb2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123872:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633eee400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.123874:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee400/0xdb7edb52b832f1d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x142fb2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123881:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee400/0xdb7edb52b832f1d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x142fb2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123890:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x142fb2da (ffff94e61e50cf00) 00010000:00010000:0.0:1788572284.123892:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.123896:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee400/0xdb7edb52b832f1d1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x142fb2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123902:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee400/0xdb7edb52b832f1d1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x142fb2da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123921:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51f000/0xdb7edb52b832f202 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x533c87fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123928:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51f000/0xdb7edb52b832f202 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x533c87fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123934:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51f000/0xdb7edb52b832f202 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x533c87fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123939:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e51f000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.123941:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51f000/0xdb7edb52b832f202 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x533c87fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123947:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51f000/0xdb7edb52b832f202 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x533c87fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123954:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x533c87fd (ffff94e63c570b00) 00010000:00010000:0.0:1788572284.123957:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.123960:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51f000/0xdb7edb52b832f202 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x533c87fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123966:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e51f000/0xdb7edb52b832f202 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x533c87fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.123987:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b832f233 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b0aec4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124385:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b832f233 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b0aec4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124391:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b832f233 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b0aec4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124395:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.124398:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b832f233 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b0aec4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124404:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b832f233 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4b0aec4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124412:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4b0aec4c (ffff94e61e50c200) 00010000:00010000:0.0:1788572284.124414:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.124418:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b832f233 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4b0aec4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124423:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b832f233 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4b0aec4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124454:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e000/0xdb7edb52b832f264 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc4e62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124459:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e000/0xdb7edb52b832f264 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc4e62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124464:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e000/0xdb7edb52b832f264 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc4e62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124469:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633d0e000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.124472:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e000/0xdb7edb52b832f264 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc4e62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124477:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e000/0xdb7edb52b832f264 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc4e62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124483:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3cc4e62f (ffff94e63c570c00) 00010000:00010000:0.0:1788572284.124485:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.124487:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e000/0xdb7edb52b832f264 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3cc4e62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124492:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0e000/0xdb7edb52b832f264 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3cc4e62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124510:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee200/0xdb7edb52b832f295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3f3f4fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124515:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee200/0xdb7edb52b832f295 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3f3f4fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124521:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee200/0xdb7edb52b832f295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3f3f4fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124525:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633eee200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.124528:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee200/0xdb7edb52b832f295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3f3f4fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124534:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee200/0xdb7edb52b832f295 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3f3f4fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124917:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f3f4fe (ffff94e640e55000) 00010000:00010000:0.0:1788572284.124920:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.124924:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee200/0xdb7edb52b832f295 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3f3f4fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124930:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eee200/0xdb7edb52b832f295 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3f3f4fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124966:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6136ac200/0xdb7edb52b832f2c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb01ae9a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124973:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6136ac200/0xdb7edb52b832f2c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb01ae9a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124979:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6136ac200/0xdb7edb52b832f2c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb01ae9a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.124983:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6136ac200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.124986:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6136ac200/0xdb7edb52b832f2c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb01ae9a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125001:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6136ac200/0xdb7edb52b832f2c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb01ae9a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125030:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb01ae9a1 (ffff94e63c570600) 00010000:00010000:0.0:1788572284.125032:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125035:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6136ac200/0xdb7edb52b832f2c6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb01ae9a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125041:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6136ac200/0xdb7edb52b832f2c6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb01ae9a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125061:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b832f2f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x171dd330 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125071:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b832f2f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x171dd330 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125077:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b832f2f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x171dd330 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125082:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aca5000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125085:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b832f2f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x171dd330 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125090:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b832f2f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x171dd330 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125098:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x171dd330 (ffff94e6415cd600) 00010000:00010000:0.0:1788572284.125100:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125103:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b832f2f7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x171dd330 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125108:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aca5000/0xdb7edb52b832f2f7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x171dd330 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125127:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eeea00/0xdb7edb52b832f328 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8a3e0c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125134:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eeea00/0xdb7edb52b832f328 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8a3e0c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125140:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eeea00/0xdb7edb52b832f328 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8a3e0c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125146:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633eeea00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125150:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eeea00/0xdb7edb52b832f328 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8a3e0c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125156:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eeea00/0xdb7edb52b832f328 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8a3e0c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125163:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8a3e0c3 (ffff94e502297600) 00010000:00010000:0.0:1788572284.125165:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125168:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eeea00/0xdb7edb52b832f328 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8a3e0c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125172:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eeea00/0xdb7edb52b832f328 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8a3e0c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125188:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5600/0xdb7edb52b832f359 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xad33ea52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125193:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5600/0xdb7edb52b832f359 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xad33ea52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125199:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5600/0xdb7edb52b832f359 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xad33ea52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125204:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f5600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125207:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5600/0xdb7edb52b832f359 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xad33ea52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125213:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5600/0xdb7edb52b832f359 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xad33ea52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125220:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xad33ea52 (ffff94e63c570800) 00010000:00010000:0.0:1788572284.125222:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125226:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5600/0xdb7edb52b832f359 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xad33ea52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125232:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5600/0xdb7edb52b832f359 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xad33ea52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125259:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f000/0xdb7edb52b832f38a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x747e3110 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125266:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f000/0xdb7edb52b832f38a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x747e3110 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125272:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f000/0xdb7edb52b832f38a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x747e3110 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125277:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633d0f000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125280:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f000/0xdb7edb52b832f38a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x747e3110 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125285:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f000/0xdb7edb52b832f38a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x747e3110 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125291:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x747e3110 (ffff94e63c570500) 00010000:00010000:0.0:1788572284.125294:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125296:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f000/0xdb7edb52b832f38a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x747e3110 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125302:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0f000/0xdb7edb52b832f38a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x747e3110 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125318:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588e00/0xdb7edb52b832f3bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3d69fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125329:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588e00/0xdb7edb52b832f3bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3d69fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125335:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588e00/0xdb7edb52b832f3bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3d69fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125340:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125342:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588e00/0xdb7edb52b832f3bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3d69fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125347:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588e00/0xdb7edb52b832f3bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa3d69fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125355:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa3d69fdf (ffff94e602c23200) 00010000:00010000:0.0:1788572284.125357:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125360:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588e00/0xdb7edb52b832f3bb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa3d69fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125365:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588e00/0xdb7edb52b832f3bb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa3d69fdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125381:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957200/0xdb7edb52b832f3ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x959099c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125387:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957200/0xdb7edb52b832f3ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x959099c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125393:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957200/0xdb7edb52b832f3ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x959099c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125398:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a957200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125401:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957200/0xdb7edb52b832f3ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x959099c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125407:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957200/0xdb7edb52b832f3ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x959099c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125414:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x959099c2 (ffff94e633ec9600) 00010000:00010000:0.0:1788572284.125417:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125419:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957200/0xdb7edb52b832f3ec lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x959099c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125425:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957200/0xdb7edb52b832f3ec lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x959099c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125538:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b832f41d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e19e11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125546:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b832f41d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e19e11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125561:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b832f41d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e19e11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125566:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6416b3000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125568:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b832f41d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e19e11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125574:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b832f41d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e19e11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125583:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e19e11 (ffff94e640e55600) 00010000:00010000:0.0:1788572284.125585:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125588:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b832f41d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e19e11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125594:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6416b3000/0xdb7edb52b832f41d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e19e11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125609:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba200/0xdb7edb52b832f44e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93a9d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125615:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba200/0xdb7edb52b832f44e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93a9d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125620:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba200/0xdb7edb52b832f44e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93a9d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125623:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63abba200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125625:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba200/0xdb7edb52b832f44e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93a9d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125631:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba200/0xdb7edb52b832f44e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93a9d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125637:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf93a9d34 (ffff94e633ec9000) 00010000:00010000:0.0:1788572284.125639:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125642:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba200/0xdb7edb52b832f44e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf93a9d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125647:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63abba200/0xdb7edb52b832f44e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf93a9d34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125661:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b832f47f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebfe86c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125672:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b832f47f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebfe86c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125678:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b832f47f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebfe86c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125682:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125684:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b832f47f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebfe86c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125689:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b832f47f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebfe86c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125694:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebfe86c3 (ffff94e61e574000) 00010000:00010000:0.0:1788572284.125695:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125698:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b832f47f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xebfe86c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125703:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12e00/0xdb7edb52b832f47f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xebfe86c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125723:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094a00/0xdb7edb52b832f4b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30797b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125729:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094a00/0xdb7edb52b832f4b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30797b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125734:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094a00/0xdb7edb52b832f4b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30797b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125737:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125740:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094a00/0xdb7edb52b832f4b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30797b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125745:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094a00/0xdb7edb52b832f4b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x30797b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125751:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30797b66 (ffff94e6118eb500) 00010000:00010000:0.0:1788572284.125752:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125755:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094a00/0xdb7edb52b832f4b0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x30797b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125759:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094a00/0xdb7edb52b832f4b0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x30797b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125773:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5a00/0xdb7edb52b832f4e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x62b06035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125778:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5a00/0xdb7edb52b832f4e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x62b06035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125783:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5a00/0xdb7edb52b832f4e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x62b06035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125787:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e6f5a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125789:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5a00/0xdb7edb52b832f4e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x62b06035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125793:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5a00/0xdb7edb52b832f4e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x62b06035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125799:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x62b06035 (ffff94e61e574d00) 00010000:00010000:0.0:1788572284.125801:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125804:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5a00/0xdb7edb52b832f4e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x62b06035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125809:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e6f5a00/0xdb7edb52b832f4e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x62b06035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125822:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ae00/0xdb7edb52b832f512 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x52f7f288 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125827:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ae00/0xdb7edb52b832f512 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x52f7f288 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125833:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ae00/0xdb7edb52b832f512 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x52f7f288 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125838:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa8ae00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125841:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ae00/0xdb7edb52b832f512 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x52f7f288 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125847:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ae00/0xdb7edb52b832f512 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x52f7f288 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125855:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x52f7f288 (ffff94e60fa14300) 00010000:00010000:0.0:1788572284.125857:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125860:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ae00/0xdb7edb52b832f512 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x52f7f288 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125866:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ae00/0xdb7edb52b832f512 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x52f7f288 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125884:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b832f543 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5733fc17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125896:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b832f543 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5733fc17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125901:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b832f543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5733fc17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125906:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125909:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b832f543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5733fc17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125915:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b832f543 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5733fc17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125923:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5733fc17 (ffff94e633ec9100) 00010000:00010000:0.0:1788572284.125925:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.125928:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b832f543 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5733fc17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125933:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e612b12a00/0xdb7edb52b832f543 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5733fc17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125948:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b832f574 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64b767fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125955:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b832f574 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64b767fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125962:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b832f574 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64b767fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125967:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.125971:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b832f574 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64b767fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125977:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b832f574 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64b767fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.125985:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64b767fe (ffff94e619d6f000) 00010000:00010000:0.0:1788572284.125998:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.126002:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b832f574 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x64b767fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126043:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b832f574 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x64b767fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126063:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e609744e00/0xdb7edb52b832f5a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68f3718d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126069:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e609744e00/0xdb7edb52b832f5a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68f3718d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126075:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e609744e00/0xdb7edb52b832f5a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68f3718d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126080:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.126083:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e609744e00/0xdb7edb52b832f5a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68f3718d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126089:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e609744e00/0xdb7edb52b832f5a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68f3718d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126097:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x68f3718d (ffff94e642150c00) 00010000:00010000:0.0:1788572284.126100:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.126103:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e609744e00/0xdb7edb52b832f5a5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68f3718d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126109:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e609744e00/0xdb7edb52b832f5a5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68f3718d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126127:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140e400/0xdb7edb52b832f5d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x405446b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126132:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140e400/0xdb7edb52b832f5d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x405446b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126138:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140e400/0xdb7edb52b832f5d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x405446b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126142:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64140e400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.126145:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140e400/0xdb7edb52b832f5d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x405446b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126150:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140e400/0xdb7edb52b832f5d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x405446b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126157:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x405446b0 (ffff94e61e574300) 00010000:00010000:0.0:1788572284.126159:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.126162:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140e400/0xdb7edb52b832f5d6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x405446b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126168:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140e400/0xdb7edb52b832f5d6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x405446b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126183:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140f600/0xdb7edb52b832f607 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa54aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126192:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140f600/0xdb7edb52b832f607 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa54aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126197:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140f600/0xdb7edb52b832f607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa54aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126201:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64140f600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.126204:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140f600/0xdb7edb52b832f607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa54aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126210:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140f600/0xdb7edb52b832f607 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa54aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126217:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa54aff (ffff94e63acf3a00) 00010000:00010000:0.0:1788572284.126219:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.126222:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140f600/0xdb7edb52b832f607 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdfa54aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126227:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140f600/0xdb7edb52b832f607 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdfa54aff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126505:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0d600/0xdb7edb52b832f638 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd15f44e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126513:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0d600/0xdb7edb52b832f638 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd15f44e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126519:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0d600/0xdb7edb52b832f638 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd15f44e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126524:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633d0d600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.126528:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0d600/0xdb7edb52b832f638 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd15f44e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126534:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0d600/0xdb7edb52b832f638 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd15f44e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126543:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd15f44e2 (ffff94e60fa14c00) 00010000:00010000:0.0:1788572284.126862:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.126867:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0d600/0xdb7edb52b832f638 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd15f44e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126873:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0d600/0xdb7edb52b832f638 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd15f44e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126898:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61870f200/0xdb7edb52b832f669 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x58b7b3b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126905:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61870f200/0xdb7edb52b832f669 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x58b7b3b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126911:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61870f200/0xdb7edb52b832f669 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x58b7b3b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126916:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61870f200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.126919:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61870f200/0xdb7edb52b832f669 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x58b7b3b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126925:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61870f200/0xdb7edb52b832f669 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x58b7b3b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.126934:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x58b7b3b1 (ffff94e633ea4500) 00010000:00010000:0.0:1788572284.126936:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.126939:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61870f200/0xdb7edb52b832f669 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x58b7b3b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127043:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61870f200/0xdb7edb52b832f669 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x58b7b3b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127064:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef000/0xdb7edb52b832f69a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf532a854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127071:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef000/0xdb7edb52b832f69a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf532a854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127076:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef000/0xdb7edb52b832f69a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf532a854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127081:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633eef000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.127084:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef000/0xdb7edb52b832f69a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf532a854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127089:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef000/0xdb7edb52b832f69a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf532a854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127098:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf532a854 (ffff94e633ea4c00) 00010000:00010000:0.0:1788572284.127101:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.127104:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef000/0xdb7edb52b832f69a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf532a854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127110:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633eef000/0xdb7edb52b832f69a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf532a854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127128:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b832f6cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x11c2b1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127137:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b832f6cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x11c2b1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127143:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b832f6cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x11c2b1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127147:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.127150:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b832f6cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x11c2b1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127156:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b832f6cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x11c2b1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127164:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11c2b1e3 (ffff94e642150300) 00010000:00010000:0.0:1788572284.127166:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.127169:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b832f6cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x11c2b1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127175:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ade9400/0xdb7edb52b832f6cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x11c2b1e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127195:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567000/0xdb7edb52b832f6fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed121a36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127201:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567000/0xdb7edb52b832f6fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed121a36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127208:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567000/0xdb7edb52b832f6fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed121a36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127214:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637567000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.127218:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567000/0xdb7edb52b832f6fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed121a36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127224:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567000/0xdb7edb52b832f6fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed121a36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127231:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed121a36 (ffff94e618403600) 00010000:00010000:0.0:1788572284.127234:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.127309:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567000/0xdb7edb52b832f6fc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed121a36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127316:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567000/0xdb7edb52b832f6fc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed121a36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127334:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567400/0xdb7edb52b832f72d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc3ed2905 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127340:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567400/0xdb7edb52b832f72d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc3ed2905 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127346:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567400/0xdb7edb52b832f72d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc3ed2905 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127351:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637567400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.127354:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567400/0xdb7edb52b832f72d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc3ed2905 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127360:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567400/0xdb7edb52b832f72d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc3ed2905 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127368:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3ed2905 (ffff94e618403d00) 00010000:00010000:0.0:1788572284.127371:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.127375:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567400/0xdb7edb52b832f72d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc3ed2905 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127380:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637567400/0xdb7edb52b832f72d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc3ed2905 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127399:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637566400/0xdb7edb52b832f75e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd1148ec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.127406:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637566400/0xdb7edb52b832f75e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd1148ec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.129794:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637566400/0xdb7edb52b832f75e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd1148ec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.129819:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637566400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.129825:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637566400/0xdb7edb52b832f75e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd1148ec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.129838:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637566400/0xdb7edb52b832f75e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd1148ec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.129861:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd1148ec9 (ffff94e618403300) 00010000:00010000:0.0:1788572284.129865:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.129871:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637566400/0xdb7edb52b832f75e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd1148ec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.129880:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637566400/0xdb7edb52b832f75e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd1148ec9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.129940:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d600/0xdb7edb52b832f78f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5a49858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130277:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d600/0xdb7edb52b832f78f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5a49858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130285:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d600/0xdb7edb52b832f78f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5a49858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130290:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9d600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.130293:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d600/0xdb7edb52b832f78f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5a49858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130299:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d600/0xdb7edb52b832f78f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc5a49858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130309:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc5a49858 (ffff94e633ea4800) 00010000:00010000:0.0:1788572284.130312:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.130315:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d600/0xdb7edb52b832f78f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc5a49858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130321:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d600/0xdb7edb52b832f78f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc5a49858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130343:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b400/0xdb7edb52b832f7c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130349:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b400/0xdb7edb52b832f7c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130354:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b400/0xdb7edb52b832f7c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130359:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64173b400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.130362:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b400/0xdb7edb52b832f7c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130369:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b400/0xdb7edb52b832f7c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130377:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a7af77b (ffff94e6412dc600) 00010000:00010000:0.0:1788572284.130379:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.130382:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b400/0xdb7edb52b832f7c0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130388:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b400/0xdb7edb52b832f7c0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130406:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a400/0xdb7edb52b832f7f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130412:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a400/0xdb7edb52b832f7f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130418:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a400/0xdb7edb52b832f7f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130423:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64173a400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.130426:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a400/0xdb7edb52b832f7f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130448:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a400/0xdb7edb52b832f7f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130455:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd9cbfbca (ffff94e618403e00) 00010000:00010000:0.0:1788572284.130457:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.130460:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a400/0xdb7edb52b832f7f1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130465:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a400/0xdb7edb52b832f7f1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130483:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140fa00/0xdb7edb52b832f822 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130489:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140fa00/0xdb7edb52b832f822 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130495:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140fa00/0xdb7edb52b832f822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130500:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64140fa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.130503:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140fa00/0xdb7edb52b832f822 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130508:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140fa00/0xdb7edb52b832f822 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130516:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb31f5ad (ffff94e63acf3000) 00010000:00010000:0.0:1788572284.130519:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.130522:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140fa00/0xdb7edb52b832f822 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.130528:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64140fa00/0xdb7edb52b832f822 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131152:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173aa00/0xdb7edb52b832f853 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131168:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173aa00/0xdb7edb52b832f853 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131174:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173aa00/0xdb7edb52b832f853 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131179:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64173aa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.131183:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173aa00/0xdb7edb52b832f853 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131190:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173aa00/0xdb7edb52b832f853 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131202:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4a61047c (ffff94e6184b3600) 00010000:00010000:0.0:1788572284.131205:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.131209:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173aa00/0xdb7edb52b832f853 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131216:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173aa00/0xdb7edb52b832f853 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131294:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637781000/0xdb7edb52b832f884 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131301:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637781000/0xdb7edb52b832f884 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131308:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637781000/0xdb7edb52b832f884 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131313:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.131316:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637781000/0xdb7edb52b832f884 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131322:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637781000/0xdb7edb52b832f884 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131332:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9759591f (ffff94e607eddb00) 00010000:00010000:0.0:1788572284.131334:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.131338:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637781000/0xdb7edb52b832f884 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131344:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637781000/0xdb7edb52b832f884 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131366:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a600/0xdb7edb52b832f8b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131374:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a600/0xdb7edb52b832f8b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131380:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a600/0xdb7edb52b832f8b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131386:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64173a600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.131388:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a600/0xdb7edb52b832f8b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131394:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a600/0xdb7edb52b832f8b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131402:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8be962ae (ffff94e6184b3f00) 00010000:00010000:0.0:1788572284.131404:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.131407:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a600/0xdb7edb52b832f8b5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131412:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173a600/0xdb7edb52b832f8b5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131428:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b832f8e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131434:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b832f8e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131440:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b832f8e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131445:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.131448:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b832f8e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131454:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b832f8e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131461:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc27c6b01 (ffff94e61e624c00) 00010000:00010000:0.0:1788572284.131463:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.131467:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b832f8e6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131472:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac81400/0xdb7edb52b832f8e6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131492:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b832f917 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131503:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b832f917 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131509:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b832f917 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131514:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.131517:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b832f917 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131523:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b832f917 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131530:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x89ab79d0 (ffff94e61e624000) 00010000:00010000:0.0:1788572284.131532:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.131535:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b832f917 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.131541:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52e00/0xdb7edb52b832f917 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132170:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637701200/0xdb7edb52b832f948 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132180:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637701200/0xdb7edb52b832f948 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132185:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637701200/0xdb7edb52b832f948 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132188:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.132192:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637701200/0xdb7edb52b832f948 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132198:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637701200/0xdb7edb52b832f948 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132208:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xda201b01 (ffff94e63acf3400) 00010000:00010000:0.0:1788572284.132211:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.132214:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637701200/0xdb7edb52b832f948 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132219:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637701200/0xdb7edb52b832f948 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132251:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557e00/0xdb7edb52b832f979 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132258:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557e00/0xdb7edb52b832f979 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132263:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557e00/0xdb7edb52b832f979 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132268:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641557e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.132270:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557e00/0xdb7edb52b832f979 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132275:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557e00/0xdb7edb52b832f979 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132282:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf93b0fa4 (ffff94e620235e00) 00010000:00010000:0.0:1788572284.132284:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.132288:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557e00/0xdb7edb52b832f979 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132293:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557e00/0xdb7edb52b832f979 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132310:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556c00/0xdb7edb52b832f9aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132316:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556c00/0xdb7edb52b832f9aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132321:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556c00/0xdb7edb52b832f9aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132325:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641556c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.132327:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556c00/0xdb7edb52b832f9aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132332:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556c00/0xdb7edb52b832f9aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132338:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9759d473 (ffff94e62d826200) 00010000:00010000:0.0:1788572284.132340:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.132343:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556c00/0xdb7edb52b832f9aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132349:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556c00/0xdb7edb52b832f9aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132363:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556400/0xdb7edb52b832f9db lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132373:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556400/0xdb7edb52b832f9db lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132378:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556400/0xdb7edb52b832f9db lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132382:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641556400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.132385:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556400/0xdb7edb52b832f9db lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132391:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556400/0xdb7edb52b832f9db lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132397:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8913ce56 (ffff94e63acf3d00) 00010000:00010000:0.0:1788572284.132399:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.132402:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556400/0xdb7edb52b832f9db lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132407:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556400/0xdb7edb52b832f9db lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132420:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557400/0xdb7edb52b832fa0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132426:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557400/0xdb7edb52b832fa0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132442:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557400/0xdb7edb52b832fa0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132447:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641557400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.132451:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557400/0xdb7edb52b832fa0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132457:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557400/0xdb7edb52b832fa0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132463:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbab0d2a5 (ffff94e62d826b00) 00010000:00010000:0.0:1788572284.132465:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.132468:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557400/0xdb7edb52b832fa0c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132473:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557400/0xdb7edb52b832fa0c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132487:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557200/0xdb7edb52b832fa3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132492:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557200/0xdb7edb52b832fa3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132498:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557200/0xdb7edb52b832fa3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132503:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641557200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.132505:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557200/0xdb7edb52b832fa3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132510:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557200/0xdb7edb52b832fa3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132515:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc69d1c8 (ffff94e641725400) 00010000:00010000:0.0:1788572284.132517:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.132521:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557200/0xdb7edb52b832fa3d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132527:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557200/0xdb7edb52b832fa3d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132539:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fbe00/0xdb7edb52b832fa6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132545:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fbe00/0xdb7edb52b832fa6e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132740:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fbe00/0xdb7edb52b832fa6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132746:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6349fbe00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.132749:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fbe00/0xdb7edb52b832fa6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132755:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fbe00/0xdb7edb52b832fa6e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132765:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49773b57 (ffff94e61e624300) 00010000:00010000:0.0:1788572284.132767:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.132770:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fbe00/0xdb7edb52b832fa6e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132775:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6349fbe00/0xdb7edb52b832fa6e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132794:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557000/0xdb7edb52b832fa9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132805:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557000/0xdb7edb52b832fa9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132810:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557000/0xdb7edb52b832fa9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132814:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641557000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.132817:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557000/0xdb7edb52b832fa9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132823:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557000/0xdb7edb52b832fa9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132830:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x68922ffa (ffff94e6053c7000) 00010000:00010000:0.0:1788572284.132833:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.132835:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557000/0xdb7edb52b832fa9f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132841:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641557000/0xdb7edb52b832fa9f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132857:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117200/0xdb7edb52b832fad0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132863:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117200/0xdb7edb52b832fad0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132868:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117200/0xdb7edb52b832fad0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132873:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641117200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.132876:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117200/0xdb7edb52b832fad0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132881:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117200/0xdb7edb52b832fad0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132888:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25e647f9 (ffff94e61e624f00) 00010000:00010000:0.0:1788572284.132890:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.132893:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117200/0xdb7edb52b832fad0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132899:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117200/0xdb7edb52b832fad0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132916:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b832fb01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132922:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b832fb01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132928:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b832fb01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132933:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641556000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.132936:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b832fb01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132952:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b832fb01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132960:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xea3f471c (ffff94e61849d300) 00010000:00010000:0.0:1788572284.132963:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.132967:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b832fb01 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132972:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b832fb01 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.132997:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649200/0xdb7edb52b832fb32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133135:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649200/0xdb7edb52b832fb32 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133142:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649200/0xdb7edb52b832fb32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133147:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637649200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.133150:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649200/0xdb7edb52b832fb32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133157:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649200/0xdb7edb52b832fb32 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133165:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd4f30798 (ffff94e61e624500) 00010000:00010000:0.0:1788572284.133168:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.133170:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649200/0xdb7edb52b832fb32 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133177:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649200/0xdb7edb52b832fb32 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133196:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648400/0xdb7edb52b832fb63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133207:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648400/0xdb7edb52b832fb63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133214:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648400/0xdb7edb52b832fb63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133218:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637648400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.133222:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648400/0xdb7edb52b832fb63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133230:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648400/0xdb7edb52b832fb63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133298:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf6e40be7 (ffff94e61e624a00) 00010000:00010000:0.0:1788572284.133301:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.133304:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648400/0xdb7edb52b832fb63 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133309:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648400/0xdb7edb52b832fb63 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133326:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648600/0xdb7edb52b832fb94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133332:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648600/0xdb7edb52b832fb94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133338:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648600/0xdb7edb52b832fb94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133343:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637648600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.133346:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648600/0xdb7edb52b832fb94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133353:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648600/0xdb7edb52b832fb94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133359:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x389d0b0a (ffff94e61e624600) 00010000:00010000:0.0:1788572284.133361:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.133363:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648600/0xdb7edb52b832fb94 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133369:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648600/0xdb7edb52b832fb94 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133382:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649000/0xdb7edb52b832fbc5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133389:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649000/0xdb7edb52b832fbc5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133395:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649000/0xdb7edb52b832fbc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133399:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637649000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.133402:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649000/0xdb7edb52b832fbc5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133406:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649000/0xdb7edb52b832fbc5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133411:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed567499 (ffff94e61e624400) 00010000:00010000:0.0:1788572284.133413:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.133416:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649000/0xdb7edb52b832fbc5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133421:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649000/0xdb7edb52b832fbc5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133498:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116c00/0xdb7edb52b832fbf6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133505:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116c00/0xdb7edb52b832fbf6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133509:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116c00/0xdb7edb52b832fbf6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133513:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641116c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.133516:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116c00/0xdb7edb52b832fbf6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133522:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116c00/0xdb7edb52b832fbf6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133530:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb471693c (ffff94e641725e00) 00010000:00010000:0.0:1788572284.133532:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.133535:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116c00/0xdb7edb52b832fbf6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133540:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641116c00/0xdb7edb52b832fbf6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133627:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648000/0xdb7edb52b832fc27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133637:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648000/0xdb7edb52b832fc27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133641:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648000/0xdb7edb52b832fc27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133646:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637648000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.133649:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648000/0xdb7edb52b832fc27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133655:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648000/0xdb7edb52b832fc27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133663:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf900780b (ffff94e61e624d00) 00010000:00010000:0.0:1788572284.133665:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.133668:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648000/0xdb7edb52b832fc27 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133674:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648000/0xdb7edb52b832fc27 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133689:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780a00/0xdb7edb52b832fc58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133695:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780a00/0xdb7edb52b832fc58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133700:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780a00/0xdb7edb52b832fc58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133704:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.133708:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780a00/0xdb7edb52b832fc58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133713:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780a00/0xdb7edb52b832fc58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133719:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeaba71ee (ffff94e60fa8c700) 00010000:00010000:0.0:1788572284.133722:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.133724:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780a00/0xdb7edb52b832fc58 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133729:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637780a00/0xdb7edb52b832fc58 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133746:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8be00/0xdb7edb52b832fc89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133752:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8be00/0xdb7edb52b832fc89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133757:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8be00/0xdb7edb52b832fc89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133761:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa8be00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.133764:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8be00/0xdb7edb52b832fc89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133770:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8be00/0xdb7edb52b832fc89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133778:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xccd4d63d (ffff94e60fa8c500) 00010000:00010000:0.0:1788572284.133780:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.133783:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8be00/0xdb7edb52b832fc89 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133790:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8be00/0xdb7edb52b832fc89 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133806:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648200/0xdb7edb52b832fcba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133812:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648200/0xdb7edb52b832fcba lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133818:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648200/0xdb7edb52b832fcba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133822:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637648200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.133825:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648200/0xdb7edb52b832fcba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133830:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648200/0xdb7edb52b832fcba lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133837:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1bbbde90 (ffff94e60fef1700) 00010000:00010000:0.0:1788572284.133839:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.133842:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648200/0xdb7edb52b832fcba lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133848:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637648200/0xdb7edb52b832fcba lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133863:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ac00/0xdb7edb52b832fceb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133872:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ac00/0xdb7edb52b832fceb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133877:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ac00/0xdb7edb52b832fceb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133881:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa8ac00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.133884:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ac00/0xdb7edb52b832fceb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133889:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ac00/0xdb7edb52b832fceb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133896:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe2eaed5f (ffff94e60fa8c600) 00010000:00010000:0.0:1788572284.133898:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.133900:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ac00/0xdb7edb52b832fceb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133906:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e60fa8ac00/0xdb7edb52b832fceb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133928:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b800/0xdb7edb52b832fd1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133933:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b800/0xdb7edb52b832fd1c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.133938:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b800/0xdb7edb52b832fd1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134195:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64173b800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.134199:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b800/0xdb7edb52b832fd1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134206:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b800/0xdb7edb52b832fd1c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134215:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf653aaf (ffff94e61e6ef500) 00010000:00010000:0.0:1788572284.134218:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.134221:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b800/0xdb7edb52b832fd1c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134227:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64173b800/0xdb7edb52b832fd1c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134323:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832fd4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134331:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832fd4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134336:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832fd4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134342:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e605d0da00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.134345:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832fd4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134351:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832fd4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134361:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xde802f52 (ffff94e641724700) 00010000:00010000:0.0:1788572284.134363:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.134367:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832fd4d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134373:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e605d0da00/0xdb7edb52b832fd4d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134389:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b832fd7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134396:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b832fd7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134402:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b832fd7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134407:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e68f400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.134410:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b832fd7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134415:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b832fd7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134422:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x507038e1 (ffff94e61e6eff00) 00010000:00010000:0.0:1788572284.134425:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.134428:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b832fd7e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134440:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b832fd7e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134458:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b832fdaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134468:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b832fdaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134475:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b832fdaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134479:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e68e600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.134482:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b832fdaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134487:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b832fdaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134494:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ffa6e04 (ffff94e61e6ef300) 00010000:00010000:0.0:1788572284.134497:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.134500:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b832fdaf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134505:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b832fdaf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134522:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b832fde0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134528:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b832fde0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134534:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b832fde0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134539:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.134542:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b832fde0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134725:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b832fde0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134734:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9eb7253 (ffff94e641724800) 00010000:00010000:0.0:1788572284.134737:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.134740:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b832fde0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134746:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63aa52a00/0xdb7edb52b832fde0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134766:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8000/0xdb7edb52b832fe11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134773:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8000/0xdb7edb52b832fe11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134778:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8000/0xdb7edb52b832fe11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134783:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6410f8000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.134786:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8000/0xdb7edb52b832fe11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134792:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8000/0xdb7edb52b832fe11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134799:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79056c36 (ffff94e641724f00) 00010000:00010000:0.0:1788572284.134802:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.134806:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8000/0xdb7edb52b832fe11 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134812:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8000/0xdb7edb52b832fe11 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134831:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a400/0xdb7edb52b832fe42 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134839:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a400/0xdb7edb52b832fe42 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134845:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a400/0xdb7edb52b832fe42 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134850:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63759a400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.134853:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a400/0xdb7edb52b832fe42 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134859:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a400/0xdb7edb52b832fe42 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134868:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x40347b05 (ffff94e60fa8cc00) 00010000:00010000:0.0:1788572284.134871:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.134874:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a400/0xdb7edb52b832fe42 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134880:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a400/0xdb7edb52b832fe42 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134896:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9600/0xdb7edb52b832fe73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134907:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9600/0xdb7edb52b832fe73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134913:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9600/0xdb7edb52b832fe73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134919:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6410f9600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.134922:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9600/0xdb7edb52b832fe73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134929:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9600/0xdb7edb52b832fe73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.134936:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d834fa8 (ffff94e641724d00) 00010000:00010000:0.0:1788572284.134939:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.134942:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9600/0xdb7edb52b832fe73 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135328:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9600/0xdb7edb52b832fe73 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135351:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8c00/0xdb7edb52b832fea4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135356:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8c00/0xdb7edb52b832fea4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135362:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8c00/0xdb7edb52b832fea4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135366:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6410f8c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.135370:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8c00/0xdb7edb52b832fea4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135376:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8c00/0xdb7edb52b832fea4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135384:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb2b67a7 (ffff94e641724200) 00010000:00010000:0.0:1788572284.135386:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.135390:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8c00/0xdb7edb52b832fea4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135396:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f8c00/0xdb7edb52b832fea4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135411:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649c00/0xdb7edb52b832fed5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135416:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649c00/0xdb7edb52b832fed5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135422:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649c00/0xdb7edb52b832fed5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.135427:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637649c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.139815:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649c00/0xdb7edb52b832fed5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.139845:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649c00/0xdb7edb52b832fed5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.139871:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4e466ca (ffff94e637787a00) 00010000:00010000:0.0:1788572284.139874:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.139882:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649c00/0xdb7edb52b832fed5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.139891:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e637649c00/0xdb7edb52b832fed5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140002:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b832ff06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140057:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b832ff06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140065:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b832ff06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140071:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e68f600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.140074:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b832ff06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140080:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b832ff06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140089:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd8caca36 (ffff94e61e6ef000) 00010000:00010000:0.0:1788572284.140091:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.140095:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b832ff06 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140102:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b832ff06 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140123:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b832ff37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140133:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b832ff37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140139:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b832ff37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140144:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.140146:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b832ff37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140152:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b832ff37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140159:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x791bed9 (ffff94e637787700) 00010000:00010000:0.0:1788572284.140161:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.140164:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b832ff37 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140170:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9400/0xdb7edb52b832ff37 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140184:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b832ff68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140189:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b832ff68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140195:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b832ff68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140200:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61ebcfe00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.140203:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b832ff68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140210:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b832ff68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140216:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf420cda8 (ffff94e637787b00) 00010000:00010000:0.0:1788572284.140218:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.140221:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b832ff68 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140226:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b832ff68 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140762:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e400/0xdb7edb52b832ff99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140773:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e400/0xdb7edb52b832ff99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140780:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e400/0xdb7edb52b832ff99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140786:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e68e400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.140790:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e400/0xdb7edb52b832ff99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140797:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e400/0xdb7edb52b832ff99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140808:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe5dac78b (ffff94e61e6ef600) 00010000:00010000:0.0:1788572284.140811:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.140816:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e400/0xdb7edb52b832ff99 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140823:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e400/0xdb7edb52b832ff99 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140843:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759be00/0xdb7edb52b832ffca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140850:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759be00/0xdb7edb52b832ffca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140856:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759be00/0xdb7edb52b832ffca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140861:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63759be00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.140864:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759be00/0xdb7edb52b832ffca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140870:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759be00/0xdb7edb52b832ffca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140879:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a3eabda (ffff94e61e6d1000) 00010000:00010000:0.0:1788572284.140882:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.140886:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759be00/0xdb7edb52b832ffca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140892:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759be00/0xdb7edb52b832ffca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140910:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117c00/0xdb7edb52b832fffb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140922:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117c00/0xdb7edb52b832fffb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140928:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117c00/0xdb7edb52b832fffb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.140934:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641117c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.140937:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117c00/0xdb7edb52b832fffb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.142316:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117c00/0xdb7edb52b832fffb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.142344:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbbf7aafd (ffff94e637787400) 00010000:00010000:0.0:1788572284.142347:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.142353:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117c00/0xdb7edb52b832fffb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.142361:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641117c00/0xdb7edb52b832fffb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.142398:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b833002c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.142405:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b833002c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.142412:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b833002c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.142417:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e68f000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.142422:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b833002c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.142427:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b833002c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143128:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc033b48c (ffff94e61e6efe00) 00010000:00010000:0.0:1788572284.143132:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.143138:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b833002c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143145:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b833002c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143170:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0c400/0xdb7edb52b833005d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143177:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0c400/0xdb7edb52b833005d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143184:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0c400/0xdb7edb52b833005d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143189:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633d0c400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.143192:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0c400/0xdb7edb52b833005d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143197:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0c400/0xdb7edb52b833005d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143205:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf4ea92f (ffff94e61e6d1d00) 00010000:00010000:0.0:1788572284.143207:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.143212:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0c400/0xdb7edb52b833005d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143217:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e633d0c400/0xdb7edb52b833005d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143246:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a600/0xdb7edb52b833008e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143252:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a600/0xdb7edb52b833008e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143258:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a600/0xdb7edb52b833008e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143263:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63759a600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.143266:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a600/0xdb7edb52b833008e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143271:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a600/0xdb7edb52b833008e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143278:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6189212e (ffff94e61e6d1100) 00010000:00010000:0.0:1788572284.143280:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.143283:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a600/0xdb7edb52b833008e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143289:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63759a600/0xdb7edb52b833008e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143303:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b83300bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143313:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b83300bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143318:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b83300bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143323:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.143325:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b83300bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143330:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b83300bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143336:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x358e2051 (ffff94e637787200) 00010000:00010000:0.0:1788572284.143339:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.143342:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b83300bf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.143347:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b83300bf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572284.192232:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572284.192331:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615931776 00000100:00100000:0.0:1788572284.192343:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615931776 00000100:00100000:0.0:1788572284.192437:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13870 00000100:00100000:0.0:1788572284.192450:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+809:88443:x1875449615931776:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:0.0:1788572284.192481:0:6552:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572284.192510:0:6552:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b83300d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb49c49 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.192616:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b83300db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.192634:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b83300db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.192650:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b83300db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788572284.192709:0:6552:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1788572284.192714:0:6552:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788572284.192739:0:6552:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b83300db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.192768:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b83300d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb49c49 expref: 811 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.192792:0:6552:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b83300db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb49c49 expref: 810 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.192802:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e505993b00) 00010000:00010000:0.0:1788572284.192805:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788572284.192809:0:6552:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1a200, rc 0) 00000100:00100000:0.0:1788572284.192885:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+810:88443:x1875449615931776:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 438us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572284.192892:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13870 00000100:00080000:2.0:1788572284.193326:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572284.198460:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572284.198540:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615931904 00000100:00100000:3.0:1788572284.198623:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615931904 00000100:00100000:3.0:1788572284.198731:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13871 00000100:00100000:3.0:1788572284.198743:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+810:88443:x1875449615931904:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:3.0:1788572284.198797:0:6550:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572284.198893:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+810:88443:x1875449615931904:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 152us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572284.198901:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13871 00000100:00100000:2.0:1788572284.211490:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572284.217978:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615932032 00000100:00100000:2.0:1788572284.218026:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615932032 00000100:00100000:2.0:1788572284.218154:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13872 00000100:00100000:2.0:1788572284.218173:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:88443:x1875449615932032:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:2.0:1788572284.218228:0:6551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572284.218346:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:88443:x1875449615932032:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 180us (6868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572284.218354:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13872 00000100:00080000:2.0:1788572284.218385:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572284.230825:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572284.230960:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615932160 00000100:00100000:2.0:1788572284.230976:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615932160 00000100:00100000:2.0:1788572284.231109:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2821 00000100:00100000:2.0:1788572284.231122:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:88443:x1875449615932160:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:2.0:1788572284.231158:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484838976 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572284.231267:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:88443:x1875449615932160:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 147us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572284.231276:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2821 00000100:00080000:3.0:1788572284.231736:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572284.237534:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572284.237799:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615932288 00000100:00100000:1.0:1788572284.237814:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615932288 00000100:00100000:1.0:1788572284.237875:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3432 00000100:00100000:1.0:1788572284.237885:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2382:x1875449615932288:12345-192.168.202.13@tcp:8:lfs.0 00010000:00080000:1.0:1788572284.237936:0:12091:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t0 exp 0000000000000000 cur 4201 last 0 00000020:00000080:1.0:1788572284.238001:0:12091:0:(genops.c:1385:class_connect()) connect: client 35eb2d60-2de0-4b00-9815-d5153edd0057, cookie 0xdb7edb52b83300e2 00002000:00100000:1.0:1788572284.238034:0:12091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35eb2d60-2de0-4b00-9815-d5153edd0057/ffff94e633ec6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 491585536 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788572284.238060:0:12091:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788572284.238164:0:12091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788572284.238206:0:12091:0:(import.c:65:import_set_state_nolock()) ffff94e633ec1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572284.238294:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2382:x1875449615932288:12345-192.168.202.13@tcp:8:lfs.0 Request processed in 408us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572284.238307:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3432 00000100:00100000:0.0:1788572284.243139:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572284.244154:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615932416 00000100:00100000:3.0:1788572284.244171:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615932416 00000100:00100000:3.0:1788572284.244258:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2822 00000100:00100000:3.0:1788572284.244270:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:88443:x1875449615932416:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:3.0:1788572284.244303:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572284.244389:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:88443:x1875449615932416:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 122us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572284.244396:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2822 00000100:00080000:0.0:1788572284.245620:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572284.354807:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572284.354872:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615932672 00000100:00100000:0.0:1788572284.354885:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615932672 00000100:00100000:0.0:1788572284.354986:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13873 00000100:00100000:0.0:1788572284.355031:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e502d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+810:88450:x1875449615932672:12345-192.168.202.13@tcp:36:mcreate.0 00010000:00010000:0.0:1788572284.355112:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572284.355148:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b83300db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb49c49 expref: 810 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.369080:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e505993b00) 00010000:00010000:0.0:1788572284.369113:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572284.369969:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b83300e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370031:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b83300e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370046:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b83300e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370061:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370068:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370074:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370665:0:6552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b83300e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370677:0:6552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b83300e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370685:0:6552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b83300e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370691:0:6552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e68e800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572284.370697:0:6552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b83300e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370711:0:6552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b83300e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370726:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e506975200) 00010000:00010000:1.0:1788572284.370729:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572284.370734:0:6552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b83300e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370741:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b83300e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572284.370764:0:6552:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba9b00fa reply state 000000006a7954be transno 219043334107 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370775:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.370781:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e506975500) 00010000:00010000:1.0:1788572284.370783:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572284.370787:0:6552:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572284.370938:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e502d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+811:88450:x1875449615932672:12345-192.168.202.13@tcp:36:mcreate.0 Request processed in 15926us (16145us total) trans 219043334107 rc 0/0 00000100:00100000:1.0:1788572284.370949:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13873 00000100:00100000:3.0:1788572284.391612:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572284.391681:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615932800 00000100:00100000:0.0:1788572284.391698:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615932800 00000100:00100000:0.0:1788572284.391777:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13874 00000100:00100000:0.0:1788572284.391791:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+811:88453:x1875449615932800:12345-192.168.202.13@tcp:101:rm.0 00010000:00010000:0.0:1788572284.391821:0:9276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572284.392263:0:9276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9c00/0xdb7edb52b83300f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb49c50 expref: -99 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.392349:0:9276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9000/0xdb7edb52b83300fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.392364:0:9276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9000/0xdb7edb52b83300fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.392381:0:9276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9000/0xdb7edb52b83300fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788572284.392431:0:9276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1788572284.392436:0:9276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788572284.392459:0:9276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9000/0xdb7edb52b83300fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.392484:0:9276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9c00/0xdb7edb52b83300f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb49c50 expref: 813 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.392504:0:9276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9000/0xdb7edb52b83300fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb49c50 expref: 812 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572284.392513:0:9276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e5023ada00) 00010000:00010000:3.0:1788572284.392516:0:9276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788572284.392520:0:9276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e6410f9000, rc 0) 00000100:00100000:3.0:1788572284.392588:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+812:88453:x1875449615932800:12345-192.168.202.13@tcp:101:rm.0 Request processed in 799us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572284.392602:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13874 00000100:00100000:0.0:1788572284.400314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572284.409119:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615932928 00000100:00100000:2.0:1788572284.409140:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615932928 00000100:00100000:1.0:1788572284.409545:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13875 00000100:00100000:1.0:1788572284.409560:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e502d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+812:88453:x1875449615932928:12345-192.168.202.13@tcp:101:rm.0 00010000:00010000:1.0:1788572284.409586:0:6551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572284.409614:0:6551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b8330105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb49c57 expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.409710:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b833010c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.409729:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b833010c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.409745:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b833010c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.409759:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b8330113 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.409767:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b8330113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.409774:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b8330113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410386:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b833011a lrc: 3/1,0 mode: --/PR res: [0x2000182d1:0x965:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410399:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b833011a lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x965:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410407:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b833011a lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x965:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572284.410462:0:6551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000182d1:0x965:0x0]: returning size 0 00000004:00200000:1.0:1788572284.410466:0:6551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572284.410495:0:6551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b833011a lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x965:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410513:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b833011a lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x965:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410522:0:6551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b833010c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410529:0:6551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b833010c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410536:0:6551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b833010c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410543:0:6551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e68f600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572284.410548:0:6551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b833010c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410557:0:6551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b833010c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410570:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e5023ada00) 00010000:00010000:1.0:1788572284.410573:0:6551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572284.410578:0:6551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b833010c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410584:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f600/0xdb7edb52b833010c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410597:0:6551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b8330113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410603:0:6551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b8330113 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410609:0:6551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b8330113 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410613:0:6551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e68e600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572284.410616:0:6551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b8330113 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410621:0:6551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b8330113 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410627:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e506975500) 00010000:00010000:1.0:1788572284.410630:0:6551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572284.410633:0:6551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b8330113 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410638:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e600/0xdb7edb52b8330113 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410668:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68e800/0xdb7edb52b8330105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb49c57 expref: 814 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410682:0:6551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b833011a lrc: 3/0,0 mode: PR/PR res: [0x2000182d1:0x965:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb49c57 expref: 813 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572284.410690:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x965:0x0].0x0 (ffff94e506975200) 00010000:00010000:1.0:1788572284.410693:0:6551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788572284.410695:0:6551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61e68f400, rc 0) 00000100:00100000:1.0:1788572284.410794:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e502d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+813:88453:x1875449615932928:12345-192.168.202.13@tcp:101:rm.0 Request processed in 1235us (10561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572284.410807:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13875 00000100:00100000:0.0:1788572284.426205:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572284.428546:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572284.428576:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639023744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572284.428664:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572284.429297:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639023744 00000100:00100000:2.0:1788572284.429311:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639023744 00000100:00100000:2.0:1788572284.429386:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823 00000100:00100000:2.0:1788572284.429399:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639023744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572284.429431:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572284.429505:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639023744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572284.429513:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823 00000100:00100000:2.0:1788572284.429563:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968476 gen 3 00000100:00100000:2.0:1788572284.429609:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639023744:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788572284.438551:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572284.441174:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615933184 00000100:00100000:0.0:1788572284.441198:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615933184 00000100:00100000:0.0:1788572284.441330:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 13876 00000100:00100000:0.0:1788572284.441343:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+813:88453:x1875449615933184:12345-192.168.202.13@tcp:36:rm.0 00010000:00010000:0.0:1788572284.441418:0:95742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788572284.441455:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f400/0xdb7edb52b833011a lrc: 0/0,0 mode: --/PR res: [0x2000182d1:0x965:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb49c57 expref: 813 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.441486:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x965:0x0].0x0 (ffff94e506975200) 00010000:00010000:0.0:1788572284.441508:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e6410f9000/0xdb7edb52b83300fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb49c50 expref: 812 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.441518:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e5023ada00) 00010000:00010000:0.0:1788572284.441526:0:95742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788572284.441561:0:95742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b8330121 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.441578:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b8330121 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.441590:0:95742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b8330121 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.441603:0:95742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.441611:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.441618:0:95742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.441735:0:95742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b833012f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x965:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.441744:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b833012f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x965:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.441754:0:95742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b833012f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x965:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442550:0:95742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b8330136 lrc: 3/0,1 mode: --/PW res: [0x2000182d1:0x965:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442568:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b8330136 lrc: 3/0,1 mode: PW/PW res: [0x2000182d1:0x965:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442578:0:95742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b8330136 lrc: 3/0,1 mode: PW/PW res: [0x2000182d1:0x965:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442586:0:95742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b8330136 lrc: 4/0,1 mode: PW/PW res: [0x2000182d1:0x965:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442593:0:95742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b8330136 lrc: 4/0,1 mode: PW/PW res: [0x2000182d1:0x965:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442599:0:95742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b8330136 lrc: 3/0,0 mode: PW/PW res: [0x2000182d1:0x965:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442620:0:95742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572284.442645:0:95742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b833012f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x965:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442650:0:95742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b833012f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x965:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442657:0:95742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b833012f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x965:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442663:0:95742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.442669:0:95742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b833012f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x965:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442677:0:95742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b833012f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x965:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442689:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x965:0x0].0x0 (ffff94e505993800) 00010000:00010000:0.0:1788572284.442692:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788572284.442696:0:95742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b833012f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x965:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442703:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a000/0xdb7edb52b833012f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x965:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442722:0:95742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b8330121 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442728:0:95742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b8330121 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442733:0:95742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b8330121 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442738:0:95742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572284.442740:0:95742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b8330121 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442746:0:95742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b8330121 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442752:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e505993b00) 00010000:00010000:0.0:1788572284.442755:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572284.442758:0:95742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b8330121 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442763:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b000/0xdb7edb52b8330121 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788572284.442777:0:95742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cfcbc3a reply state 0000000060da41ff transno 219043334108 ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442788:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572284.442794:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e506975500) 00010000:00010000:0.0:1788572284.442796:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788572284.442799:0:95742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788572284.446423:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+813:88453:x1875449615933184:12345-192.168.202.13@tcp:36:rm.0 Request processed in 5064us (20211us total) trans 219043334108 rc 0/0 00000100:00100000:0.0:1788572284.446441:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 13876 00010000:00010000:2.0:1788572284.451925:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572284.452326:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b8330136 lrc: 2/0,0 mode: PW/PW res: [0x2000182d1:0x965:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.452344:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61ebcfe00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572284.452349:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b8330136 lrc: 2/0,0 mode: PW/PW res: [0x2000182d1:0x965:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.452361:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b8330136 lrc: 3/0,0 mode: PW/PW res: [0x2000182d1:0x965:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.452386:0:92610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x965:0x0].0x0 (ffff94e505993800) 00010000:00010000:2.0:1788572284.452389:0:92610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788572284.452395:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b8330136 lrc: 1/0,0 mode: --/PW res: [0x2000182d1:0x965:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.452402:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61ebcfe00/0xdb7edb52b8330136 lrc: 0/0,0 mode: --/PW res: [0x2000182d1:0x965:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572284.452432:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572284.452435:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572284.452437:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572284.611340:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572284.931691:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572284.940914:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639023872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572284.941083:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572284.941360:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639023872 00000100:00100000:3.0:1788572284.941373:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639023872 00000100:00100000:3.0:1788572284.941471:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824 00000100:00100000:3.0:1788572284.941483:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639023872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572284.941521:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484838976 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572284.941583:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639023872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572284.941590:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824 00000100:00080000:0.0:1788572284.941708:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572284.941789:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639023872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572285.444309:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639024384:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.444404:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572285.444660:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639024896:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.444689:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572285.444711:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639025408:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.444733:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572285.444762:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788572285.444768:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639024256:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.444791:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572285.444816:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639024768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.444835:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572285.444852:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639025280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.444872:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572285.444909:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639024384 00000100:00100000:0.0:1788572285.444919:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639024384 00000100:00100000:0.0:1788572285.444989:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639025408 00000100:00100000:0.0:1788572285.444993:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639025408 00000100:00100000:0.0:1788572285.445036:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639024768 00000100:00100000:0.0:1788572285.445038:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639024768 00000100:00100000:0.0:1788572285.445069:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639025280 00000100:00100000:0.0:1788572285.445072:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639025280 00000100:00100000:1.0:1788572285.445186:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639024000:0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.445234:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572285.445264:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639024512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.445285:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572285.445301:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639025024:0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.445318:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572285.445332:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639025536:0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.445349:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572285.445365:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788572285.445370:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639024128:0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.445391:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572285.445407:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639024640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.445424:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572285.445581:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639025152:0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.445603:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572285.445639:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639024000 00000100:00100000:1.0:1788572285.445643:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639024000 00000100:00100000:1.0:1788572285.445678:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788572285.445687:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e615386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639024000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.445744:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e615386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639024000:12345-0@lo:400:kworker.0 Request processed in 57us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572285.445752:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788572285.445786:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639024896 00000100:00100000:1.0:1788572285.445790:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639024896 00000100:00100000:1.0:1788572285.445811:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639024256 00000100:00100000:1.0:1788572285.445813:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639024256 00000100:00100000:1.0:1788572285.445822:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639024512 00000100:00100000:1.0:1788572285.445825:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639024512 00000100:00100000:1.0:1788572285.445836:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639025024 00000100:00100000:1.0:1788572285.445838:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639025024 00000100:00100000:1.0:1788572285.445854:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639025536 00000100:00100000:1.0:1788572285.445856:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639025536 00000100:00100000:1.0:1788572285.445866:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639024640 00000100:00100000:1.0:1788572285.445868:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639024640 00000100:00100000:1.0:1788572285.445881:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4478 00000100:00100000:1.0:1788572285.445886:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639024896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.445921:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639024896:12345-0@lo:400:kworker.0 Request processed in 34us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572285.445927:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4478 00000100:00100000:1.0:1788572285.445939:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4479 00000100:00100000:1.0:1788572285.445944:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639024256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.445968:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639024256:12345-0@lo:400:kworker.0 Request processed in 25us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572285.445974:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4479 00000100:00100000:1.0:1788572285.445998:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4480 00000100:00100000:1.0:1788572285.446025:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639024512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572285.446051:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639024512:12345-0@lo:400:kworker.0 Request processed in 49us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572285.446057:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4480 00000100:00100000:1.0:1788572285.446067:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4481 00000100:00100000:1.0:1788572285.446072:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639025024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572285.446239:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4482 00000100:00100000:2.0:1788572285.446250:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639025536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.446323:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3663 00000100:00100000:0.0:1788572285.446332:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639024384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572285.446627:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4483 00000100:00100000:3.0:1788572285.446640:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639024640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572285.446856:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639025536:12345-0@lo:400:kworker.0 Request processed in 609us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572285.446865:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4482 00000100:00100000:0.0:1788572285.447069:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639024384:12345-0@lo:400:kworker.0 Request processed in 738us (2663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572285.447077:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3663 00000100:00100000:0.0:1788572285.447104:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3664 00000100:00100000:0.0:1788572285.447113:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639025408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.447149:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639025408:12345-0@lo:400:kworker.0 Request processed in 39us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572285.447156:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3664 00000100:00100000:0.0:1788572285.447167:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3665 00000100:00100000:0.0:1788572285.447173:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639024768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.447200:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639024768:12345-0@lo:400:kworker.0 Request processed in 27us (2364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572285.447205:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3665 00000100:00100000:0.0:1788572285.447214:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3666 00000100:00100000:0.0:1788572285.447219:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639025280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.447258:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639025280:12345-0@lo:400:kworker.0 Request processed in 38us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572285.447264:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3666 00000100:00080000:0.0:1788572285.447332:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572285.447338:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572285.447342:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572285.447345:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572285.447400:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639024256:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.447415:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639024768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.447426:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572285.447664:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639025280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.447684:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639024384:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.447699:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639024896:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.447712:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639025408:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.447780:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639024128 00000100:00100000:0.0:1788572285.447788:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639024128 00000100:00100000:0.0:1788572285.447824:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1788572285.447831:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639024128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.447872:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639024128:12345-0@lo:400:kworker.0 Request processed in 42us (2480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572285.447879:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:0.0:1788572285.447890:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639025152 00000100:00100000:0.0:1788572285.447894:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639025152 00000100:00100000:0.0:1788572285.447913:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1788572285.447917:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639025152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.447947:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639025152:12345-0@lo:400:kworker.0 Request processed in 29us (2342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572285.447952:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1788572285.448044:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639024128:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.448057:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639025152:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.448068:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639024000:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.448080:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639024512:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.448093:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639025536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572285.448776:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639025024:12345-0@lo:400:kworker.0 Request processed in 2699us (3452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572285.448787:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4481 00000100:00100000:1.0:1788572285.448867:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639025024:0@lo:400:kworker.0 00000100:00100000:3.0:1788572285.448976:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639024640:12345-0@lo:400:kworker.0 Request processed in 2338us (3547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572285.448992:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4483 00000100:00100000:2.0:1788572285.449366:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639025664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572285.449415:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572285.449464:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639025664 00000100:00100000:2.0:1788572285.449469:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639025664 00000100:00100000:2.0:1788572285.449506:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00100000:2.0:1788572285.449513:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639025664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572285.449545:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572285.449584:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639025664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572285.449590:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00000100:00100000:2.0:1788572285.449622:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639025664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572285.453716:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639024640:0@lo:400:kworker.0 00010000:00010000:1.0:1788572285.637230:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572285.869241:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572285.869281:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572285.869305:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572285.869373:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615933696 00000100:00100000:0.0:1788572285.869382:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615933696 00000100:00100000:0.0:1788572285.869466:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615933824 00000100:00100000:0.0:1788572285.869470:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615933824 00000100:00100000:0.0:1788572285.869552:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3667 00000100:00100000:0.0:1788572285.869575:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449615933696:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572285.869691:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449615933696:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 131us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572285.869969:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615933440 00000100:00100000:1.0:1788572285.869993:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615933440 00000100:00100000:1.0:1788572285.870052:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4484 00000100:00100000:1.0:1788572285.870060:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+813:2385:x1875449615933440:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572285.870096:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+813:2385:x1875449615933440:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 37us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572285.870103:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4484 00000100:00100000:1.0:1788572285.870129:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3668 00000100:00100000:1.0:1788572285.870136:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449615933824:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572285.870158:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449615933824:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572285.870164:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3668 00000100:00100000:0.0:1788572285.870576:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3667 00000100:00100000:3.0:1788572285.880577:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572285.880651:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615933312 00000100:00100000:0.0:1788572285.880661:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615933312 00000100:00100000:0.0:1788572285.880715:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00100000:0.0:1788572285.880725:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615933312:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572285.880798:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615933312:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572285.880806:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00100000:1.0:1788572285.890430:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572285.890521:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615933568 00000100:00100000:2.0:1788572285.890531:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615933568 00000100:00100000:2.0:1788572285.890596:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4485 00000100:00100000:2.0:1788572285.890607:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615933568:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572285.890691:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615933568:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572285.890698:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4485 00000100:00100000:2.0:1788572285.959522:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572285.959547:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639025792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572285.959616:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572285.959663:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639025792 00000100:00100000:2.0:1788572285.959670:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639025792 00000100:00100000:2.0:1788572285.959712:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:2.0:1788572285.959720:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639025792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572285.959742:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572285.959787:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639025792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572285.959795:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00000100:00100000:2.0:1788572285.959852:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639025792:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572286.659482:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572287.683378:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572288.713649:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572289.027347:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639025920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572289.027420:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572289.027691:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639025920 00000100:00100000:2.0:1788572289.027699:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639025920 00000100:00100000:2.0:1788572289.027753:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:2.0:1788572289.027762:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639025920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572289.027804:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:2.0:1788572289.027868:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639025920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572289.027875:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00100000:2.0:1788572289.027919:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639025920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572289.042777:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572289.042811:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639026048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572289.042889:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572289.043348:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639026048 00000100:00100000:1.0:1788572289.043358:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639026048 00000100:00100000:1.0:1788572289.043415:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826 00000100:00100000:1.0:1788572289.043426:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639026048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572289.043454:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484838976 pending 0 free 3923476480 avail 3691954176 00010000:00000080:1.0:1788572289.043469:0:8468:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e637597100 x1875449639026048/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:705/0 lens 224/368 e 0 to 0 dl 1788572300 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572289.043524:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639026048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572289.043531:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826 00000100:00100000:3.0:1788572289.043619:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639026048:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788572289.045933:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572289.541397:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639026176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572289.541478:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572289.541587:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639026176 00000100:00100000:3.0:1788572289.541596:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639026176 00000100:00100000:3.0:1788572289.541656:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827 00000100:00100000:3.0:1788572289.541667:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639026176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572289.541698:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572289.541743:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639026176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572289.541750:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827 00000100:00080000:2.0:1788572289.541914:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572289.541962:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639026176:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572289.732224:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572290.054283:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639026304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572290.054353:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572290.054414:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639026304 00000100:00100000:1.0:1788572290.054422:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639026304 00000100:00100000:1.0:1788572290.054474:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:1.0:1788572290.054485:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639026304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572290.054509:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484838976 pending 0 free 3923476480 avail 3691954176 00010000:00000080:1.0:1788572290.054524:0:8468:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e634c91450 x1875449639026304/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:706/0 lens 224/368 e 0 to 0 dl 1788572301 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572290.054565:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639026304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572290.054572:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00000100:00100000:1.0:1788572290.054811:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639026304:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572290.055365:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788572290.065332:0:9546:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000001:00080000:3.0:1788572290.065871:0:111978:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 219043334108 is committed 00010000:00010000:2.0:1788572290.065928:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.065949:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.065956:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.065962:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e68f000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572290.065966:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.065974:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.065991:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e506975500) 00010000:00010000:2.0:1788572290.065994:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572290.065998:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.066033:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e68f000/0xdb7edb52b83300f0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.066055:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.066061:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.066067:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.066072:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572290.066074:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.066080:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.066088:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e506975500) 00010000:00010000:2.0:1788572290.066091:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572290.066093:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572290.066099:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a200/0xdb7edb52b8330128 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572290.564204:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639026432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572290.564287:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572290.564531:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639026432 00000100:00100000:3.0:1788572290.564539:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639026432 00000100:00100000:3.0:1788572290.564590:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708 00000100:00100000:3.0:1788572290.564600:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639026432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572290.564631:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572290.564685:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639026432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572290.564692:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708 00000100:00100000:1.0:1788572290.564769:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639026432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572290.566146:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639026688:0@lo:400:kworker.0 00000100:00100000:3.0:1788572290.566189:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572290.566221:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639027200:0@lo:400:kworker.0 00000100:00100000:1.0:1788572290.566327:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639026560:0@lo:400:kworker.0 00000100:00100000:1.0:1788572290.566360:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572290.566382:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639027072:0@lo:400:kworker.0 00000100:00100000:1.0:1788572290.566417:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572290.566436:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639027584:0@lo:400:kworker.0 00000100:00100000:1.0:1788572290.566459:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572290.566498:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639027072 00000100:00100000:1.0:1788572290.566504:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639027072 00000100:00100000:1.0:1788572290.566553:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4486 00000100:00100000:1.0:1788572290.566562:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639027072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572290.566607:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639027072:12345-0@lo:400:kworker.0 Request processed in 47us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572290.566614:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4486 00000100:00100000:1.0:1788572290.566638:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639027584 00000100:00100000:1.0:1788572290.566641:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639027584 00000100:00100000:1.0:1788572290.566667:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3669 00000100:00100000:1.0:1788572290.566673:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639027584:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572290.566686:0:43973:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e6375a5c00 x1875449639027584/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:706/0 lens 224/224 e 0 to 0 dl 1788572301 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572290.566713:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639027584:12345-0@lo:400:kworker.0 Request processed in 40us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572290.566718:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3669 00000100:00100000:1.0:1788572290.566749:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639027072:0@lo:400:kworker.0 00000100:00100000:1.0:1788572290.566757:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639027584:0@lo:400:kworker.0 00000100:00100000:3.0:1788572290.566931:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572290.566967:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639027712:0@lo:400:kworker.0 00000100:00100000:3.0:1788572290.566989:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572290.567291:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639026560 00000100:00100000:2.0:1788572290.567297:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639026560 00000100:00100000:2.0:1788572290.567329:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788572290.567336:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639026560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.567375:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639026560:12345-0@lo:400:kworker.0 Request processed in 40us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572290.567382:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788572290.567420:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572290.567441:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639026560:0@lo:400:kworker.0 00000100:00100000:3.0:1788572290.567795:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639026688 00000100:00100000:3.0:1788572290.567801:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639026688 00000100:00100000:3.0:1788572290.567837:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:3.0:1788572290.567843:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639026688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572290.567882:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639026688:12345-0@lo:400:kworker.0 Request processed in 40us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572290.567889:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000100:00100000:3.0:1788572290.567910:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639027200 00000100:00100000:3.0:1788572290.567913:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639027200 00000100:00100000:3.0:1788572290.567955:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639027712 00000100:00100000:3.0:1788572290.567958:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639027712 00000100:00100000:3.0:1788572290.567988:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3670 00000100:00100000:3.0:1788572290.567995:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639027200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572290.568079:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639027200:12345-0@lo:400:kworker.0 Request processed in 84us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572290.568087:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3670 00000100:00100000:3.0:1788572290.568098:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3671 00000100:00100000:3.0:1788572290.568103:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639027712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572290.568129:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639027712:12345-0@lo:400:kworker.0 Request processed in 27us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572290.568136:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3671 00000100:00080000:3.0:1788572290.568161:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572290.568173:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639026816:0@lo:400:kworker.0 00000100:00100000:3.0:1788572290.568198:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572290.568218:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639027328:0@lo:400:kworker.0 00000100:00100000:3.0:1788572290.568491:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572290.568551:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639027840:0@lo:400:kworker.0 00000100:00100000:3.0:1788572290.568575:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572290.577457:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639026944:0@lo:400:kworker.0 00000100:00100000:1.0:1788572290.582508:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639026816 00000100:00100000:1.0:1788572290.582522:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639026816 00000100:00100000:2.0:1788572290.582641:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639027328 00000100:00100000:2.0:1788572290.582647:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639027328 00000100:00100000:2.0:1788572290.582688:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639027840 00000100:00100000:2.0:1788572290.582692:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639027840 00000100:00100000:2.0:1788572290.582714:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4487 00000100:00100000:2.0:1788572290.582723:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639026816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.582807:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639026816:12345-0@lo:400:kworker.0 Request processed in 86us (14608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572290.582815:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4487 00000100:00100000:2.0:1788572290.582832:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4488 00000100:00100000:2.0:1788572290.582838:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639027328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.582866:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639027328:12345-0@lo:400:kworker.0 Request processed in 29us (14376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572290.582873:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4488 00000100:00100000:2.0:1788572290.582886:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4489 00000100:00100000:2.0:1788572290.582892:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639027840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.582917:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639027840:12345-0@lo:400:kworker.0 Request processed in 25us (14342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572290.582923:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4489 00000100:00080000:2.0:1788572290.582954:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572290.582970:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572290.583029:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639027456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.583064:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572290.583092:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639026944 00000100:00100000:2.0:1788572290.583096:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639026944 00000100:00100000:2.0:1788572290.583114:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639027456 00000100:00100000:2.0:1788572290.583117:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639027456 00000100:00100000:2.0:1788572290.583131:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4490 00000100:00100000:2.0:1788572290.583136:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639026944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.583168:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639026944:12345-0@lo:400:kworker.0 Request processed in 31us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572290.583174:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4490 00000100:00100000:2.0:1788572290.583185:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4491 00000100:00100000:2.0:1788572290.583191:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639027456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.583217:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639027456:12345-0@lo:400:kworker.0 Request processed in 26us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572290.583222:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4491 00000100:00080000:2.0:1788572290.583249:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572290.583252:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572290.583279:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639026944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.583290:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639027456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.587493:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639026688:0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.587514:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639027200:0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.587526:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639027712:0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.587573:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639027840:0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.587593:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639026816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572290.587605:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639027328:0@lo:400:kworker.0 00010000:00010000:0.0:1788572290.756461:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572290.978505:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572290.978632:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572290.978704:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615934080 00000100:00100000:3.0:1788572290.978714:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615934080 00000100:00100000:3.0:1788572290.978775:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4492 00000100:00100000:3.0:1788572290.978784:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+809:2386:x1875449615934080:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572290.993485:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615934336 00000100:00100000:2.0:1788572290.993499:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615934336 00000100:00100000:2.0:1788572290.993578:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3672 00000100:00100000:2.0:1788572290.993589:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615934336:12345-192.168.202.13@tcp:400:kworker.0 00010000:00000080:2.0:1788572290.993615:0:43965:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e63778d180 x1875449615934336/t0(0) o400->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:706/0 lens 224/224 e 0 to 0 dl 1788572301 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572290.993839:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+809:2386:x1875449615934080:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 15053us (16832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572290.993849:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4492 00000100:00100000:0.0:1788572290.995731:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572290.995768:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572290.995799:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572290.995829:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615934208 00000100:00100000:0.0:1788572290.995837:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615934208 00000100:00100000:0.0:1788572290.995884:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4493 00000100:00100000:0.0:1788572290.995893:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615934208:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572290.995966:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615934208:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572290.995973:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4493 00000100:00100000:0.0:1788572290.995994:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615934464 00000100:00100000:0.0:1788572290.995998:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615934464 00000100:00100000:0.0:1788572290.996046:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3673 00000100:00100000:0.0:1788572290.996053:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449615934464:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572290.996095:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449615934464:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 43us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572290.996102:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3673 00000100:00080000:0.0:1788572290.996200:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572290.996205:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572290.996207:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572290.996210:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572290.998452:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615933952 00000100:00100000:3.0:1788572290.998468:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615933952 00000100:00100000:3.0:1788572290.998542:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 103 00000100:00100000:3.0:1788572290.998552:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615933952:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572290.998622:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615933952:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 72us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572290.998629:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 103 00000100:00100000:2.0:1788572291.005434:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615934336:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 11833us (26788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572291.005449:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3672 00000100:00100000:2.0:1788572291.112619:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639027968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572291.112693:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572291.113154:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639027968 00000100:00100000:3.0:1788572291.113163:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639027968 00000100:00100000:3.0:1788572291.113238:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:3.0:1788572291.113247:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639027968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572291.113275:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572291.113327:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639027968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572291.113334:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00100000:1.0:1788572291.113687:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639027968:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572291.781042:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572292.808767:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572293.827482:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788572293.868278:0:113865:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:0.0:1788572294.147388:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572294.147423:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639028096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572294.147963:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572294.148216:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572294.148230:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639028224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572294.148280:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572294.148320:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639028224 00000100:00100000:0.0:1788572294.148331:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639028224 00000100:00100000:0.0:1788572294.148762:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830 00000100:00100000:0.0:1788572294.148776:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639028224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572294.148820:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484838976 pending 0 free 3923476480 avail 3691954176 00010000:00000080:0.0:1788572294.148841:0:8468:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e63778d880 x1875449639028224/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:710/0 lens 224/368 e 0 to 0 dl 1788572305 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572294.148896:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639028224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572294.148904:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830 00000100:00080000:0.0:1788572294.148943:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572294.149119:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639028224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572294.149762:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639028096 00000100:00100000:2.0:1788572294.149772:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639028096 00000100:00100000:2.0:1788572294.149845:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:2.0:1788572294.149857:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639028096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572294.149894:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:2.0:1788572294.149975:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639028096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572294.149982:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00000100:00100000:0.0:1788572294.150756:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639028096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572294.661902:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572294.661947:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639028352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572294.662082:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572294.662258:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639028352 00000100:00100000:2.0:1788572294.662268:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639028352 00000100:00100000:2.0:1788572294.662354:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:2.0:1788572294.662366:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639028352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572294.662407:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572294.662471:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639028352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572294.662479:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00080000:0.0:1788572294.662620:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572294.662781:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639028352:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788572294.851967:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572295.172256:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572295.172278:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639028480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572295.172348:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.172411:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639028480 00000100:00100000:3.0:1788572295.172418:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639028480 00000100:00100000:3.0:1788572295.172476:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:3.0:1788572295.172485:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639028480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572295.172510:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484838976 pending 0 free 3923476480 avail 3691954176 00010000:00000080:3.0:1788572295.172526:0:8468:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e6412b3100 x1875449639028480/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:711/0 lens 224/368 e 0 to 0 dl 1788572306 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572295.172568:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639028480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572295.172575:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00000100:00080000:3.0:1788572295.172596:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572295.172634:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639028480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572295.685440:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572295.685470:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639028608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572295.685556:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572295.685647:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639028608 00000100:00100000:1.0:1788572295.685655:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639028608 00000100:00100000:1.0:1788572295.685707:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:1.0:1788572295.685716:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639028608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572295.685754:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572295.685804:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639028608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572295.685811:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:1.0:1788572295.685857:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639028608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572295.704247:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639029120:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.704333:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.704410:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639029632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.704432:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.704457:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572295.704462:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639028736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.704493:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.704516:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639029248:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.704537:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.704553:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639029760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.704576:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.704609:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639028736 00000100:00100000:3.0:1788572295.704617:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639028736 00000100:00100000:3.0:1788572295.704665:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788572295.704674:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639028736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.704723:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639028736:12345-0@lo:400:kworker.0 Request processed in 50us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572295.704730:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788572295.704767:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639029120 00000100:00100000:3.0:1788572295.704770:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639029120 00000100:00100000:3.0:1788572295.704803:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639029632 00000100:00100000:3.0:1788572295.704805:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639029632 00000100:00100000:3.0:1788572295.704821:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639029248 00000100:00100000:3.0:1788572295.704823:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639029248 00000100:00100000:3.0:1788572295.704847:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4494 00000100:00100000:3.0:1788572295.704852:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639029120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.704884:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639029120:12345-0@lo:400:kworker.0 Request processed in 32us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572295.704904:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4494 00000100:00100000:3.0:1788572295.704915:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4495 00000100:00100000:3.0:1788572295.704921:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639029632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.704951:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639029632:12345-0@lo:400:kworker.0 Request processed in 30us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572295.704974:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4495 00000100:00100000:3.0:1788572295.704987:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4496 00000100:00100000:3.0:1788572295.704993:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639029248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705041:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639029248:12345-0@lo:400:kworker.0 Request processed in 49us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572295.705047:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4496 00000100:00100000:3.0:1788572295.705065:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639029760 00000100:00100000:3.0:1788572295.705068:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639029760 00000100:00100000:3.0:1788572295.705099:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3674 00000100:00100000:3.0:1788572295.705105:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639029760:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572295.705123:0:8465:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e6412b0700 x1875449639029760/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:711/0 lens 224/224 e 0 to 0 dl 1788572306 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572295.705154:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639029760:12345-0@lo:400:kworker.0 Request processed in 49us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572295.705159:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3674 00000100:00080000:3.0:1788572295.705190:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572295.705194:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572295.705205:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639028864:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705236:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.705256:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639029376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705278:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.705298:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639029888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705317:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.705338:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788572295.705344:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639028992:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705367:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.705382:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639029504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705404:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.705418:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639030016:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705438:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572295.705462:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639029376 00000100:00100000:3.0:1788572295.705465:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639029376 00000100:00100000:3.0:1788572295.705491:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639029888 00000100:00100000:3.0:1788572295.705494:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639029888 00000100:00100000:3.0:1788572295.705511:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3675 00000100:00100000:3.0:1788572295.705517:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639029376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705554:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639029376:12345-0@lo:400:kworker.0 Request processed in 37us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572295.705560:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3675 00000100:00100000:3.0:1788572295.705572:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3676 00000100:00100000:3.0:1788572295.705578:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639029888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705604:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639029888:12345-0@lo:400:kworker.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572295.705609:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3676 00000100:00100000:3.0:1788572295.705627:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639028992 00000100:00100000:3.0:1788572295.705631:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639028992 00000100:00100000:3.0:1788572295.705645:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639029504 00000100:00100000:3.0:1788572295.705647:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639029504 00000100:00100000:3.0:1788572295.705658:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639030016 00000100:00100000:3.0:1788572295.705661:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639030016 00000100:00100000:3.0:1788572295.705672:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4497 00000100:00100000:3.0:1788572295.705677:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639028992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705703:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639028992:12345-0@lo:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572295.705708:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4497 00000100:00100000:3.0:1788572295.705719:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4498 00000100:00100000:3.0:1788572295.705725:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639029504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705752:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639029504:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572295.705757:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4498 00000100:00100000:3.0:1788572295.705767:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4499 00000100:00100000:3.0:1788572295.705771:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639030016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705795:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639030016:12345-0@lo:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572295.705799:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4499 00000100:00080000:3.0:1788572295.705816:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572295.705819:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572295.705846:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639028736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705862:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639029248:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705872:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639029760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705883:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639029120:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705894:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639029632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705929:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639028992:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705938:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639029504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705948:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639030016:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705972:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639029376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572295.705981:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639029888:0@lo:400:kworker.0 00000100:00100000:2.0:1788572295.706372:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639028864 00000100:00100000:2.0:1788572295.706378:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639028864 00000100:00100000:2.0:1788572295.706487:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:2.0:1788572295.706495:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639028864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572295.706553:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639028864:12345-0@lo:400:kworker.0 Request processed in 59us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572295.706559:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1788572295.710435:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639028864:0@lo:400:kworker.0 00010000:00010000:0.0:1788572295.878266:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572296.108494:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572296.108591:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572296.108625:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572296.108658:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572296.108692:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572296.108720:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615934848 00000100:00100000:0.0:1788572296.108730:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615934848 00000100:00100000:0.0:1788572296.108795:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615934720 00000100:00100000:0.0:1788572296.108799:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615934720 00000100:00100000:0.0:1788572296.108821:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4500 00000100:00100000:0.0:1788572296.108832:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615934848:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572296.108908:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615934848:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 79us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572296.108916:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4500 00000100:00100000:0.0:1788572296.108934:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4501 00000100:00100000:0.0:1788572296.108941:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+809:2386:x1875449615934720:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572296.108977:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+809:2386:x1875449615934720:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572296.108984:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4501 00000100:00100000:0.0:1788572296.109043:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615935104 00000100:00100000:0.0:1788572296.109047:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615935104 00000100:00100000:0.0:1788572296.109077:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615934976 00000100:00100000:0.0:1788572296.109081:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615934976 00000100:00100000:0.0:1788572296.109104:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3677 00000100:00100000:0.0:1788572296.109110:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449615935104:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572296.109137:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449615935104:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572296.109144:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3677 00000100:00100000:0.0:1788572296.109156:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3678 00000100:00100000:0.0:1788572296.109163:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615934976:12345-192.168.202.13@tcp:400:kworker.0 00010000:00000080:0.0:1788572296.109180:0:43966:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e60fc8c700 x1875449615934976/t0(0) o400->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:712/0 lens 224/224 e 0 to 0 dl 1788572307 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572296.109205:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449615934976:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 42us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572296.109211:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3678 00000100:00080000:3.0:1788572296.109348:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572296.109353:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572296.109355:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572296.109357:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572296.109847:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449615934592 00000100:00100000:2.0:1788572296.109855:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449615934592 00000100:00100000:2.0:1788572296.109936:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 105 00000100:00100000:2.0:1788572296.109944:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615934592:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572296.110001:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449615934592:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 57us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572296.110032:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 105 00000100:00100000:2.0:1788572296.196785:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639030144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572296.196870:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572296.198173:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639030144 00000100:00100000:1.0:1788572296.198186:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639030144 00000100:00100000:1.0:1788572296.198255:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833 00000100:00100000:1.0:1788572296.198267:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639030144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572296.198299:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572296.198366:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639030144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572296.198373:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833 00000100:00100000:1.0:1788572296.198427:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639030144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572302.997316:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639068800 00000100:00100000:0.0:1788572302.997323:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639068800 00000100:00100000:0.0:1788572302.997372:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069312 00000100:00100000:0.0:1788572302.997376:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069312 00000100:00100000:0.0:1788572302.997397:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707 00000100:00100000:0.0:1788572302.997405:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+158:3650:x1875449639068800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572302.997421:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2622 count 1 00002000:00010000:0.0:1788572302.997441:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572302.997449:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d3f6685/0xdb7edb52b8334a5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997460:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3e:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572302.997464:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572302.997469:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d3f6685/0xdb7edb52b8334a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997487:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d3f6685/0xdb7edb52b8334a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997496:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d3f6685/0xdb7edb52b8334a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997504:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d3f6685/0xdb7edb52b8334a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997524:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00000080:0.0:1788572302.997585:0:17011:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e63779b800 x1875449639068800/t8589935929(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:718/0 lens 544/432 e 0 to 0 dl 1788572313 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572302.997685:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+159:3650:x1875449639068800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 280us (838us total) trans 8589935929 rc 0/0 00000100:00100000:0.0:1788572302.997693:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707 00000100:00100000:0.0:1788572302.997709:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:0.0:1788572302.997716:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+158:3650:x1875449639069312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572302.997726:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2626 count 1 00002000:00010000:0.0:1788572302.997740:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572302.997747:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b15c095/0xdb7edb52b8334a62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997756:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa42:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572302.997760:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572302.997765:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b15c095/0xdb7edb52b8334a62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997775:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b15c095/0xdb7edb52b8334a62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997783:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b15c095/0xdb7edb52b8334a62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997790:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b15c095/0xdb7edb52b8334a62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997805:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00000080:0.0:1788572302.997841:0:17011:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e637798000 x1875449639069312/t8589935930(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:718/0 lens 544/432 e 0 to 0 dl 1788572313 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572302.997868:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+159:3650:x1875449639069312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 153us (955us total) trans 8589935930 rc 0/0 00000100:00100000:0.0:1788572302.997874:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00010000:00010000:0.0:1788572302.997910:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572302.997915:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d3f6685/0xdb7edb52b8334a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997924:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1e600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572302.997928:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d3f6685/0xdb7edb52b8334a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997938:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d3f6685/0xdb7edb52b8334a5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997950:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d3f6685/0xdb7edb52b8334a5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997957:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d3f6685/0xdb7edb52b8334a5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997972:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572302.997976:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b15c095/0xdb7edb52b8334a62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997983:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1e400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572302.997986:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b15c095/0xdb7edb52b8334a62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.997993:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b15c095/0xdb7edb52b8334a62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.998028:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b15c095/0xdb7edb52b8334a62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.998036:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b15c095/0xdb7edb52b8334a62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.998050:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572302.998052:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572302.998054:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572302.998101:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6377c0700/2, rc 0, transno 4294968598 00000100:00100000:0.0:1788572302.998114:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639065088:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572302.998124:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639065600:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572302.998191:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639068160:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572302.998240:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572302.999389:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639069440:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572302.999431:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572302.999563:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae6bb80/2, rc 0, transno 8589935929 00000100:00100000:1.0:1788572302.999577:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639068800:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572302.999601:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae68000/2, rc 0, transno 8589935930 00000100:00100000:1.0:1788572302.999606:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639069312:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572302.999671:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572302.999683:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639069824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572302.999710:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572302.999804:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639068928 00000100:00100000:0.0:1788572302.999811:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639068928 00000100:00100000:0.0:1788572302.999852:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069440 00000100:00100000:0.0:1788572302.999855:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069440 00000100:00100000:0.0:1788572302.999876:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:0.0:1788572302.999884:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+159:3650:x1875449639068928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572302.999908:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2623 count 1 00002000:00010000:0.0:1788572302.999938:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572302.999946:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b892cd1/0xdb7edb52b8334a69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.999961:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3f:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572302.999965:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572302.999972:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b892cd1/0xdb7edb52b8334a69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.999986:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b892cd1/0xdb7edb52b8334a69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572302.999996:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b892cd1/0xdb7edb52b8334a69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000033:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b892cd1/0xdb7edb52b8334a69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000051:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00000080:0.0:1788572303.000149:0:8466:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e63779aa00 x1875449639068928/t8589935931(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:718/0 lens 544/432 e 0 to 0 dl 1788572313 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572303.000198:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+160:3650:x1875449639068928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 314us (3105us total) trans 8589935931 rc 0/0 00000100:00100000:0.0:1788572303.000205:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00100000:0.0:1788572303.000237:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:0.0:1788572303.000243:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+127:3650:x1875449639069440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.000255:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2594 count 1 00002000:00010000:0.0:1788572303.000270:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.000275:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11c3545/0xdb7edb52b8334a70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000284:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa22:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.000287:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.000291:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b11c3545/0xdb7edb52b8334a70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000302:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b11c3545/0xdb7edb52b8334a70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000309:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11c3545/0xdb7edb52b8334a70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000318:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b11c3545/0xdb7edb52b8334a70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000332:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572303.000342:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572303.000348:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b892cd1/0xdb7edb52b8334a69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000356:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1ee00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.000360:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b892cd1/0xdb7edb52b8334a69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000369:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b892cd1/0xdb7edb52b8334a69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000384:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b892cd1/0xdb7edb52b8334a69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000391:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b892cd1/0xdb7edb52b8334a69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000410:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572303.000414:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b11c3545/0xdb7edb52b8334a70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000426:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1e800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.000429:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11c3545/0xdb7edb52b8334a70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000436:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11c3545/0xdb7edb52b8334a70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000444:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b11c3545/0xdb7edb52b8334a70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000451:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b11c3545/0xdb7edb52b8334a70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.000461:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.000463:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.000464:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.000470:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572303.000543:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+128:3650:x1875449639069440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 300us (1112us total) trans 4294968599 rc 0/0 00000100:00100000:0.0:1788572303.000549:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000004:00080000:0.0:1788572303.000591:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae69500/2, rc 0, transno 8589935931 00000100:00100000:0.0:1788572303.000600:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639068928:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572303.000611:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637798e00/2, rc 0, transno 4294968599 00000100:00100000:0.0:1788572303.000618:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639069440:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.000667:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572303.000674:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639069952:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.000888:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069824 00000100:00100000:1.0:1788572303.000892:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069824 00000100:00100000:1.0:1788572303.000919:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:1.0:1788572303.000925:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+160:3651:x1875449639069824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572303.000937:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2628 count 1 00002000:00010000:1.0:1788572303.000955:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.000961:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334a77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.000970:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa44:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.000974:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.000978:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.000989:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001023:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001031:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001043:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572303.001050:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.001055:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001062:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.001066:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001074:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334a77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001085:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334a77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001092:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334a77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001106:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.001108:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.001110:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:1.0:1788572303.001169:0:43976:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e61e762a00 x1875449639069824/t8589935932(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:718/0 lens 544/432 e 0 to 0 dl 1788572313 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572303.001203:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+161:3651:x1875449639069824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 278us (1492us total) trans 8589935932 rc 0/0 00000100:00100000:1.0:1788572303.001209:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000004:00080000:1.0:1788572303.001231:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63779a300/2, rc 0, transno 8589935932 00000100:00100000:1.0:1788572303.001239:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639069824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572303.001267:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.001287:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069952 00000100:00100000:1.0:1788572303.001289:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069952 00000100:00100000:1.0:1788572303.001310:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:1.0:1788572303.001315:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+128:3650:x1875449639069952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.001326:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2596 count 1 00002000:00010000:1.0:1788572303.001340:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.001345:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334a7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001352:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa24:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.001355:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.001359:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001368:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001380:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001386:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001398:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572303.001457:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+129:3650:x1875449639069952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 142us (189us total) trans 4294968600 rc 0/0 00000100:00100000:1.0:1788572303.001463:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00010000:00010000:1.0:1788572303.001477:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.001482:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001488:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.001490:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001497:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334a7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001507:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334a7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001514:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334a7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001527:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.001529:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.001531:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572303.001549:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641694700/2, rc 0, transno 4294968600 00000100:00100000:1.0:1788572303.001559:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639069952:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.001592:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572303.001598:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639070336:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.001621:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.001641:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070336 00000100:00100000:1.0:1788572303.001644:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070336 00000100:00100000:1.0:1788572303.001664:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:1.0:1788572303.001669:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+129:3651:x1875449639070336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.001680:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2597 count 1 00002000:00010000:1.0:1788572303.001693:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.001698:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334a85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001707:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa25:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.001710:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.001715:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334a85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001725:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334a85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001738:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334a85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001746:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334a85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001759:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572303.001816:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+130:3651:x1875449639070336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 146us (194us total) trans 4294968601 rc 0/0 00000100:00100000:1.0:1788572303.001821:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00010000:00010000:1.0:1788572303.001835:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.001839:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334a85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001846:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.001849:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334a85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001856:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334a85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001866:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334a85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001873:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334a85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.001889:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.001891:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.001893:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572303.001913:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e760000/2, rc 0, transno 4294968601 00000100:00100000:1.0:1788572303.001922:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639070336:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.001954:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639070464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.001975:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.002030:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.002049:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e502d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639066112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.002069:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.002083:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639066624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572303.002100:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.002112:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639067136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572303.002128:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.002149:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070464 00000100:00100000:1.0:1788572303.002167:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070464 00000100:00100000:1.0:1788572303.002190:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639065600 00000100:00100000:1.0:1788572303.002193:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639065600 00000100:00100000:1.0:1788572303.002209:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639066112 00000100:00100000:1.0:1788572303.002211:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639066112 00000100:00100000:1.0:1788572303.002223:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639066624 00000100:00100000:1.0:1788572303.002226:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639066624 00000100:00100000:1.0:1788572303.002241:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639067136 00000100:00100000:1.0:1788572303.002244:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639067136 00000100:00100000:1.0:1788572303.002260:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:1.0:1788572303.002266:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+132:3651:x1875449639070464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.002280:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2598 count 1 00002000:00010000:1.0:1788572303.002298:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.002304:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334a8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.002313:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa26:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.002316:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.002320:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.002328:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.002335:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.002342:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334a8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.002353:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572303.002426:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+133:3651:x1875449639070464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 160us (449us total) trans 4294968602 rc 0/0 00000100:00100000:1.0:1788572303.002431:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00100000:1.0:1788572303.002445:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:1.0:1788572303.002451:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+132:3652:x1875449639065600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.002462:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2583 count 1 00002000:00010000:1.0:1788572303.002479:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.002484:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334a93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.002492:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa17:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.002495:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.002498:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.002506:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.002514:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.002522:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334a93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.002534:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572303.002802:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572303.002808:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334a8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002816:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.002819:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334a8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002826:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334a8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002838:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334a8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002846:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334a8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002862:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572303.002865:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334a93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002871:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.002874:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334a93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002881:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334a93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002890:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334a93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002897:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334a93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002909:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.002911:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.002913:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.002918:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572303.002930:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1788572303.002938:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+133:3652:x1875449639066112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.002950:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2587 count 1 00002000:00010000:0.0:1788572303.002964:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.002969:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003119a277/0xdb7edb52b8334a9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002977:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa1b:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.002979:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.002983:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003119a277/0xdb7edb52b8334a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.002991:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003119a277/0xdb7edb52b8334a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003062:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003119a277/0xdb7edb52b8334a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003071:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003119a277/0xdb7edb52b8334a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003086:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572303.003165:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+134:3652:x1875449639066112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 217us (1083us total) trans 4294968604 rc 0/0 00000100:00100000:0.0:1788572303.003171:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1788572303.003186:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:0.0:1788572303.003193:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+162:3652:x1875449639066624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572303.003206:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2611 count 1 00002000:00010000:0.0:1788572303.003223:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.003227:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094428cf1/0xdb7edb52b8334aa1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003235:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa33:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.003238:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.003241:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094428cf1/0xdb7edb52b8334aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003249:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094428cf1/0xdb7edb52b8334aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003261:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094428cf1/0xdb7edb52b8334aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003268:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094428cf1/0xdb7edb52b8334aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003282:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00000080:0.0:1788572303.003335:0:43974:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e50552c700 x1875449639066624/t8589935933(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572303.003365:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+163:3652:x1875449639066624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 173us (1263us total) trans 8589935933 rc 0/0 00000100:00100000:0.0:1788572303.003371:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000100:00100000:0.0:1788572303.003384:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:0.0:1788572303.003390:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+162:3652:x1875449639067136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572303.003428:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2615 count 1 00002000:00010000:0.0:1788572303.003443:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.003448:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e184ab8/0xdb7edb52b8334aa8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003456:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa37:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.003458:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.003462:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e184ab8/0xdb7edb52b8334aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003469:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e184ab8/0xdb7edb52b8334aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003478:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e184ab8/0xdb7edb52b8334aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003484:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e184ab8/0xdb7edb52b8334aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003498:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00000080:0.0:1788572303.003536:0:43974:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e61e570700 x1875449639067136/t8589935934(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572303.003564:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+163:3652:x1875449639067136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 174us (1434us total) trans 8589935934 rc 0/0 00000100:00100000:0.0:1788572303.003569:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00010000:00010000:0.0:1788572303.003588:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572303.003594:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003119a277/0xdb7edb52b8334a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003601:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1f600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.003605:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003119a277/0xdb7edb52b8334a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003612:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003119a277/0xdb7edb52b8334a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003625:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003119a277/0xdb7edb52b8334a9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003637:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003119a277/0xdb7edb52b8334a9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003656:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572303.003660:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094428cf1/0xdb7edb52b8334aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003667:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1f200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.003670:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094428cf1/0xdb7edb52b8334aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003677:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094428cf1/0xdb7edb52b8334aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003685:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094428cf1/0xdb7edb52b8334aa1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003693:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094428cf1/0xdb7edb52b8334aa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003705:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572303.003708:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e184ab8/0xdb7edb52b8334aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003714:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1ea00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.003718:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e184ab8/0xdb7edb52b8334aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003726:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e184ab8/0xdb7edb52b8334aa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003735:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e184ab8/0xdb7edb52b8334aa8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003743:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e184ab8/0xdb7edb52b8334aa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.003755:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.003757:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.003758:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.003764:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.003771:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572303.003847:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad5c000/2, rc 0, transno 8589935934 00000100:00100000:0.0:1788572303.003860:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639067136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572303.003870:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639067648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572303.003902:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.003927:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639067648 00000100:00100000:0.0:1788572303.003933:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639067648 00000100:00100000:0.0:1788572303.003962:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:0.0:1788572303.003969:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+163:3652:x1875449639067648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572303.003981:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2619 count 1 00002000:00010000:0.0:1788572303.003996:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.004001:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d595bd3/0xdb7edb52b8334aaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.004368:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3b:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.004372:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.004376:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d595bd3/0xdb7edb52b8334aaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.004386:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d595bd3/0xdb7edb52b8334aaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.004395:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d595bd3/0xdb7edb52b8334aaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.004403:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d595bd3/0xdb7edb52b8334aaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572303.004496:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+133:3652:x1875449639065600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 142us (561us total) trans 4294968603 rc 0/0 00000100:00100000:1.0:1788572303.004506:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000004:00080000:1.0:1788572303.004566:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e50552d880/2, rc 0, transno 4294968602 00000100:00100000:1.0:1788572303.004578:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639070464:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572303.004724:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00000080:0.0:1788572303.004794:0:43972:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e618432d80 x1875449639067648/t8589935935(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572303.004835:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+164:3652:x1875449639067648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 866us (931us total) trans 8589935935 rc 0/0 00000100:00100000:0.0:1788572303.004842:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000004:00080000:0.0:1788572303.004871:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae6ad80/2, rc 0, transno 8589935935 00000100:00100000:0.0:1788572303.004886:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639067648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572303.004897:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639068032:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.004922:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.004941:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639068544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.004959:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.004975:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639069056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572303.004993:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.005036:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639069568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.005057:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.005072:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639070080:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572303.005092:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.005115:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639068032 00000100:00100000:0.0:1788572303.005119:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639068032 00000100:00100000:0.0:1788572303.005145:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639068544 00000100:00100000:0.0:1788572303.005147:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639068544 00000100:00100000:0.0:1788572303.005174:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069056 00000100:00100000:0.0:1788572303.005177:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069056 00000100:00100000:0.0:1788572303.005191:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069568 00000100:00100000:0.0:1788572303.005193:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069568 00000100:00100000:0.0:1788572303.005211:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070080 00000100:00100000:0.0:1788572303.005214:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070080 00000100:00100000:0.0:1788572303.005229:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:0.0:1788572303.005235:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+135:3652:x1875449639068032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.005250:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2588 count 1 00002000:00010000:0.0:1788572303.005273:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.005278:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000316cf55b/0xdb7edb52b8334ab6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.005288:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa1c:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.005291:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.005295:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000316cf55b/0xdb7edb52b8334ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.005305:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000316cf55b/0xdb7edb52b8334ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.005313:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000316cf55b/0xdb7edb52b8334ab6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.005319:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000316cf55b/0xdb7edb52b8334ab6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572303.005419:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:3.0:1788572303.005429:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+135:3652:x1875449639068544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572303.005442:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2592 count 1 00002000:00010000:3.0:1788572303.005463:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572303.005468:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334abd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.005479:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa20:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:3.0:1788572303.005482:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572303.005486:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.005499:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.005507:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.005515:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572303.005586:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:1.0:1788572303.005601:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+165:3652:x1875449639069056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572303.005617:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2624 count 1 00002000:00010000:1.0:1788572303.005633:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.005639:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334ac4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.005647:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa40:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.005651:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.005655:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.005664:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.005672:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.005679:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006212:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572303.006221:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d595bd3/0xdb7edb52b8334aaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006231:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1e200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.006235:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d595bd3/0xdb7edb52b8334aaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006243:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d595bd3/0xdb7edb52b8334aaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006266:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d595bd3/0xdb7edb52b8334aaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006273:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d595bd3/0xdb7edb52b8334aaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006298:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572303.006301:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000316cf55b/0xdb7edb52b8334ab6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006307:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1fa00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.006310:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000316cf55b/0xdb7edb52b8334ab6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006316:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000316cf55b/0xdb7edb52b8334ab6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006326:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000316cf55b/0xdb7edb52b8334ab6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006332:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572303.006334:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334abd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006340:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.006343:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334abd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006351:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334abd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006359:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334abd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006366:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572303.006369:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006374:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.006377:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006383:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334ac4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006392:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334ac4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006400:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.006402:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.006404:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.006494:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572303.006501:0:43974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000316cf55b/0xdb7edb52b8334ab6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.006665:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572303.006759:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+136:3652:x1875449639068032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1522us (1835us total) trans 4294968605 rc 0/0 00000100:00100000:0.0:1788572303.006767:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00100000:0.0:1788572303.006791:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:0.0:1788572303.006799:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+135:3652:x1875449639069568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.006816:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2595 count 1 00002000:00010000:0.0:1788572303.006835:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.006840:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8d67e3a/0xdb7edb52b8334acb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.006854:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa23:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.006857:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.006862:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d67e3a/0xdb7edb52b8334acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.006872:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8d67e3a/0xdb7edb52b8334acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.006879:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8d67e3a/0xdb7edb52b8334acb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.006886:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d67e3a/0xdb7edb52b8334acb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.006908:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572303.006968:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+136:3652:x1875449639069568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 170us (1908us total) trans 4294968606 rc 0/0 00000100:00100000:0.0:1788572303.006974:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00100000:0.0:1788572303.006987:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:0.0:1788572303.006994:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+165:3652:x1875449639070080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572303.007030:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2629 count 1 00002000:00010000:0.0:1788572303.007048:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.007053:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334ad2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007065:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa45:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.007068:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.007073:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007082:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007090:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007097:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007113:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572303.007121:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572303.007126:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8d67e3a/0xdb7edb52b8334acb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007134:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e633e1f000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.007137:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8d67e3a/0xdb7edb52b8334acb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007146:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8d67e3a/0xdb7edb52b8334acb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007170:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8d67e3a/0xdb7edb52b8334acb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007178:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8d67e3a/0xdb7edb52b8334acb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007192:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572303.007196:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007202:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.007205:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007212:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007221:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334ad2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007228:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334ad2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007238:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.007240:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.007242:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:0.0:1788572303.007323:0:43974:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e637715500 x1875449639070080/t8589935936(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572303.007356:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+166:3652:x1875449639070080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 363us (2263us total) trans 8589935936 rc 0/0 00000100:00100000:0.0:1788572303.007362:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000100:00100000:0.0:1788572303.007399:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.007434:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639068160 00000100:00100000:0.0:1788572303.007442:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639068160 00000100:00100000:0.0:1788572303.007471:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:0.0:1788572303.007477:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+136:3653:x1875449639068160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.007489:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2589 count 1 00002000:00010000:0.0:1788572303.007505:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.007510:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334ad9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007518:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa1d:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.007521:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.007525:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007533:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007541:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007547:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.007560:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572303.007790:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572303.007796:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.007803:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.007806:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.007813:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.007823:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334ad9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.007829:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334ad9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.007845:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.007847:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.007848:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572303.007916:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+137:3653:x1875449639068160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 438us (515us total) trans 4294968607 rc 0/0 00000100:00100000:0.0:1788572303.007922:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00010000:00010000:0.0:1788572303.007937:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572303.007968:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63779bb80/2, rc 0, transno 4294968607 00000100:00100000:0.0:1788572303.008253:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639068160:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572303.014447:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572303.014464:0:43973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334abd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.014467:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572303.014478:0:43969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334ac4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:1.0:1788572303.014641:0:43969:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e61e634380 x1875449639069056/t8589935937(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572303.014717:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572303.014743:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+166:3652:x1875449639069056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9150us (9748us total) trans 8589935937 rc 0/0 00000100:00100000:1.0:1788572303.014753:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00010000:00010000:1.0:1788572303.014785:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572303.014805:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572303.014823:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639070848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.014862:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.014989:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639070976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572303.015046:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.015072:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070848 00000100:00100000:2.0:1788572303.015072:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070976 00000100:00100000:1.0:1788572303.015079:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070848 00000100:00100000:2.0:1788572303.015079:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070976 00000100:00100000:1.0:1788572303.015112:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:1.0:1788572303.015120:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+138:3651:x1875449639070848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.015144:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2600 count 1 00002000:00010000:1.0:1788572303.015184:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.015191:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334ae0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.015206:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa28:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.015211:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.015218:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334ae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.015232:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334ae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.015242:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334ae0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.015255:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334ae0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.015272:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572303.015352:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+139:3651:x1875449639070848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 232us (488us total) trans 4294968609 rc 0/0 00000100:00100000:1.0:1788572303.015359:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:1.0:1788572303.015373:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:1.0:1788572303.015380:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+166:3651:x1875449639070976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572303.015392:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2632 count 1 00002000:00010000:1.0:1788572303.015408:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.015413:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334ae7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.015421:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa48:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.015424:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.015428:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.015439:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.015447:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.015461:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334ae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.015476:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00000080:1.0:1788572303.015525:0:8663:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e506552d80 x1875449639070976/t8589935938(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572303.015555:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+167:3651:x1875449639070976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 175us (508us total) trans 8589935938 rc 0/0 00000100:00100000:1.0:1788572303.015561:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00100000:3.0:1788572303.016537:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+138:3652:x1875449639068544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11105us (11571us total) trans 4294968608 rc 0/0 00000100:00100000:3.0:1788572303.016547:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00010000:00010000:2.0:1788572303.018719:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572303.018733:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334ae0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.018748:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.018754:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334ae0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.018765:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334ae0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572303.019579:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641696a00/2, rc 0, transno 8589935936 00000100:00100000:0.0:1788572303.019607:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639070080:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572303.019621:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639070592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.019697:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572303.019729:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618430700/2, rc 0, transno 4294968603 00000100:00100000:0.0:1788572303.019741:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639065600:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.019797:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639068672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.019819:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.019844:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070592 00000100:00100000:0.0:1788572303.019850:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070592 00000100:00100000:0.0:1788572303.019901:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639068672 00000100:00100000:0.0:1788572303.019904:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639068672 00000100:00100000:0.0:1788572303.019921:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:0.0:1788572303.019939:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+139:3652:x1875449639070592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.019964:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2599 count 1 00002000:00010000:0.0:1788572303.019992:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.019999:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334aee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020043:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa27:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.020047:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.020054:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020067:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020078:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334aee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020087:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020102:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572303.020230:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+140:3652:x1875449639070592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 300us (533us total) trans 4294968610 rc 0/0 00000100:00100000:0.0:1788572303.020237:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00100000:0.0:1788572303.020253:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:0.0:1788572303.020258:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+139:3653:x1875449639068672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.020288:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2593 count 1 00002000:00010000:0.0:1788572303.020302:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.020307:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334af5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020321:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa21:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.020324:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.020328:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334af5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020338:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334af5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020346:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334af5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020354:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334af5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020367:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788572303.020417:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+140:3653:x1875449639068672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 159us (597us total) trans 4294968611 rc 0/0 00000100:00100000:0.0:1788572303.020423:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00010000:00010000:0.0:1788572303.020441:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572303.020447:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334ae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020456:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.020460:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334ae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020476:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334ae7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020490:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334ae7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020864:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334ae7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020944:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572303.020949:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020956:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.020960:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334aee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020968:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334aee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020978:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334aee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.020985:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334aee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.021143:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572303.021148:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334af5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.021164:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.021168:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334af5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.021177:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334af5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.021188:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334af5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.021196:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334af5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.021208:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.021210:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.021212:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.021219:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572303.021251:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e502d5f100/2, rc 0, transno 4294968604 00000100:00100000:0.0:1788572303.021264:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e502d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639066112:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572303.021309:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad5e680/2, rc 0, transno 8589935933 00000100:00100000:0.0:1788572303.021314:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639066624:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572303.021330:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639071104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.021375:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.021400:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639071104 00000100:00100000:0.0:1788572303.021405:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639071104 00000100:00100000:0.0:1788572303.021431:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:0.0:1788572303.021438:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+140:3652:x1875449639071104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.021455:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2601 count 1 00002000:00010000:0.0:1788572303.021471:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.021477:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334afc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.021487:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa29:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.021491:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.021497:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.021507:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.021516:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334afc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.021524:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.021537:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572303.021623:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+141:3652:x1875449639071104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 185us (247us total) trans 4294968612 rc 0/0 00000100:00100000:0.0:1788572303.021630:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00010000:00010000:1.0:1788572303.022061:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.022068:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.022077:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.022081:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334afc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.022091:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334afc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.022104:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334afc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.022111:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334afc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.022132:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.022133:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.022135:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572303.022316:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637798700/2, rc 0, transno 4294968611 00000100:00100000:0.0:1788572303.022327:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639068672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.022424:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639069184:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572303.022523:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.022549:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069184 00000100:00100000:0.0:1788572303.022553:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069184 00000100:00100000:0.0:1788572303.022586:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:0.0:1788572303.022594:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+167:3653:x1875449639069184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572303.022613:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2625 count 1 00002000:00010000:0.0:1788572303.022636:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.022642:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334b03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.022776:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa41:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.022779:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.022785:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.022799:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.022808:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.022821:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.022837:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572303.022847:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572303.022850:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.022855:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.022858:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.022865:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334b03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.022877:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334b03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.022884:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334b03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.022911:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.022913:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.022914:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:0.0:1788572303.023234:0:43964:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e63ae3ed80 x1875449639069184/t8589935939(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572303.023278:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+168:3653:x1875449639069184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 685us (754us total) trans 8589935939 rc 0/0 00000100:00100000:0.0:1788572303.023284:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000004:00080000:0.0:1788572303.023326:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3d180/2, rc 0, transno 4294968612 00000100:00100000:0.0:1788572303.023424:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639071104:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572303.023550:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637799180/2, rc 0, transno 4294968605 00000100:00100000:0.0:1788572303.023558:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639068032:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572303.023586:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637798380/2, rc 0, transno 4294968608 00000100:00100000:0.0:1788572303.023593:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639068544:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572303.023622:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae68700/2, rc 0, transno 8589935939 00000100:00100000:0.0:1788572303.023630:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639069184:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572303.024224:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639069696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572303.024275:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.024310:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069696 00000100:00100000:0.0:1788572303.024315:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069696 00000100:00100000:0.0:1788572303.024359:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:0.0:1788572303.024368:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+168:3653:x1875449639069696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572303.024392:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2627 count 1 00002000:00010000:0.0:1788572303.024418:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.024425:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334b0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.024809:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa43:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.024816:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.024824:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334b0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.024838:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334b0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.024848:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334b0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.024855:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334b0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.024873:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572303.025373:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334ae0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.025384:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334ae0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.025408:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572303.025412:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334b0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.025418:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.025421:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334b0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.025429:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334b0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.025443:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334b0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.025450:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334b0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.025464:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.025466:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.025468:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.025544:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572303.025566:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639071488:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.025625:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.025652:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639072000:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.025678:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572303.025715:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e506552680/2, rc 0, transno 8589935938 00000100:00100000:2.0:1788572303.025724:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639070976:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572303.025737:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57fb80/2, rc 0, transno 4294968609 00000100:00100000:2.0:1788572303.025749:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639070848:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.025761:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788572303.025767:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639071360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.025789:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.025804:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639071872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.025842:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.025873:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639071488 00000100:00100000:2.0:1788572303.025878:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639071488 00000100:00100000:2.0:1788572303.025916:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639072000 00000100:00100000:2.0:1788572303.025919:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639072000 00000100:00100000:2.0:1788572303.025936:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639071360 00000100:00100000:2.0:1788572303.025939:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639071360 00000100:00100000:2.0:1788572303.025952:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639071872 00000100:00100000:2.0:1788572303.025954:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639071872 00000100:00100000:2.0:1788572303.025972:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:2.0:1788572303.025979:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+170:3651:x1875449639071488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572303.026028:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2634 count 1 00002000:00010000:2.0:1788572303.026052:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.026059:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026069:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4a:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.026072:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.026077:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026087:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026096:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026105:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026119:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00000080:2.0:1788572303.026338:0:43968:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e61e57df80 x1875449639071488/t8589935940(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572303.026380:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+171:3651:x1875449639071488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 401us (755us total) trans 8589935940 rc 0/0 00000100:00100000:2.0:1788572303.026387:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00000100:00100000:2.0:1788572303.026406:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:2.0:1788572303.026413:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+142:3651:x1875449639072000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572303.026426:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2606 count 1 00002000:00010000:2.0:1788572303.026442:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.026447:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026456:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2e:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.026459:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.026463:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026472:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026478:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026485:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026498:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572303.026576:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+143:3651:x1875449639072000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 163us (897us total) trans 4294968613 rc 0/0 00000100:00100000:2.0:1788572303.026582:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00000100:00100000:2.0:1788572303.026595:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:2.0:1788572303.026600:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+170:3651:x1875449639071360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572303.026612:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2633 count 1 00002000:00010000:2.0:1788572303.026625:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.026631:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a1f53ed/0xdb7edb52b8334b1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026638:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa49:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.026641:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.026645:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a1f53ed/0xdb7edb52b8334b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026653:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a1f53ed/0xdb7edb52b8334b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026660:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a1f53ed/0xdb7edb52b8334b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026667:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a1f53ed/0xdb7edb52b8334b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026679:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788572303.026689:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572303.026693:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026701:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.026704:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026717:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026730:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026738:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026755:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572303.026758:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026765:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.026768:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026775:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026784:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.026790:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1788572303.026885:0:43966:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e63ae3dc00 x1875449639069696/t8589935941(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572303.027141:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+171:3653:x1875449639069696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2773us (2865us total) trans 8589935941 rc 0/0 00000100:00100000:0.0:1788572303.027149:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00100000:0.0:1788572303.027256:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:0.0:1788572303.027263:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+142:3651:x1875449639071872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.027276:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2605 count 1 00002000:00010000:0.0:1788572303.027294:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.027304:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ebe61fa/0xdb7edb52b8334b26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.027312:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2d:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.027316:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.027320:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ebe61fa/0xdb7edb52b8334b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.027330:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ebe61fa/0xdb7edb52b8334b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.027339:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ebe61fa/0xdb7edb52b8334b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.027347:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ebe61fa/0xdb7edb52b8334b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.027366:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572303.027433:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+143:3651:x1875449639071872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 171us (1590us total) trans 4294968614 rc 0/0 00010000:00010000:1.0:1788572303.027797:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572303.027804:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a1f53ed/0xdb7edb52b8334b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.027812:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.027816:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a1f53ed/0xdb7edb52b8334b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.027824:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a1f53ed/0xdb7edb52b8334b1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.027838:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a1f53ed/0xdb7edb52b8334b1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.027846:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a1f53ed/0xdb7edb52b8334b1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.027863:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.027866:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ebe61fa/0xdb7edb52b8334b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.027873:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.027876:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ebe61fa/0xdb7edb52b8334b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.027884:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ebe61fa/0xdb7edb52b8334b26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.027893:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ebe61fa/0xdb7edb52b8334b26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.027900:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ebe61fa/0xdb7edb52b8334b26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.027915:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.027917:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.027918:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.028074:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.028076:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.028078:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572303.028111:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3ea00/2, rc 0, transno 4294968614 00000100:00100000:2.0:1788572303.028118:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639071872:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572303.028131:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634b28380/2, rc 0, transno 8589935940 00000100:00100000:2.0:1788572303.028144:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639071488:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572303.028165:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3fb80/2, rc 0, transno 4294968613 00000100:00100000:2.0:1788572303.028169:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639072000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.028317:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572303.028329:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639072384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572303.028364:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:2.0:1788572303.028463:0:43968:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e61e57e300 x1875449639071360/t8589935942(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572303.028537:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+171:3651:x1875449639071360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1936us (2746us total) trans 8589935942 rc 0/0 00000100:00100000:2.0:1788572303.028545:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000100:00100000:2.0:1788572303.028563:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639072384 00000100:00100000:2.0:1788572303.028568:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639072384 00000100:00100000:2.0:1788572303.028603:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:2.0:1788572303.028609:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+171:3651:x1875449639072384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572303.028625:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2637 count 1 00002000:00010000:2.0:1788572303.028643:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.028649:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334b2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.028659:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4d:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.028663:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.028669:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.028681:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.028689:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.028698:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.028714:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00000080:2.0:1788572303.028757:0:43968:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e501ff1500 x1875449639072384/t8589935943(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572303.028783:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+172:3651:x1875449639072384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 174us (418us total) trans 8589935943 rc 0/0 00000100:00100000:2.0:1788572303.028789:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:0.0:1788572303.031556:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00010000:00010000:0.0:1788572303.031600:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572303.031609:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.031623:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.031628:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.031640:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334b2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.031678:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334b2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.031686:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334b2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.031707:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.031709:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.031711:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.031723:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.031728:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572303.031861:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae6a680/2, rc 0, transno 8589935937 00000100:00100000:0.0:1788572303.031877:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639069056:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572303.031891:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6377c2a00/2, rc 0, transno 4294968606 00000100:00100000:0.0:1788572303.031899:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639069568:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572303.032045:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e506553b80/2, rc 0, transno 4294968610 00000100:00100000:0.0:1788572303.032054:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639070592:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572303.032124:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641104700/2, rc 0, transno 8589935942 00000100:00100000:1.0:1788572303.032130:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639071360:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572303.032148:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572303.040509:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639072896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.040608:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.040657:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572303.040667:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639073024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.040691:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572303.041780:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637799880/2, rc 0, transno 8589935941 00000100:00100000:2.0:1788572303.041801:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639069696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.041813:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639070208:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.041851:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.041877:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639070720:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.041912:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.041937:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639071232:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.041958:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.041975:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639071744:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.041991:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.042031:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639072896 00000100:00100000:2.0:1788572303.042038:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639072896 00000100:00100000:2.0:1788572303.042082:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073024 00000100:00100000:2.0:1788572303.042085:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073024 00000100:00100000:2.0:1788572303.042101:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070208 00000100:00100000:2.0:1788572303.042103:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070208 00000100:00100000:2.0:1788572303.042117:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070720 00000100:00100000:2.0:1788572303.042119:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070720 00000100:00100000:2.0:1788572303.042132:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639071232 00000100:00100000:2.0:1788572303.042134:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639071232 00000100:00100000:2.0:1788572303.042147:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639071744 00000100:00100000:2.0:1788572303.042150:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639071744 00000100:00100000:2.0:1788572303.042181:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1788572303.042190:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+145:3650:x1875449639072896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572303.042342:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2610 count 1 00000100:00100000:3.0:1788572303.042443:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1788572303.042453:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+174:3650:x1875449639073024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572303.042466:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2638 count 1 00002000:00010000:3.0:1788572303.042491:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572303.042499:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334b34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042514:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4e:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:3.0:1788572303.042519:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572303.042526:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042540:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042550:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042557:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042575:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572303.042588:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572303.042594:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042602:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572303.042606:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042615:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334b34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042631:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334b34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042645:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334b34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042665:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572303.042666:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572303.042668:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:3.0:1788572303.042774:0:43968:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e61e57dc00 x1875449639073024/t8589935944(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572303.042825:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+175:3650:x1875449639073024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 374us (2132us total) trans 8589935944 rc 0/0 00000100:00100000:3.0:1788572303.042832:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00100000:3.0:1788572303.042851:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:3.0:1788572303.042857:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+174:3653:x1875449639070208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572303.042869:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2630 count 1 00002000:00010000:3.0:1788572303.042883:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572303.042887:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334b3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042902:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa46:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:3.0:1788572303.042905:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572303.042908:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042917:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042930:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.042937:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572303.042959:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:0.0:1788572303.042970:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+174:3653:x1875449639070720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572303.042983:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2631 count 1 00002000:00010000:0.0:1788572303.042999:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1788572303.043045:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639072512:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1788572303.043056:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.043061:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334b49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.043069:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa32:0x0].0x0 since=4220s v=(0 0) 00000100:00100000:1.0:1788572303.043073:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00010000:00010000:2.0:1788572303.043073:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.043077:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572303.043083:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50329df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+145:3653:x1875449639071232:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572303.043086:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572303.043093:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2602 count 1 00010000:00010000:2.0:1788572303.043094:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.043101:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572303.043107:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.043112:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334b50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.043120:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2a:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.043123:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.043127:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.043137:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.043145:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.043149:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572303.043161:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.043200:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334b42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1788572303.043212:0:43968:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e61e57d500 x1875449639070208/t8589935945(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572303.043214:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa47:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.043218:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.043222:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.043231:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.043239:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572303.043242:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+175:3653:x1875449639070208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 386us (1392us total) trans 8589935945 rc 0/0 00010000:00010000:0.0:1788572303.043247:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334b42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572303.043248:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00100000:3.0:1788572303.043261:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:3.0:1788572303.043272:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+145:3653:x1875449639071744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572303.043283:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2604 count 1 00002000:00010000:3.0:1788572303.043300:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572303.043308:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334b57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.043315:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2c:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:3.0:1788572303.043318:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572303.043322:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.043334:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.043342:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.043352:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334b57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.045601:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1788572303.045817:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+146:3650:x1875449639072896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3623us (5204us total) trans 4294968615 rc 0/0 00000100:00100000:2.0:1788572303.045828:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1788572303.046347:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639072256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.046396:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.046429:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639072256 00000100:00100000:2.0:1788572303.046437:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639072256 00000100:00100000:2.0:1788572303.046478:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:2.0:1788572303.046487:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+175:3653:x1875449639072256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572303.046516:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2636 count 1 00002000:00010000:2.0:1788572303.046549:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.046556:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000477478ed/0xdb7edb52b8334b5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.046577:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4c:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.046581:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.046586:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000477478ed/0xdb7edb52b8334b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.046599:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000477478ed/0xdb7edb52b8334b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.046608:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000477478ed/0xdb7edb52b8334b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.046616:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000477478ed/0xdb7edb52b8334b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.046634:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00000080:2.0:1788572303.046701:0:43973:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e6131cd880 x1875449639072256/t8589935946(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572303.046733:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+176:3653:x1875449639072256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 247us (336us total) trans 8589935946 rc 0/0 00000100:00100000:2.0:1788572303.046740:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000004:00080000:2.0:1788572303.046778:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff3800/2, rc 0, transno 8589935946 00000100:00100000:2.0:1788572303.046785:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639072256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.046792:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639072768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.046815:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.046841:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639073280:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.046858:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572303.046877:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e761880/2, rc 0, transno 8589935945 00000100:00100000:2.0:1788572303.046881:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639070208:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572303.047782:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1788572303.047961:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50329df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+146:3653:x1875449639071232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4878us (5999us total) trans 4294968616 rc 0/0 00000100:00100000:1.0:1788572303.047970:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00100000:1.0:1788572303.047989:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639072768 00000100:00100000:1.0:1788572303.047995:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639072768 00000100:00100000:1.0:1788572303.048055:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073280 00000100:00100000:1.0:1788572303.048058:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073280 00000100:00100000:1.0:1788572303.048078:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:1.0:1788572303.048084:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+147:3653:x1875449639072768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.048106:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2609 count 1 00002000:00010000:1.0:1788572303.048128:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.048135:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334b65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.048147:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa31:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.048163:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.048169:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.048181:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.048191:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.048199:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.048220:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1788572303.048283:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+148:3653:x1875449639072768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 199us (1466us total) trans 4294968617 rc 0/0 00000100:00100000:1.0:1788572303.048290:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:1.0:1788572303.048303:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:1.0:1788572303.048309:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+147:3653:x1875449639073280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.048320:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2611 count 1 00002000:00010000:1.0:1788572303.048333:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.048338:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334b6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.048346:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa33:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.048349:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.048353:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334b6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.048361:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334b6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.048369:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334b6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.048377:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334b6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.048385:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:1.0:1788572303.049273:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+148:3653:x1875449639073280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 128us (1578us total) trans 4294968618 rc 0/0 00000100:00100000:1.0:1788572303.049284:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00010000:00010000:1.0:1788572303.049309:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788572303.049317:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049327:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.049332:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049346:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334b3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049363:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334b3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049371:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334b3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049391:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788572303.049395:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049402:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.049404:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049411:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334b49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049420:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334b49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049426:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334b49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049518:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788572303.049523:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049529:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.049532:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049539:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334b50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049548:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334b50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049556:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334b50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049568:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788572303.049572:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334b42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049578:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.049581:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334b42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049731:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334b42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049745:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334b42 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049754:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788572303.049758:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334b57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049763:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.049766:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334b57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049772:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334b57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049779:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334b57 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049786:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572303.049789:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000477478ed/0xdb7edb52b8334b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049794:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.049797:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000477478ed/0xdb7edb52b8334b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049804:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000477478ed/0xdb7edb52b8334b5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049812:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000477478ed/0xdb7edb52b8334b5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049819:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000477478ed/0xdb7edb52b8334b5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049831:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572303.049834:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049840:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.049844:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049851:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334b65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049859:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334b65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049867:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334b65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049880:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.049883:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334b6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049889:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.049892:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334b6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049899:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334b6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049909:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334b6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049915:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334b6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.049934:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.049937:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.049940:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572303.050133:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572303.050208:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff2680/2, rc 0, transno 8589935943 00000100:00100000:1.0:1788572303.050221:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639072384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572303.050238:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639073536:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572303.050263:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.050264:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639072512 00000100:00100000:2.0:1788572303.050270:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639072512 00000100:00100000:1.0:1788572303.050282:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073536 00000100:00100000:1.0:1788572303.050285:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073536 00000100:00100000:2.0:1788572303.050307:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:1.0:1788572303.050311:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:2.0:1788572303.050314:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+148:3651:x1875449639072512:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.050316:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+176:3651:x1875449639073536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572303.050335:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2641 count 1 00002000:00080000:2.0:1788572303.050335:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2607 count 1 00002000:00010000:1.0:1788572303.050358:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1788572303.050358:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.050365:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334b73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.050365:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.050377:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa51:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.050378:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2f:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.050382:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.050382:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.050388:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334b73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.050388:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.050402:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334b73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.050402:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.050412:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334b73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.050412:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.050421:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334b73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.050421:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.050435:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572303.050435:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572303.050551:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+149:3651:x1875449639072512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 237us (419us total) trans 4294968619 rc 0/0 00000100:00100000:2.0:1788572303.050558:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00100000:2.0:1788572303.051167:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639073408:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.051280:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572303.051313:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff2d80/2, rc 0, transno 8589935944 00000100:00100000:2.0:1788572303.051318:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639073024:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572303.051328:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3dc00/2, rc 0, transno 4294968615 00000100:00100000:2.0:1788572303.051337:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639072896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.051389:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073408 00000100:00100000:2.0:1788572303.051393:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073408 00000100:00100000:2.0:1788572303.051418:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:2.0:1788572303.051423:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+177:3650:x1875449639073408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572303.051440:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2640 count 1 00002000:00010000:2.0:1788572303.051461:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.051468:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.051479:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa50:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.051482:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.051487:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.051503:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.051513:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.051519:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.051530:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00000080:2.0:1788572303.051767:0:43975:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e62dac7100 x1875449639073408/t8589935947(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572303.051808:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+178:3650:x1875449639073408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 384us (527us total) trans 8589935947 rc 0/0 00000100:00100000:2.0:1788572303.051815:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000004:00080000:2.0:1788572303.051841:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff0000/2, rc 0, transno 8589935947 00000100:00100000:2.0:1788572303.051846:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639073408:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572303.051960:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788572303.051966:0:17011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334b42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.051997:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572303.052019:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334b73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052027:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.052032:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334b73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052047:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334b73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052063:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334b73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052071:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b8334b73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052085:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572303.052089:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052095:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.052098:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052106:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052116:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052122:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d81636/0xdb7edb52b8334b7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052139:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572303.052140:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572303.052142:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.052146:0:43968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334b57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052149:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.052162:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052169:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052179:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.052185:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334b81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.052187:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.052196:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.052198:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.052200:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.052207:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572303.052498:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+149:3653:x1875449639071744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9226us (10504us total) trans 4294968620 rc 0/0 00000100:00100000:3.0:1788572303.052505:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00010000:00000080:1.0:1788572303.054025:0:43969:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e5032b6680 x1875449639073536/t8589935948(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572303.054091:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+178:3651:x1875449639073536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3774us (3827us total) trans 8589935948 rc 0/0 00000100:00100000:1.0:1788572303.054100:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00010000:00010000:2.0:1788572303.059513:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572303.059584:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639071616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.059674:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.059726:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639072128:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.059748:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.059764:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639072640:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.059788:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.059805:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639073152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.059823:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.059851:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639071616 00000100:00100000:2.0:1788572303.059859:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639071616 00010000:00010000:1.0:1788572303.060374:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.060433:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:0.0:1788572303.060598:0:17011:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e61e57df80 x1875449639070720/t8589935949(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572303.060610:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639072128 00000100:00100000:2.0:1788572303.060614:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639072128 00000100:00100000:0.0:1788572303.060772:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+179:3653:x1875449639070720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17805us (18858us total) trans 8589935949 rc 0/0 00000100:00100000:0.0:1788572303.060781:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00100000:0.0:1788572303.060799:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639072640 00000100:00100000:0.0:1788572303.060802:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639072640 00000100:00100000:1.0:1788572303.060839:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073152 00000100:00100000:1.0:1788572303.060843:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073152 00000100:00100000:1.0:1788572303.060870:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:1.0:1788572303.060879:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+150:3652:x1875449639071616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.060912:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2603 count 1 00002000:00010000:1.0:1788572303.060951:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.060959:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023acf97a/0xdb7edb52b8334b88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.060975:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2b:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.060979:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.060985:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023acf97a/0xdb7edb52b8334b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.060999:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023acf97a/0xdb7edb52b8334b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061030:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023acf97a/0xdb7edb52b8334b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061038:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023acf97a/0xdb7edb52b8334b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061058:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572303.061111:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:2.0:1788572303.061118:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+179:3652:x1875449639072128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572303.061130:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2635 count 1 00000100:00100000:1.0:1788572303.061144:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+151:3652:x1875449639071616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 266us (1470us total) trans 4294968621 rc 0/0 00002000:00010000:2.0:1788572303.061149:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1788572303.061150:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00010000:00010000:2.0:1788572303.061164:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334b8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572303.061173:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00010000:00010000:2.0:1788572303.061173:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4b:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.061176:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4b:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1788572303.061179:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+150:3652:x1875449639072640:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572303.061181:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572303.061190:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2608 count 1 00010000:00010000:2.0:1788572303.061191:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572303.061204:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.061209:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000615dffbd/0xdb7edb52b8334b96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061216:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa30:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.061219:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.061223:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000615dffbd/0xdb7edb52b8334b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061231:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000615dffbd/0xdb7edb52b8334b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061238:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000615dffbd/0xdb7edb52b8334b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061246:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000615dffbd/0xdb7edb52b8334b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061260:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572303.061268:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061275:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061293:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572303.061317:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+151:3652:x1875449639072640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 138us (1528us total) trans 4294968622 rc 0/0 00000100:00100000:1.0:1788572303.061327:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00010000:00000080:2.0:1788572303.061336:0:43973:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e62dac5180 x1875449639072128/t8589935950(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572303.061339:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:1.0:1788572303.061345:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+180:3652:x1875449639073152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572303.061355:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2639 count 1 00000100:00100000:2.0:1788572303.061365:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+180:3652:x1875449639072128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 249us (1617us total) trans 8589935950 rc 0/0 00002000:00010000:1.0:1788572303.061370:0:12091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1788572303.061371:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00010000:00010000:1.0:1788572303.061374:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334b9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061382:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4f:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.061385:0:12091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.061389:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061391:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572303.061396:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023acf97a/0xdb7edb52b8334b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061398:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061404:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.061406:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061408:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023acf97a/0xdb7edb52b8334b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061414:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061418:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023acf97a/0xdb7edb52b8334b88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061425:0:12091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788572303.061434:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023acf97a/0xdb7edb52b8334b88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061443:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023acf97a/0xdb7edb52b8334b88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061463:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572303.061467:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000615dffbd/0xdb7edb52b8334b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061474:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00000080:1.0:1788572303.061475:0:12091:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e6412b0380 x1875449639073152/t8589935951(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788572303.061477:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000615dffbd/0xdb7edb52b8334b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061485:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000615dffbd/0xdb7edb52b8334b96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061495:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000615dffbd/0xdb7edb52b8334b96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572303.061503:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+180:3652:x1875449639073152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 159us (1680us total) trans 8589935951 rc 0/0 00010000:00010000:2.0:1788572303.061503:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000615dffbd/0xdb7edb52b8334b96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572303.061509:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00010000:00010000:2.0:1788572303.061515:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572303.061518:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061524:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.061527:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572303.061528:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061531:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061535:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334b8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061539:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.061542:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061545:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334b8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061550:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334b9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061553:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334b8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.061560:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334b9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061564:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.061566:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e68e5a/0xdb7edb52b8334b9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.061566:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.061567:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.061578:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.061579:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.061580:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572303.061602:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff1c00/2, rc 0, transno 8589935951 00000100:00100000:2.0:1788572303.061608:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639073152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.061625:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639073664:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572303.061631:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff3100/2, rc 0, transno 8589935948 00000100:00100000:1.0:1788572303.061639:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639073536:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.061656:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572303.061689:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3f100/2, rc 0, transno 4294968621 00000100:00100000:2.0:1788572303.061700:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639071616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.061755:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639073920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.061777:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572303.061817:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff2a00/2, rc 0, transno 8589935950 00000100:00100000:2.0:1788572303.061822:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639072128:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572303.061830:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3ce00/2, rc 0, transno 4294968622 00000100:00100000:2.0:1788572303.061836:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639072640:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.061864:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572303.061870:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639074048:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.061890:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.062357:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073664 00000100:00100000:2.0:1788572303.062363:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073664 00000100:00100000:2.0:1788572303.062400:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073920 00000100:00100000:2.0:1788572303.062403:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073920 00000004:00080000:1.0:1788572303.062418:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3f480/2, rc 0, transno 4294968619 00000100:00100000:2.0:1788572303.062418:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639074048 00000100:00100000:2.0:1788572303.062421:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639074048 00000100:00100000:1.0:1788572303.062430:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639072512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.062435:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:2.0:1788572303.062442:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+180:3652:x1875449639073664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572303.062460:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2642 count 1 00002000:00010000:2.0:1788572303.062482:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.062489:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff386779/0xdb7edb52b8334ba4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.062500:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa52:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.062504:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa52:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1788572303.062508:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00010000:00010000:2.0:1788572303.062510:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff386779/0xdb7edb52b8334ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572303.062517:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+152:3650:x1875449639073920:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572303.062521:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff386779/0xdb7edb52b8334ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572303.062529:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2613 count 1 00010000:00010000:2.0:1788572303.062530:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff386779/0xdb7edb52b8334ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.062537:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff386779/0xdb7edb52b8334ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572303.062543:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.062548:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334bab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.062552:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572303.062556:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa35:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.062559:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.062562:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334bab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062571:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334bab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062578:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334bab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062584:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334bab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062596:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00000080:2.0:1788572303.062613:0:43966:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e6412b3480 x1875449639073664/t8589935952(0) o6->lustre-MDT0000-mdtlov_UUID@0@lo:719/0 lens 544/432 e 0 to 0 dl 1788572314 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572303.062651:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+181:3652:x1875449639073664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 209us (993us total) trans 8589935952 rc 0/0 00000100:00100000:2.0:1788572303.062657:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:2.0:1788572303.062670:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:2.0:1788572303.062677:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+153:3650:x1875449639074048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572303.062687:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2614 count 1 00002000:00010000:2.0:1788572303.062700:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.062705:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002576824d/0xdb7edb52b8334bb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.062713:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa36:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.062715:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.062719:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002576824d/0xdb7edb52b8334bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572303.062723:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+153:3650:x1875449639073920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 208us (944us total) trans 4294968623 rc 0/0 00000100:00100000:1.0:1788572303.062729:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00010000:00010000:2.0:1788572303.062729:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002576824d/0xdb7edb52b8334bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.062737:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002576824d/0xdb7edb52b8334bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062744:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572303.062744:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002576824d/0xdb7edb52b8334bb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062749:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff386779/0xdb7edb52b8334ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.062756:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572303.062762:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.062766:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff386779/0xdb7edb52b8334ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062774:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff386779/0xdb7edb52b8334ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062787:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff386779/0xdb7edb52b8334ba4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062795:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff386779/0xdb7edb52b8334ba4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572303.062807:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+153:3650:x1875449639074048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 131us (916us total) trans 4294968624 rc 0/0 00010000:00010000:1.0:1788572303.062810:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788572303.062813:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00010000:00010000:1.0:1788572303.062814:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334bab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062820:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.062823:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334bab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062831:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334bab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062840:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334bab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572303.062844:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b7100/2, rc 0, transno 8589935952 00010000:00010000:1.0:1788572303.062848:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8334bab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572303.062849:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639073664:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572303.062856:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788572303.062863:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788572303.062863:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639073792:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788572303.062866:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002576824d/0xdb7edb52b8334bb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062872:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.062875:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002576824d/0xdb7edb52b8334bb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062882:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002576824d/0xdb7edb52b8334bb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572303.062886:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572303.062892:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002576824d/0xdb7edb52b8334bb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062900:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002576824d/0xdb7edb52b8334bb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.062912:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572303.062912:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073792 00010000:00010000:1.0:1788572303.062913:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.062915:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572303.062915:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073792 00000100:00100000:2.0:1788572303.062948:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:2.0:1788572303.062954:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+153:3652:x1875449639073792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572303.062988:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2612 count 1 00002000:00010000:2.0:1788572303.063019:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.063024:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8049cd/0xdb7edb52b8334bb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572303.063029:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778f480/2, rc 0, transno 4294968624 00010000:00010000:2.0:1788572303.063033:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa34:0x0].0x0 since=4220s v=(0 0) 00000100:00100000:1.0:1788572303.063037:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639074048:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572303.063037:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.063041:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8049cd/0xdb7edb52b8334bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572303.063046:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778ce00/2, rc 0, transno 4294968623 00000100:00100000:1.0:1788572303.063049:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639073920:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572303.063051:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8049cd/0xdb7edb52b8334bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.063058:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8049cd/0xdb7edb52b8334bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.063071:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8049cd/0xdb7edb52b8334bb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.063084:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572303.063086:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639074432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.063110:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.063138:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639074432 00000100:00100000:2.0:1788572303.063138:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+154:3652:x1875449639073792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 184us (251us total) trans 4294968625 rc 0/0 00000100:00100000:1.0:1788572303.063141:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639074432 00000100:00100000:2.0:1788572303.063144:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00010000:00010000:2.0:1788572303.063169:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572303.063173:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb8049cd/0xdb7edb52b8334bb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572303.063175:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00010000:00010000:2.0:1788572303.063181:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701200 already unused, calling callback (ffffffffc0be44f0) 00000100:00100000:1.0:1788572303.063182:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+154:3650:x1875449639074432:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572303.063184:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8049cd/0xdb7edb52b8334bb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572303.063192:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2617 count 1 00010000:00010000:2.0:1788572303.063192:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8049cd/0xdb7edb52b8334bb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572303.063206:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.063211:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334bc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.063214:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb8049cd/0xdb7edb52b8334bb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.063220:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa39:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.063222:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb8049cd/0xdb7edb52b8334bb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.063223:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.063228:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.063235:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.063237:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.063237:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.063239:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.063245:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.063252:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572303.063258:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac7800/2, rc 0, transno 4294968625 00000100:00100000:2.0:1788572303.063266:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639073792:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788572303.063267:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572303.063295:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572303.063299:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.063306:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.063309:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.063317:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334bc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.063327:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334bc0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572303.063333:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+155:3650:x1875449639074432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 152us (222us total) trans 4294968626 rc 0/0 00010000:00010000:2.0:1788572303.063335:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003266f0c7/0xdb7edb52b8334bc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572303.063339:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00010000:00010000:2.0:1788572303.063348:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.063350:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.063352:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572303.063357:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639074176:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572303.063365:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e64173d500/2, rc 0, transno 4294968626 00000100:00100000:1.0:1788572303.063373:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639074432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.063379:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572303.063381:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.063384:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639074560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.063397:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572303.063402:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639074304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.063413:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.063447:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.064434:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639074688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.064476:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572303.066105:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.066116:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572303.066128:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639074176 00000100:00100000:0.0:1788572303.066137:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639074176 00000100:00100000:0.0:1788572303.066202:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639074560 00000100:00100000:0.0:1788572303.066206:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639074560 00000100:00100000:0.0:1788572303.066225:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639074304 00000100:00100000:0.0:1788572303.066228:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639074304 00000100:00100000:0.0:1788572303.066241:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639074688 00000100:00100000:0.0:1788572303.066244:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639074688 00000100:00100000:0.0:1788572303.066262:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:0.0:1788572303.066272:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+158:3652:x1875449639074176:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.066285:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1788572303.066293:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+158:3650:x1875449639074560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.066305:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2615 count 1 00002000:00080000:2.0:1788572303.066305:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2618 count 1 00002000:00010000:0.0:1788572303.066333:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1788572303.066333:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.066342:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334bc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.066342:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334bce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.066358:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa37:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.066358:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3a:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.066363:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.066363:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.066371:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.066371:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.066386:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.066386:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.066398:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.066400:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.066407:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.066407:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.066422:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572303.066486:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:3.0:1788572303.066496:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+158:3652:x1875449639074304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572303.066508:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2616 count 1 00002000:00010000:3.0:1788572303.066522:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572303.066527:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334bd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.066535:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa38:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:3.0:1788572303.066538:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572303.066541:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.066567:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.066575:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.066582:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.066734:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788572303.067091:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+159:3650:x1875449639074560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 798us (3676us total) trans 4294968627 rc 0/0 00000100:00100000:2.0:1788572303.067101:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1788572303.067121:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1788572303.067128:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+158:3652:x1875449639074688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572303.067142:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2619 count 1 00002000:00010000:2.0:1788572303.067169:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.067174:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334bdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.067184:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3b:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.067186:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.067190:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.067270:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.067280:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.067288:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.067302:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1788572303.067372:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+159:3652:x1875449639074688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 244us (2894us total) trans 4294968628 rc 0/0 00000100:00100000:2.0:1788572303.067381:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00010000:00010000:3.0:1788572303.067534:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1788572303.067603:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+159:3652:x1875449639074304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1109us (4154us total) trans 4294968629 rc 0/0 00000100:00100000:3.0:1788572303.067610:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000004:00080000:2.0:1788572303.067767:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d2f0e00/2, rc 0, transno 4294968628 00000100:00100000:2.0:1788572303.067777:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639074688:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572303.067787:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b5880/2, rc 0, transno 4294968629 00000100:00100000:2.0:1788572303.067791:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639074304:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.074473:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+159:3652:x1875449639074176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8193us (11080us total) trans 4294968630 rc 0/0 00000100:00100000:0.0:1788572303.074486:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000004:00080000:2.0:1788572303.074527:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b4000/2, rc 0, transno 4294968630 00010000:00010000:0.0:1788572303.074535:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1788572303.074535:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639074176:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572303.074544:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.074556:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.074562:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.074574:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334bc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.074608:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334bc7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.074616:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334bc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.074637:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572303.074640:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.074646:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.075079:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572303.075087:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.075096:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.075099:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.075109:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334bd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.075121:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334bd5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.075127:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009da4108e/0xdb7edb52b8334bd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.075143:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572303.075148:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.075177:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572303.075180:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.075187:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334bdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.075265:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334bdc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.075276:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334bdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.075292:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.075294:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572303.075296:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572303.075354:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3ed80/2, rc 0, transno 4294968617 00000100:00100000:2.0:1788572303.075361:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639072768:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572303.075371:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57f480/2, rc 0, transno 4294968618 00000100:00100000:2.0:1788572303.075375:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639073280:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572303.075388:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e506550700/2, rc 0, transno 8589935949 00000100:00100000:2.0:1788572303.076381:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639070720:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572303.076987:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3df80/2, rc 0, transno 4294968616 00000100:00100000:2.0:1788572303.076996:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639071232:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572303.077026:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3d880/2, rc 0, transno 4294968620 00000100:00100000:2.0:1788572303.077031:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639071744:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572303.077319:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.077334:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334bce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.077350:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334bce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.077358:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334bce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.077383:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.077385:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.077388:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.077417:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.077422:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.077431:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572303.077497:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63778fb80/2, rc 0, transno 4294968627 00000100:00100000:0.0:1788572303.077502:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639074560:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.080151:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639074944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.080189:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639074816:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.080250:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.080295:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.080900:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639075200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.080947:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.090705:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639074944 00000100:00100000:1.0:1788572303.090716:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639074944 00000100:00100000:1.0:1788572303.090775:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639074816 00000100:00100000:1.0:1788572303.090778:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639074816 00000100:00100000:1.0:1788572303.090792:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639075200 00000100:00100000:1.0:1788572303.090795:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639075200 00000100:00100000:1.0:1788572303.090814:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:1.0:1788572303.090824:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+161:3650:x1875449639074944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.090861:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2621 count 1 00000100:00100000:0.0:1788572303.090987:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639075712:0@lo:6:osp-syn-1-0.0 00002000:00010000:1.0:1788572303.091061:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.091069:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334be3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091085:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3d:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.091090:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.091096:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334be3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091110:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334be3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091120:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334be3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091127:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334be3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091144:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572303.091320:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+162:3650:x1875449639074944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 496us (11069us total) trans 4294968631 rc 0/0 00000100:00100000:1.0:1788572303.091328:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00100000:1.0:1788572303.091423:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:1.0:1788572303.091430:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+161:3653:x1875449639074816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.091517:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2620 count 1 00002000:00010000:1.0:1788572303.091534:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.091540:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334bea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091549:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3c:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.091551:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.091555:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334bea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091566:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334bea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091574:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334bea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091581:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334bea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091599:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572303.091677:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+162:3653:x1875449639074816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 247us (11381us total) trans 4294968632 rc 0/0 00000100:00100000:1.0:1788572303.091683:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00100000:1.0:1788572303.091696:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:1.0:1788572303.091703:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+161:3652:x1875449639075200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.091714:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2623 count 1 00002000:00010000:1.0:1788572303.091728:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.091733:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334bf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091741:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3f:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.091743:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.091747:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334bf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091760:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334bf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091767:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334bf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091774:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334bf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.091788:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572303.091847:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+162:3652:x1875449639075200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 145us (10899us total) trans 4294968633 rc 0/0 00000100:00100000:1.0:1788572303.091854:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00010000:00010000:1.0:1788572303.092036:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572303.092044:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334be3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092052:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.092056:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334be3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092065:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334be3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092083:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334be3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092091:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000037daf32/0xdb7edb52b8334be3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092110:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572303.092114:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334bea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092120:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.092123:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334bea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092130:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334bea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092139:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334bea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092145:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8334bea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092168:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.092171:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334bf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092177:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.092180:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334bf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092187:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334bf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092197:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334bf1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092205:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8334bf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092216:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.092218:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.092220:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.092226:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572303.092244:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639075456:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.092279:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572303.092328:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d28b100/2, rc 0, transno 4294968631 00000100:00100000:1.0:1788572303.092341:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639074944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.092355:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788572303.092361:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639075072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.092383:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.092403:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639075584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.092423:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.092594:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639075456 00000100:00100000:1.0:1788572303.092600:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639075456 00000100:00100000:1.0:1788572303.092633:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639075072 00000100:00100000:1.0:1788572303.092636:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639075072 00000100:00100000:1.0:1788572303.092725:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639075584 00000100:00100000:1.0:1788572303.092729:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639075584 00000100:00100000:1.0:1788572303.092749:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:1.0:1788572303.092756:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+164:3650:x1875449639075456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.092775:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2625 count 1 00002000:00010000:1.0:1788572303.092797:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.092804:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334bf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092814:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa41:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.092817:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.092822:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334bf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092832:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334bf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092841:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334bf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092848:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334bf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.092864:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572303.093276:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+165:3650:x1875449639075456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 520us (996us total) trans 4294968634 rc 0/0 00000100:00100000:1.0:1788572303.093284:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:1.0:1788572303.093301:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:1.0:1788572303.093307:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+164:3650:x1875449639075072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.093320:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2622 count 1 00002000:00010000:1.0:1788572303.093336:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.093340:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001898055a/0xdb7edb52b8334bff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093349:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3e:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.093353:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.093356:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001898055a/0xdb7edb52b8334bff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093366:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001898055a/0xdb7edb52b8334bff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093373:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001898055a/0xdb7edb52b8334bff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093381:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001898055a/0xdb7edb52b8334bff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093395:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572303.093534:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+165:3650:x1875449639075072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 226us (1149us total) trans 4294968635 rc 0/0 00000100:00100000:1.0:1788572303.093540:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00100000:1.0:1788572303.093553:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:1.0:1788572303.093559:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+164:3650:x1875449639075584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.093571:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2626 count 1 00002000:00010000:1.0:1788572303.093585:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.093589:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000463c1e0c/0xdb7edb52b8334c06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093597:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa42:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.093600:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.093605:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000463c1e0c/0xdb7edb52b8334c06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093614:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000463c1e0c/0xdb7edb52b8334c06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093621:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000463c1e0c/0xdb7edb52b8334c06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093627:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000463c1e0c/0xdb7edb52b8334c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093640:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572303.093766:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+165:3650:x1875449639075584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 206us (1341us total) trans 4294968636 rc 0/0 00000100:00100000:1.0:1788572303.093772:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00010000:00010000:1.0:1788572303.093797:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572303.093803:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334bf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093810:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.093814:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334bf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093822:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334bf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093838:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334bf8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093845:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f31191d/0xdb7edb52b8334bf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093864:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572303.093867:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001898055a/0xdb7edb52b8334bff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093872:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.093875:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001898055a/0xdb7edb52b8334bff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093882:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001898055a/0xdb7edb52b8334bff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093891:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001898055a/0xdb7edb52b8334bff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093970:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001898055a/0xdb7edb52b8334bff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093986:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.093989:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000463c1e0c/0xdb7edb52b8334c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.093995:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.093998:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000463c1e0c/0xdb7edb52b8334c06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.094030:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000463c1e0c/0xdb7edb52b8334c06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.094041:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000463c1e0c/0xdb7edb52b8334c06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.094048:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000463c1e0c/0xdb7edb52b8334c06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.094060:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.094062:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.094064:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.094069:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.094073:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572303.094106:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae6b480/2, rc 0, transno 4294968635 00000100:00100000:1.0:1788572303.094115:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639075072:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572303.094124:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63779a680/2, rc 0, transno 4294968636 00000100:00100000:1.0:1788572303.094127:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639075584:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572303.094134:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63779aa00/2, rc 0, transno 4294968634 00000100:00100000:1.0:1788572303.094138:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639075456:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788572303.094164:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572303.094232:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639075968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.094263:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.094320:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572303.094327:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639076096:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.094349:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.094775:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.094799:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639076224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.094820:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.094842:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639075968 00000100:00100000:0.0:1788572303.094848:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639075968 00000100:00100000:0.0:1788572303.094882:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639076096 00000100:00100000:0.0:1788572303.094885:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639076096 00000100:00100000:0.0:1788572303.095025:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639075712 00000100:00100000:0.0:1788572303.095029:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639075712 00000100:00100000:0.0:1788572303.095049:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639076224 00000100:00100000:0.0:1788572303.095052:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639076224 00000100:00100000:0.0:1788572303.095072:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:0.0:1788572303.095079:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+168:3650:x1875449639075968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.095101:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2629 count 1 00002000:00010000:0.0:1788572303.095124:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.095130:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334c0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.095142:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa45:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.095146:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.095151:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.095173:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.095188:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334c0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.095196:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.095212:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572303.095319:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+169:3650:x1875449639075968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 239us (1054us total) trans 4294968637 rc 0/0 00000100:00100000:0.0:1788572303.095327:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:0.0:1788572303.095342:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:0.0:1788572303.095348:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50329df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+168:3650:x1875449639076096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.095359:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2630 count 1 00002000:00010000:0.0:1788572303.095375:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.095380:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a181095e/0xdb7edb52b8334c14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.095388:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa46:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.095391:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.095395:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a181095e/0xdb7edb52b8334c14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.095405:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a181095e/0xdb7edb52b8334c14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.095417:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a181095e/0xdb7edb52b8334c14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.095424:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a181095e/0xdb7edb52b8334c14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.095437:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572303.095567:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:1.0:1788572303.095577:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+168:3652:x1875449639075712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.095591:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2627 count 1 00002000:00010000:1.0:1788572303.095607:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.095612:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d999cbdd/0xdb7edb52b8334c1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095621:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa43:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.095624:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.095628:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d999cbdd/0xdb7edb52b8334c1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095638:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d999cbdd/0xdb7edb52b8334c1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095726:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d999cbdd/0xdb7edb52b8334c1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095734:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d999cbdd/0xdb7edb52b8334c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095748:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788572303.095756:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572303.095761:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095769:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.095773:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334c0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095782:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334c0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095798:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334c0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095806:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334c0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095822:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572303.095826:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a181095e/0xdb7edb52b8334c14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095832:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.095835:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a181095e/0xdb7edb52b8334c14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095843:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a181095e/0xdb7edb52b8334c14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095853:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a181095e/0xdb7edb52b8334c14 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095860:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.095863:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d999cbdd/0xdb7edb52b8334c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095870:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.095873:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d999cbdd/0xdb7edb52b8334c1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095880:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d999cbdd/0xdb7edb52b8334c1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095890:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d999cbdd/0xdb7edb52b8334c1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095975:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d999cbdd/0xdb7edb52b8334c1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.095990:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.095992:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.095994:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572303.096116:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+169:3652:x1875449639075712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 541us (1341us total) trans 4294968638 rc 0/0 00000100:00100000:1.0:1788572303.096124:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00000100:00100000:1.0:1788572303.096142:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:1.0:1788572303.096150:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+168:3652:x1875449639076224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.096175:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2631 count 1 00002000:00010000:1.0:1788572303.096194:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.096199:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092e6056b/0xdb7edb52b8334c22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.096208:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa47:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.096211:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.096215:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092e6056b/0xdb7edb52b8334c22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.096224:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092e6056b/0xdb7edb52b8334c22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.096232:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092e6056b/0xdb7edb52b8334c22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.096240:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092e6056b/0xdb7edb52b8334c22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.096254:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572303.096262:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.096267:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092e6056b/0xdb7edb52b8334c22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.096273:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.096276:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092e6056b/0xdb7edb52b8334c22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.096283:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092e6056b/0xdb7edb52b8334c22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.096292:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092e6056b/0xdb7edb52b8334c22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.096299:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092e6056b/0xdb7edb52b8334c22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.096311:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.096313:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.096314:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572303.096384:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+169:3652:x1875449639076224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 236us (1562us total) trans 4294968639 rc 0/0 00000100:00100000:1.0:1788572303.096390:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00010000:00010000:0.0:1788572303.096525:0:43969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a181095e/0xdb7edb52b8334c14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572303.096606:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50329df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+169:3650:x1875449639076096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1258us (2256us total) trans 4294968640 rc 0/0 00000100:00100000:0.0:1788572303.096613:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00010000:00010000:0.0:1788572303.096636:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.096643:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572303.096751:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff1500/2, rc 0, transno 4294968640 00000100:00100000:0.0:1788572303.096772:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639076096:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572303.096784:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d289c00/2, rc 0, transno 4294968637 00000100:00100000:0.0:1788572303.096787:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639075968:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572303.096819:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6131cd880/2, rc 0, transno 4294968639 00000100:00100000:0.0:1788572303.096823:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639076224:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572303.096832:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63779b800/2, rc 0, transno 4294968633 00000100:00100000:0.0:1788572303.096835:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639075200:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572303.096843:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e762a00/2, rc 0, transno 4294968638 00000100:00100000:0.0:1788572303.096846:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639075712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.096854:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788572303.096864:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639075328:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.097083:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639076608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.097138:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.097181:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639076480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.097203:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.097228:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639075840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.097246:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.097260:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639076736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.097275:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.097286:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788572303.097290:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639076352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.097306:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572303.097317:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639076864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.097331:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.097388:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639075328 00000100:00100000:1.0:1788572303.097395:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639075328 00000100:00100000:1.0:1788572303.097509:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639076480 00000100:00100000:1.0:1788572303.097513:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639076480 00000100:00100000:1.0:1788572303.097533:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639075840 00000100:00100000:1.0:1788572303.097536:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639075840 00000100:00100000:1.0:1788572303.097548:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639076736 00000100:00100000:1.0:1788572303.097550:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639076736 00000100:00100000:1.0:1788572303.097561:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639076352 00000100:00100000:1.0:1788572303.097563:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639076352 00000100:00100000:1.0:1788572303.097577:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639076864 00000100:00100000:1.0:1788572303.097579:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639076864 00000100:00100000:1.0:1788572303.097909:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:1.0:1788572303.097919:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+174:3652:x1875449639075328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.097944:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2624 count 1 00002000:00010000:1.0:1788572303.097973:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.097980:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009109bce2/0xdb7edb52b8334c29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.097993:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa40:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.097997:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.098033:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009109bce2/0xdb7edb52b8334c29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.098045:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009109bce2/0xdb7edb52b8334c29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.098061:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009109bce2/0xdb7edb52b8334c29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.098068:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009109bce2/0xdb7edb52b8334c29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.098082:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572303.098234:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+175:3652:x1875449639075328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 316us (1339us total) trans 4294968641 rc 0/0 00000100:00100000:0.0:1788572303.098346:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:0.0:1788572303.098357:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+175:3650:x1875449639076480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.098372:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2633 count 1 00002000:00010000:0.0:1788572303.098390:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.098394:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334c30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098403:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa49:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.098406:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.098410:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334c30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098420:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334c30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098427:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334c30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098434:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334c30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098518:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572303.098529:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572303.098534:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009109bce2/0xdb7edb52b8334c29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098542:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.098546:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009109bce2/0xdb7edb52b8334c29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098556:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009109bce2/0xdb7edb52b8334c29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098571:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009109bce2/0xdb7edb52b8334c29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098578:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009109bce2/0xdb7edb52b8334c29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098597:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572303.098600:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334c30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098607:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.098610:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334c30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098616:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334c30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098625:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334c30 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098632:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378de9d7/0xdb7edb52b8334c30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098645:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.098647:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572303.098723:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:1.0:1788572303.098749:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:1.0:1788572303.098757:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+174:3652:x1875449639075840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.098770:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2628 count 1 00002000:00010000:1.0:1788572303.098784:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.098789:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.098797:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa44:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.098800:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.098804:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.098813:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.098825:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.098832:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.098847:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572303.098960:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572303.098965:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098972:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.098976:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098985:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.098995:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099022:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099037:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.099039:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.099041:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572303.099131:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+176:3650:x1875449639076480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 777us (1926us total) trans 4294968643 rc 0/0 00000100:00100000:0.0:1788572303.099138:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000004:00080000:0.0:1788572303.099193:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6131cdc00/2, rc 0, transno 4294968643 00000100:00100000:0.0:1788572303.099205:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639076480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.099226:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:0.0:1788572303.099234:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+175:3652:x1875449639076736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.099246:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2635 count 1 00002000:00010000:0.0:1788572303.099260:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.099264:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334c3e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099272:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4b:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.099276:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.099281:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334c3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099290:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334c3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099298:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334c3e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099305:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334c3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099318:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572303.099325:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572303.099330:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334c3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099336:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.099340:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334c3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099347:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334c3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099356:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334c3e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099369:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334c3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.099383:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.099385:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.099386:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572303.100366:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:2.0:1788572303.100388:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+176:3652:x1875449639076352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572303.100667:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2632 count 1 00002000:00010000:2.0:1788572303.100698:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.100706:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000824cdf94/0xdb7edb52b8334c45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.100719:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa48:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.100723:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.100728:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000824cdf94/0xdb7edb52b8334c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.100740:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000824cdf94/0xdb7edb52b8334c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.100749:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000824cdf94/0xdb7edb52b8334c45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.100756:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000824cdf94/0xdb7edb52b8334c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.100786:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572303.102627:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:3.0:1788572303.102646:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+177:3652:x1875449639076864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572303.102677:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2636 count 1 00002000:00010000:3.0:1788572303.102710:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572303.102719:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334c4c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.102734:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4c:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:3.0:1788572303.102739:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572303.102746:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.102763:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.102773:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334c4c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.102781:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334c4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572303.102807:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572303.105264:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+178:3652:x1875449639075840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6495us (8003us total) trans 4294968642 rc 0/0 00000100:00100000:1.0:1788572303.105282:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00010000:00010000:1.0:1788572303.105386:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572303.105394:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000824cdf94/0xdb7edb52b8334c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105405:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.105411:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000824cdf94/0xdb7edb52b8334c45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105422:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000824cdf94/0xdb7edb52b8334c45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105454:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000824cdf94/0xdb7edb52b8334c45 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105463:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000824cdf94/0xdb7edb52b8334c45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105488:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.105493:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334c4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105499:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.105503:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334c4c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105510:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334c4c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105520:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334c4c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105527:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334c4c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105540:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.105542:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.105544:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.105554:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572303.105576:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.105626:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639076608 00000100:00100000:1.0:1788572303.105634:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639076608 00000100:00100000:1.0:1788572303.105679:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:1.0:1788572303.105687:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+178:3651:x1875449639076608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.105716:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2634 count 1 00002000:00010000:1.0:1788572303.105743:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.105749:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334c53 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105761:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4a:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.105766:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.105773:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105784:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105793:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334c53 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105801:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.105816:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572303.105960:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+179:3651:x1875449639076608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 274us (383us total) trans 4294968647 rc 0/0 00000100:00100000:1.0:1788572303.105967:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000004:00080000:1.0:1788572303.106049:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6131cd180/2, rc 0, transno 4294968647 00000100:00100000:1.0:1788572303.106056:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639076608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.106127:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639077120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.106172:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.106191:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639077120 00000100:00100000:1.0:1788572303.106195:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639077120 00000100:00100000:1.0:1788572303.106216:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:1.0:1788572303.106222:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+179:3651:x1875449639077120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.106235:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2638 count 1 00002000:00010000:1.0:1788572303.106251:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.106255:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334c5a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106264:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4e:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.106267:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.106271:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106281:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106288:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334c5a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106294:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334c5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106306:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572303.106367:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+180:3651:x1875449639077120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 144us (194us total) trans 4294968648 rc 0/0 00000100:00100000:1.0:1788572303.106378:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00010000:00010000:1.0:1788572303.106395:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572303.106400:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106407:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.106411:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334c53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106419:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334c53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106430:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334c53 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106438:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334c53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106455:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.106458:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334c5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106464:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.106466:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334c5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106479:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334c5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106488:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334c5a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106495:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334c5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106505:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.106507:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.106508:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572303.106525:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57dc00/2, rc 0, transno 4294968648 00000100:00100000:1.0:1788572303.106534:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639077120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.106542:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572303.106548:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639076992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572303.106573:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572303.106592:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639076992 00000100:00100000:1.0:1788572303.106595:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639076992 00000100:00100000:1.0:1788572303.106618:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:1.0:1788572303.106625:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+180:3651:x1875449639076992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572303.106636:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2637 count 1 00002000:00010000:1.0:1788572303.106652:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572303.106657:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334c61 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106671:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4d:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:1.0:1788572303.106674:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572303.106678:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334c61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106687:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334c61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106694:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334c61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106700:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334c61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106712:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572303.106773:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+181:3651:x1875449639076992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 149us (199us total) trans 4294968649 rc 0/0 00000100:00100000:1.0:1788572303.106779:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00010000:00010000:1.0:1788572303.106797:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.106803:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334c61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106810:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.106813:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334c61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106824:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334c61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106835:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334c61 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106842:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334c61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.106854:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.106862:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.106864:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572303.106880:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57e680/2, rc 0, transno 4294968649 00000100:00100000:1.0:1788572303.106884:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639076992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.113074:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+180:3652:x1875449639076736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13829us (15785us total) trans 4294968644 rc 0/0 00000100:00100000:0.0:1788572303.113092:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00010000:00010000:0.0:1788572303.113134:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.113141:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572303.113187:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639077248:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.117346:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+179:3652:x1875449639076352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16954us (20026us total) trans 4294968645 rc 0/0 00000100:00100000:2.0:1788572303.117362:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000004:00080000:2.0:1788572303.117560:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d289180/2, rc 0, transno 4294968632 00000100:00100000:2.0:1788572303.117585:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639074816:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.117608:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639077376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572303.117655:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572303.117692:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639077376 00000100:00100000:2.0:1788572303.117698:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639077376 00000100:00100000:2.0:1788572303.117741:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:2.0:1788572303.117749:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+179:3653:x1875449639077376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572303.117776:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2640 count 1 00002000:00010000:2.0:1788572303.117812:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572303.117819:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334c68 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.117836:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa50:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:2.0:1788572303.117841:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572303.117849:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.117865:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.117881:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334c68 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.117888:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572303.117912:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572303.117975:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572303.117983:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.117991:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572303.117995:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334c68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.118024:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334c68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.118047:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334c68 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.118053:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cc42b4c/0xdb7edb52b8334c68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572303.118074:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.118075:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572303.118077:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572303.118166:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+180:3653:x1875449639077376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 406us (500us total) trans 4294968650 rc 0/0 00000100:00100000:2.0:1788572303.118173:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000004:00080000:2.0:1788572303.118514:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac7100/2, rc 0, transno 4294968650 00000100:00100000:2.0:1788572303.118533:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639077376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572303.120811:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+179:3652:x1875449639076864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18164us (23470us total) trans 4294968646 rc 0/0 00000100:00100000:3.0:1788572303.120826:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00010000:00010000:3.0:1788572303.120866:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572303.121421:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572303.121491:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6131cc380/2, rc 0, transno 4294968645 00000100:00100000:1.0:1788572303.121504:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639076352:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572303.121515:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b6680/2, rc 0, transno 4294968646 00000100:00100000:1.0:1788572303.121518:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639076864:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572303.121527:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5032b6a00/2, rc 0, transno 4294968644 00000100:00100000:1.0:1788572303.121531:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639076736:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572303.121540:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637798000/2, rc 0, transno 4294968641 00000100:00100000:1.0:1788572303.121543:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639075328:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572303.121552:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d28a300/2, rc 0, transno 4294968642 00000100:00100000:1.0:1788572303.121555:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639075840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572303.121986:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639077248 00000100:00100000:0.0:1788572303.121994:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639077248 00000100:00100000:0.0:1788572303.122057:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:0.0:1788572303.122067:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+179:3652:x1875449639077248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572303.122096:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2639 count 1 00002000:00010000:0.0:1788572303.122128:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572303.122136:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554a00bf/0xdb7edb52b8334c6f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.122151:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4f:0x0].0x0 since=4220s v=(0 0) 00010000:00010000:0.0:1788572303.122168:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572303.122175:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000554a00bf/0xdb7edb52b8334c6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.122196:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000554a00bf/0xdb7edb52b8334c6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.122207:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000554a00bf/0xdb7edb52b8334c6f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.122215:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000554a00bf/0xdb7edb52b8334c6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.122232:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572303.122373:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+180:3652:x1875449639077248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 307us (952us total) trans 4294968651 rc 0/0 00000100:00100000:0.0:1788572303.122380:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00010000:00010000:0.0:1788572303.122401:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572303.122407:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000554a00bf/0xdb7edb52b8334c6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.122415:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572303.122419:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000554a00bf/0xdb7edb52b8334c6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.122429:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000554a00bf/0xdb7edb52b8334c6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.122507:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000554a00bf/0xdb7edb52b8334c6f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.122517:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000554a00bf/0xdb7edb52b8334c6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572303.122537:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.122539:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572303.122541:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572303.122633:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57df80/2, rc 0, transno 4294968651 00000100:00100000:1.0:1788572303.122823:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639077248:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572304.078268:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572304.397966:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639077504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572304.398057:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572304.398394:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639077504 00000100:00100000:3.0:1788572304.398404:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639077504 00000100:00100000:3.0:1788572304.398467:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:3.0:1788572304.398477:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639077504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572304.398518:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572304.398568:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639077504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572304.398575:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00100000:0.0:1788572304.398899:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639077504:0@lo:41:osp-pre-0-1.0 00000004:00080000:2.0:1788572304.399378:0:111999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4221420372414ns, next at 4222420369821ns, rc = 0 00000100:00100000:0.0:1788572304.399594:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572304.399608:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639077632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572304.399650:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572304.407949:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639077632 00000100:00100000:2.0:1788572304.407964:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639077632 00000100:00100000:3.0:1788572304.408636:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:3.0:1788572304.408648:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+181:3650:x1875449639077632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572304.408684:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484838976 pending 0 free 3923476480 avail 3691954176 00010000:00000080:3.0:1788572304.408701:0:8468:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e506552300 x1875449639077632/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:720/0 lens 224/368 e 0 to 0 dl 1788572315 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572304.408830:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572304.409183:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+181:3650:x1875449639077632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 537us (9532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572304.409220:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:2.0:1788572304.420210:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639077632:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788572304.903259:0:112001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 4221924251735ns, next at 4222924248763ns, rc = 0 00000100:00100000:1.0:1788572304.904533:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639077760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572304.904610:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572304.905805:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639077760 00000100:00100000:3.0:1788572304.905826:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639077760 00000100:00100000:3.0:1788572304.905902:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839 00000100:00100000:3.0:1788572304.905913:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+180:3652:x1875449639077760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572304.905945:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572304.906060:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+180:3652:x1875449639077760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572304.906068:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839 00000100:00080000:1.0:1788572304.906216:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572304.906695:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639077760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788572305.099770:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572305.419435:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572305.419462:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639077888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572305.419531:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572305.421100:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639077888 00000100:00100000:0.0:1788572305.421113:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639077888 00000100:00100000:0.0:1788572305.421278:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:0.0:1788572305.421290:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639077888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572305.421319:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 484838976 pending 0 free 3923476480 avail 3691954176 00010000:00000080:0.0:1788572305.421335:0:10546:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e63aeb0000 x1875449639077888/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:721/0 lens 224/368 e 0 to 0 dl 1788572316 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572305.421423:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639077888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572305.421432:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00080000:0.0:1788572305.421467:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572305.427769:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639077888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572305.935866:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639078144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.935939:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.935993:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639078656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936061:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.936080:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639079168:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936101:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.936124:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788572305.936130:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639078016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936159:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.936180:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639078528:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936204:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.936219:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639079040:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936260:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.936285:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639078400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936311:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.936336:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639078912:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936358:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.936375:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639079424:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936397:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.936415:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788572305.936449:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639078272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936475:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.936508:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639078784:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936529:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.936547:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639079296:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936569:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.936599:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639078144 00000100:00100000:1.0:1788572305.936606:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639078144 00000100:00100000:1.0:1788572305.936648:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639079040 00000100:00100000:1.0:1788572305.936651:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639079040 00000100:00100000:1.0:1788572305.936672:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1788572305.936681:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639078144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936737:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639078144:12345-0@lo:400:kworker.0 Request processed in 57us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572305.936744:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1788572305.936762:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1788572305.936769:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639079040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936796:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639079040:12345-0@lo:400:kworker.0 Request processed in 28us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572305.936802:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1788572305.936836:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639078656 00000100:00100000:1.0:1788572305.936839:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639078656 00000100:00100000:1.0:1788572305.936876:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639079168 00000100:00100000:1.0:1788572305.936880:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639079168 00000100:00100000:1.0:1788572305.936895:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639079296 00000100:00100000:1.0:1788572305.936898:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639079296 00000100:00100000:1.0:1788572305.936918:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3684 00000100:00100000:1.0:1788572305.936924:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639078656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.936957:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639078656:12345-0@lo:400:kworker.0 Request processed in 34us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572305.936964:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3684 00000100:00100000:1.0:1788572305.936976:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3685 00000100:00100000:1.0:1788572305.936983:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+181:3651:x1875449639079168:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788572305.936995:0:17011:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e503932680 x1875449639079168/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:721/0 lens 224/224 e 0 to 0 dl 1788572316 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572305.937050:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+181:3651:x1875449639079168:12345-0@lo:400:kworker.0 Request processed in 68us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572305.937056:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3685 00000100:00100000:1.0:1788572305.937068:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3686 00000100:00100000:1.0:1788572305.937074:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+180:3653:x1875449639079296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.937104:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+180:3653:x1875449639079296:12345-0@lo:400:kworker.0 Request processed in 30us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572305.937110:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3686 00000100:00100000:1.0:1788572305.937132:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639078528 00000100:00100000:1.0:1788572305.937136:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639078528 00000100:00100000:1.0:1788572305.937157:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639078400 00000100:00100000:1.0:1788572305.937159:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639078400 00000100:00100000:1.0:1788572305.937171:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639078912 00000100:00100000:1.0:1788572305.937173:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639078912 00000100:00100000:1.0:1788572305.937185:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639079424 00000100:00100000:1.0:1788572305.937188:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639079424 00000100:00100000:1.0:1788572305.937198:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639078272 00000100:00100000:1.0:1788572305.937200:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639078272 00000100:00100000:1.0:1788572305.937211:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639078784 00000100:00100000:1.0:1788572305.937213:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639078784 00000100:00100000:1.0:1788572305.937225:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4509 00000100:00100000:1.0:1788572305.937266:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639078528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.937295:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639078528:12345-0@lo:400:kworker.0 Request processed in 64us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572305.937301:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4509 00000100:00100000:1.0:1788572305.937313:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4510 00000100:00100000:1.0:1788572305.937318:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639078400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.937341:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639078400:12345-0@lo:400:kworker.0 Request processed in 23us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572305.937343:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639078016 00000100:00100000:1.0:1788572305.937346:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4510 00000100:00100000:2.0:1788572305.937347:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639078016 00000100:00100000:1.0:1788572305.937357:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4511 00000100:00100000:1.0:1788572305.937362:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639078912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572305.937374:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788572305.937380:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639078016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.937385:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639078912:12345-0@lo:400:kworker.0 Request processed in 24us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572305.937390:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4511 00000100:00100000:1.0:1788572305.937401:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4512 00000100:00100000:1.0:1788572305.937406:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639079424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572305.937410:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639078016:12345-0@lo:400:kworker.0 Request processed in 31us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572305.937415:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788572305.937428:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639079424:12345-0@lo:400:kworker.0 Request processed in 22us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572305.937434:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4512 00000100:00100000:2.0:1788572305.937442:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4513 00000100:00100000:2.0:1788572305.937448:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639078272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572305.937475:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639078272:12345-0@lo:400:kworker.0 Request processed in 28us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572305.937825:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639079552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572305.937861:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572305.938897:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4514 00000100:00100000:1.0:1788572305.938917:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639078784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.938983:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639078784:12345-0@lo:400:kworker.0 Request processed in 76us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572305.938990:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4514 00000100:00100000:1.0:1788572305.939059:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639079552 00000100:00100000:1.0:1788572305.939065:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639079552 00000100:00100000:1.0:1788572305.939091:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1788572305.939097:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639079552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572305.939123:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572305.939163:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639079552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572305.939169:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1788572305.939211:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639078016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.939228:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639078528:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.939253:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639079040:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.939265:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639078144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.939277:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639078656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.939291:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639079168:0@lo:400:kworker.0 00000100:00080000:1.0:1788572305.939336:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572305.939341:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572305.939343:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572305.939372:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639078272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.939383:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639078784:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.939395:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639079296:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.939406:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639078400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.939416:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639078912:0@lo:400:kworker.0 00000100:00100000:1.0:1788572305.939426:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639079424:0@lo:400:kworker.0 00000100:00100000:2.0:1788572305.940938:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4513 00000100:00100000:3.0:1788572305.943688:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639079552:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788572306.115160:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788572306.300849:0:114155:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788572306.300923:0:114155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a800/0xdb7edb52b831caa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b831caab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.300939:0:114155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a800/0xdb7edb52b831caa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b831caab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.300947:0:114155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a800/0xdb7edb52b831caa4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831caab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.300954:0:114155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a800/0xdb7edb52b831caa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831caab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.300979:0:114155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788572306.300985:0:114155:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788572306.301041:0:114155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572306.301046:0:114155:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788572306.301053:0:114155:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788572306.301081:0:114155:0:(import.c:65:import_set_state_nolock()) ffff94e502d2b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788572306.301237:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572306.301255:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a800/0xdb7edb52b831caa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831caab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.301263:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ae3a800 already unused, calling callback (ffffffffc11ccc20) 10000000:00010000:3.0:1788572306.301267:0:92609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a800/0xdb7edb52b831caa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831caab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.301276:0:92609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a800/0xdb7edb52b831caa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb7edb52b831caab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572306.301289:0:92609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a800/0xdb7edb52b831caa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb7edb52b831caab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572306.301295:0:92609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788572306.301297:0:92609:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788572306.301300:0:92609:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788572306.301329:0:92609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a800/0xdb7edb52b831caa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831caab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.301336:0:92609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572306.301369:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a800/0xdb7edb52b831caa4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831caab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.301377:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a800/0xdb7edb52b831caa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831caab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.301389:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572306.301391:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572306.301393:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572306.301446:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572306.301469:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639079808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572306.301549:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572306.301708:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639079808 00000100:00100000:3.0:1788572306.301715:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639079808 00000100:00100000:3.0:1788572306.301770:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788572306.301780:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639079808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572306.301792:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572306.301807:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63ae3a400/0xdb7edb52b831caab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831caa4 expref: 24 pid: 111984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.301820:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572306.301860:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d74e0a07-d05f-49a8-aa32-40b653992526+23:3650:x1875449639079808:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.301869:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788572306.301988:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639079680:0@lo:39:umount.0 00000100:00100000:1.0:1788572306.302043:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572306.302114:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639079680 00000100:00100000:3.0:1788572306.302118:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639079680 00000100:00100000:3.0:1788572306.302153:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14677 00000100:00100000:3.0:1788572306.302160:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875449639079680:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788572306.302179:0:9276:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831cb68 00000100:00080000:3.0:1788572306.302195:0:9276:0:(import.c:65:import_set_state_nolock()) ffff94e63ae1b000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788572306.302262:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+1:3649:x1875449639079680:12345-0@lo:39:umount.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572306.302268:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14677 00000020:00000080:3.0:1788572306.302274:0:9276:0:(genops.c:885:class_export_put()) final put ffff94e63ae1e800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1788572306.302735:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788572306.302780:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e63ae1e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788572306.302843:0:84098:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e63ae1b000 for lustre-MDT0000 00000100:00080000:1.0:1788572306.302877:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e502d2b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788572306.302886:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639079680:0@lo:39:umount.0 00000100:00100000:2.0:1788572306.303069:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639079808:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788572306.303090:0:114155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572306.303093:0:114155:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788572306.303097:0:114155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788572306.304161:0:114155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788572306.304167:0:114155:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788572306.304173:0:114155:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788572306.304197:0:114155:0:(import.c:65:import_set_state_nolock()) ffff94e6131a7800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788572306.304970:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1875449639079936:0@lo:39:umount.0 00000100:00100000:1.0:1788572306.305069:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572306.305269:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639079936 00000100:00100000:0.0:1788572306.305278:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639079936 00000100:00100000:0.0:1788572306.305332:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14678 00000100:00100000:0.0:1788572306.305341:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875449639079936:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788572306.305366:0:95742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b82ddcb8 00000100:00080000:0.0:1788572306.305376:0:95742:0:(import.c:65:import_set_state_nolock()) ffff94e502d28800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788572306.305554:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572306.305601:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+1:3649:x1875449639079936:12345-0@lo:39:umount.0 Request processed in 261us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572306.305609:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14678 00000020:00000080:0.0:1788572306.305620:0:95742:0:(genops.c:885:class_export_put()) final put ffff94e502d2f000/lustre-MDT0001-lwp-OST0000_UUID 00000100:00080000:1.0:1788572306.305728:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6131a7800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788572306.305747:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1875449639079936:0@lo:39:umount.0 00000100:00080000:0.0:1788572306.305917:0:114155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788572306.305921:0:114155:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788572306.305925:0:114155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788572306.307265:0:114155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ade9800/0xdb7edb52b831cab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b831cab9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.307285:0:114155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ade9800/0xdb7edb52b831cab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b831cab9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.307293:0:114155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ade9800/0xdb7edb52b831cab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831cab9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.307301:0:114155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff94e63ade9800/0xdb7edb52b831cab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831cab9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.307323:0:114155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572306.307330:0:114155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637697400/0xdb7edb52b831cac0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b831cac7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.307342:0:114155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637697400/0xdb7edb52b831cac0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b831cac7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.307348:0:114155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637697400/0xdb7edb52b831cac0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831cac7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.307354:0:114155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff94e637697400/0xdb7edb52b831cac0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831cac7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.307373:0:114155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788572306.307377:0:114155:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788572306.307438:0:114155:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788572306.307443:0:114155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00010000:00010000:0.0:1788572306.307459:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572306.307663:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572306.307671:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff94e637697400/0xdb7edb52b831cac0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831cac7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.307678:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637697400 already unused, calling callback (ffffffffc11ccc20) 10000000:00010000:2.0:1788572306.307682:0:6538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff94e637697400/0xdb7edb52b831cac0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831cac7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.307691:0:6538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e637697400/0xdb7edb52b831cac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb7edb52b831cac7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572306.307699:0:6538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e637697400/0xdb7edb52b831cac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb7edb52b831cac7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572306.307705:0:6538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788572306.307707:0:6538:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788572306.307710:0:6538:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788572306.307749:0:6538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff94e637697400/0xdb7edb52b831cac0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831cac7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.307755:0:6538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572306.307790:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff94e637697400/0xdb7edb52b831cac0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831cac7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.307798:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e637697400/0xdb7edb52b831cac0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831cac7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.307815:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572306.307817:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572306.307819:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572306.307827:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572306.307847:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639080064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572306.307917:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572306.307978:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639080064 00000100:00100000:2.0:1788572306.307985:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639080064 00000100:00100000:2.0:1788572306.308054:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788572306.308064:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e640e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d74e0a07-d05f-49a8-aa32-40b653992526+23:3653:x1875449639080064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572306.308076:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572306.308090:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63ade9200/0xdb7edb52b831cac7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831cac0 expref: 23 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.308101:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572306.308131:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e640e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d74e0a07-d05f-49a8-aa32-40b653992526+22:3653:x1875449639080064:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.308137:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788572306.308195:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639080064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788572306.308382:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff94e63ade9800/0xdb7edb52b831cab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831cab9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.308391:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9800 already unused, calling callback (ffffffffc11ccc20) 10000000:00010000:0.0:1788572306.308394:0:17013:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff94e63ade9800/0xdb7edb52b831cab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831cab9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.308401:0:17013:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ade9800/0xdb7edb52b831cab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb7edb52b831cab9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572306.308407:0:17013:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ade9800/0xdb7edb52b831cab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb7edb52b831cab9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572306.308412:0:17013:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788572306.308415:0:17013:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788572306.308417:0:17013:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788572306.308680:0:17013:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff94e63ade9800/0xdb7edb52b831cab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831cab9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.308688:0:17013:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788572306.308733:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788572306.308752:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff94e63ade9800/0xdb7edb52b831cab2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831cab9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.308759:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ade9800/0xdb7edb52b831cab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831cab9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572306.308771:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572306.308773:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572306.308775:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788572306.308788:0:114155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788572306.308798:0:114155:0:(obd_config.c:933:class_cleanup()) Failing over lustre-OST0000 00000020:00000080:3.0:1788572306.310688:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e502d2f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788572306.310757:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e502d28800 for lustre-MDT0001 00002000:00000080:0.0:1788572306.311416:0:114155:0:(ofd_obd.c:1268:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:0.0:1788572306.311589:0:114155:0:(ofd_obd.c:1282:ofd_iocontrol()) syncing ost lustre-OST0000 00000100:00100000:1.0:1788572306.311837:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639080192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572306.311914:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572306.312138:0:8491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639080192 00000100:00100000:2.0:1788572306.312147:0:8491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639080192 00000100:00100000:2.0:1788572306.312211:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788572306.312220:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d74e0a07-d05f-49a8-aa32-40b653992526+22:3652:x1875449639080192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572306.312236:0:8491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572306.312269:0:8491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63af8d200/0xdb7edb52b831cab9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831cab2 expref: 22 pid: 111984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572306.312285:0:8491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572306.312324:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d74e0a07-d05f-49a8-aa32-40b653992526+21:3652:x1875449639080192:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.312331:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788572306.312437:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639080192:0@lo:103:ldlm_bl.0 00000001:00080000:3.0:1788572306.313391:0:16234:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589935952 is committed 00000020:00000080:0.0:1788572306.314348:0:114155:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:0.0:1788572306.314357:0:114155:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff94e62d4e1800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 8589935952 stale:0 00000020:00080000:0.0:1788572306.314367:0:114155:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff94e501c61000 35eb2d60-2de0-4b00-9815-d5153edd0057 192.168.202.13@tcp 5 (0 0 1) 0 0 0 0: 0000000000000000 8589935763 stale:0 00000020:00080000:0.0:1788572306.314372:0:114155:0:(genops.c:1819:print_export_data()) lustre-OST0000: ACTIVE ffff94e50303e800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:0.0:1788572306.314377:0:114155:0:(genops.c:1553:class_disconnect_exports()) OBD device 18 (ffff94e641990000) has exports, disconnecting them 00000020:00080000:0.0:1788572306.314381:0:114155:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff94e62d4e1800), last request at 1788572305 00000020:00000080:0.0:1788572306.314388:0:114155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831ca26 00000100:00080000:0.0:1788572306.314399:0:114155:0:(import.c:65:import_set_state_nolock()) ffff94e62d4e3000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572306.314575:0:114155:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94e62d4e1800): rc 0 00000020:00000080:0.0:1788572306.314578:0:114155:0:(genops.c:885:class_export_put()) final put ffff94e62d4e1800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1788572306.314596:0:114155:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.202.13@tcp (ffff94e501c61000), last request at 1788572301 00000020:00000080:0.0:1788572306.314601:0:114155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b82e01b7 00000020:00010000:0.0:1788572306.314606:0:114155:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94e501c61000: total 1 00000100:00080000:0.0:1788572306.314610:0:114155:0:(import.c:65:import_set_state_nolock()) ffff94e501c60800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788572306.314642:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e62d4e1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788572306.314686:0:84098:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e62d4e3000 for lustre-OST0000 00000020:00010000:3.0:1788572306.314742:0:92609:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94e501c61000: total 0 00010000:00010000:3.0:1788572306.314790:0:92609:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94e501c61000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788572306.314846:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003da7d80a/0xdb7edb52b83267bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47089 expref: 5 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572306.314872:0:92609:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94e501c61000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788572306.316146:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572306.316152:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788572306.316194:0:114155:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.13@tcp (ffff94e501c61000): rc 0 00000020:00000080:0.0:1788572306.316199:0:114155:0:(genops.c:885:class_export_put()) final put ffff94e501c61000/35eb2d60-2de0-4b00-9815-d5153edd0057 00000020:00080000:0.0:1788572306.316218:0:114155:0:(genops.c:1528:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff94e50303e800), last request at 1788572305 00000020:00000080:0.0:1788572306.316225:0:114155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b82ddc64 00000100:00080000:0.0:1788572306.316235:0:114155:0:(import.c:65:import_set_state_nolock()) ffff94e63c409000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788572306.316307:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e501c61000/35eb2d60-2de0-4b00-9815-d5153edd0057 for lustre-OST0000 00000020:00000080:2.0:1788572306.316351:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e501c60800 for lustre-OST0000 00010000:00010000:1.0:1788572306.316393:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572306.316419:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788572306.316611:0:114155:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94e50303e800): rc 0 00000020:00000080:0.0:1788572306.316613:0:114155:0:(genops.c:885:class_export_put()) final put ffff94e50303e800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1788572306.316658:0:114155:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff94e641990000) has no exports 00000020:00000080:2.0:1788572306.317618:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e50303e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788572306.317666:0:84098:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e63c409000 for lustre-OST0000 00010000:00010000:1.0:1788572306.318114:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788572306.319143:0:114155:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94e501d56d80 - data ffff94e611ff95e8/ffff94e503940c00 00000020:01000000:2.0:1788572306.319301:0:114155:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94e63af16180 - data ffff94e6207e50d8/ffff94e615888c00 00000100:00100000:3.0:1788572306.341226:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572306.341280:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572306.341294:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616089856 00000100:00100000:1.0:1788572306.341304:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616089856 00000100:00100000:3.0:1788572306.341309:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572306.341373:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616089728 00000100:00100000:1.0:1788572306.341377:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616089728 00000100:00100000:1.0:1788572306.341396:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3784 00000100:00100000:2.0:1788572306.341398:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616089472 00000100:00100000:2.0:1788572306.341402:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616089472 00000100:00100000:1.0:1788572306.341406:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2382:x1875449616089856:12345-192.168.202.13@tcp:9:kworker.0 00000100:00100000:2.0:1788572306.341437:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4515 00000020:00000080:1.0:1788572306.341439:0:43969:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b83300e2 00000100:00100000:2.0:1788572306.341443:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2386:x1875449616089472:12345-192.168.202.13@tcp:400:kworker.0 00000100:00080000:1.0:1788572306.341448:0:43969:0:(import.c:65:import_set_state_nolock()) ffff94e633ec1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572306.341511:0:43969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968651 00000100:00100000:2.0:1788572306.341529:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2386:x1875449616089472:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 86us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.341535:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4515 00000100:00100000:2.0:1788572306.341570:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3785 00000100:00100000:2.0:1788572306.341575:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2386:x1875449616089728:12345-192.168.202.13@tcp:400:kworker.0 00000020:00080000:2.0:1788572306.341581:0:43976:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.13@tcp 00000100:00100000:2.0:1788572306.341604:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2386:x1875449616089728:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (295us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572306.341610:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3785 00000100:00100000:1.0:1788572306.341626:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+2:2382:x1875449616089856:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 222us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.341633:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3784 00000100:00080000:1.0:1788572306.341648:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572306.341652:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572306.341660:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788572306.344528:0:114155:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000100:00100000:0.0:1788572306.359072:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572306.359119:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572306.361097:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616089344 00000100:00100000:2.0:1788572306.361110:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616089344 00000100:00100000:2.0:1788572306.361167:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 109 00000100:00100000:2.0:1788572306.361177:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616089344:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572306.361264:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616089344:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 88us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572306.361272:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 109 00000100:00100000:1.0:1788572306.365479:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616089600 00000100:00100000:1.0:1788572306.365551:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616089600 00000100:00100000:1.0:1788572306.365648:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4516 00000100:00100000:1.0:1788572306.365660:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616089600:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572306.365747:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616089600:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 90us (6626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.365755:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4516 00000100:00080000:2.0:1788572306.365941:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:0.0:1788572306.372357:0:114155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b82ddc5d 00000020:00000080:0.0:1788572306.372371:0:114155:0:(genops.c:885:class_export_put()) final put ffff94e503038800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788572306.372395:0:114155:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94e501cd3000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788572306.372399:0:114155:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94e501cd3000 2 00000020:01000004:0.0:1788572306.372403:0:114155:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94e501cd3000 from lustre-OST0000 00000020:00000080:0.0:1788572306.372440:0:114155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572306.372460:0:114155:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788572306.372464:0:114155:0:(genops.c:885:class_export_put()) final put ffff94e50303a800/lustre-OST0000_UUID 00000020:00000080:0.0:1788572306.372467:0:114155:0:(genops.c:844:class_export_destroy()) destroying export ffff94e50303a800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788572306.372474:0:114155:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788572306.372529:0:114155:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:0.0:1788572306.372534:0:114155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788572306.372538:0:114155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788572306.372544:0:114155:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788572306.372551:0:114155:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff94e502d2c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572306.372557:0:114155:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff94e50304cd40) has exports, disconnecting them 00000020:00080000:0.0:1788572306.372562:0:114155:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff94e502d2c000), last request at 1788568565 00000020:00000080:0.0:1788572306.372566:0:114155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b82ddc9c 00000020:00080000:0.0:1788572306.372575:0:114155:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94e502d2c000): rc 0 00000020:00000080:0.0:1788572306.372579:0:114155:0:(genops.c:885:class_export_put()) final put ffff94e502d2c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788572306.373031:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e503038800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788572306.373046:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e502d2c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788572306.375366:0:114155:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788572306.375376:0:114155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572306.375381:0:114155:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788572306.375388:0:114155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788572306.375503:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e502d2b000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788572306.375588:0:114155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572306.375601:0:114155:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788572306.375607:0:114155:0:(genops.c:885:class_export_put()) final put ffff94e5038b4000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788572306.375611:0:114155:0:(genops.c:844:class_export_destroy()) destroying export ffff94e5038b4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788572306.375617:0:114155:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788572306.375722:0:114155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788572306.375726:0:114155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572306.375733:0:114155:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788572306.375740:0:114155:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff94e62d804800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788572306.375747:0:114155:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff94e501f30000) has exports, disconnecting them 00000020:00080000:1.0:1788572306.375751:0:114155:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff94e62d804800), last request at 1788568565 00000020:00000080:1.0:1788572306.375756:0:114155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b82ddcb1 00000020:00080000:1.0:1788572306.375772:0:114155:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94e62d804800): rc 0 00000020:00000080:1.0:1788572306.375777:0:114155:0:(genops.c:885:class_export_put()) final put ffff94e62d804800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788572306.375895:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e62d804800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00000100:00100000:1.0:1788572306.419030:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572306.419077:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616089984 00000100:00100000:1.0:1788572306.419087:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616089984 00000100:00100000:1.0:1788572306.419131:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3786 00000100:00100000:1.0:1788572306.419139:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2382:x1875449616089984:12345-192.168.202.13@tcp:8:ptlrpcd_01_01.0 00010000:00020000:1.0:1788572306.419167:0:43965:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572306.419239:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2382:x1875449616089984:12345-192.168.202.13@tcp:8:ptlrpcd_01_01.0 Request processed in 87us (239us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572306.419255:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3786 00000100:00100000:1.0:1788572306.439083:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639080320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572306.439158:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572306.439219:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639080320 00000100:00100000:1.0:1788572306.439227:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639080320 00000100:00100000:1.0:1788572306.439289:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:1.0:1788572306.439298:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639080320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572306.439328:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572306.439368:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639080320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572306.439374:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:1.0:1788572306.439418:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639080320:0@lo:13:osp-pre-1-1.0 00010000:01000000:1.0:1788572306.454141:0:114155:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788572306.454156:0:114155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788572306.454160:0:114155:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788572306.454168:0:114155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572306.454340:0:114155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572306.454353:0:114155:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788572306.454360:0:114155:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94e501cd3000 1 00000020:00000080:1.0:1788572306.454367:0:114155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b82ddc41 00000020:00000080:1.0:1788572306.454376:0:114155:0:(genops.c:885:class_export_put()) final put ffff94e63c394800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788572306.454382:0:114155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788572306.454386:0:114155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572306.454391:0:114155:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788572306.454395:0:114155:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff94e6419919c0) has no exports 00000020:00000080:2.0:1788572306.494390:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e6131a7800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788572306.494407:0:93352:0:(genops.c:885:class_export_put()) final put ffff94e502de3800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788572306.494410:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e502de3800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788572306.494420:0:93352:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788572306.495209:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e63c394800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788572306.526373:0:114155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788572306.526392:0:114155:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788572306.526397:0:114155:0:(genops.c:885:class_export_put()) final put ffff94e503828000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788572306.526402:0:114155:0:(genops.c:844:class_export_destroy()) destroying export ffff94e503828000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788572306.526408:0:114155:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788572306.526573:0:114155:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94e501cd5000 00000020:02000400:0.0:1788572306.526635:0:114155:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788572307.142620:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572308.166471:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788572309.002130:0:9546:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000020:00000080:3.0:1788572309.002140:0:9546:0:(genops.c:885:class_export_put()) final put ffff94e633ec6000/35eb2d60-2de0-4b00-9815-d5153edd0057 00000001:00080000:3.0:1788572309.002155:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968651 is committed 00000020:00000080:2.0:1788572309.004697:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e633ec6000/35eb2d60-2de0-4b00-9815-d5153edd0057 for lustre-OST0001 00000020:00000080:2.0:1788572309.004774:0:84098:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e633ec1800 for lustre-OST0001 00010000:00010000:3.0:1788572309.187365:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572309.508427:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:2.0:1788572309.508477:0:111999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4226529471116ns, next at 4227529467829ns, rc = 0 00000100:00100000:0.0:1788572309.509677:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639080576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572309.509767:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572309.510075:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639080576 00000100:00100000:2.0:1788572309.510091:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639080576 00000100:00100000:2.0:1788572309.510160:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:2.0:1788572309.510191:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639080576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572309.510233:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:0.0:1788572309.510479:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639080576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572309.510532:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639080576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 363us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572309.510540:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000004:00080000:3.0:1788572309.513234:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00000004:00080000:3.0:1788572309.513271:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 20 committed 00000004:00080000:3.0:1788572309.513290:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000100:00100000:3.0:1788572309.513552:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639080704:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.513805:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572309.513887:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639080704 00000100:00100000:3.0:1788572309.513894:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639080704 00000100:00100000:3.0:1788572309.514033:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:3.0:1788572309.514045:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639080704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572309.514073:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2641 count 1 00002000:00010000:3.0:1788572309.514104:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572309.514113:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006af8f87f/0xdb7edb52b8334c76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.514129:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa51:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:3.0:1788572309.514134:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572309.514140:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006af8f87f/0xdb7edb52b8334c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.514157:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006af8f87f/0xdb7edb52b8334c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.514168:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006af8f87f/0xdb7edb52b8334c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.514182:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006af8f87f/0xdb7edb52b8334c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.514207:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572309.514406:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449639080704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 362us (600us total) trans 4294968652 rc 0/0 00000100:00100000:3.0:1788572309.514413:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00010000:00010000:1.0:1788572309.515641:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572309.515654:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006af8f87f/0xdb7edb52b8334c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.515667:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572309.515672:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006af8f87f/0xdb7edb52b8334c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.515683:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006af8f87f/0xdb7edb52b8334c76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.515703:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006af8f87f/0xdb7edb52b8334c76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.515710:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006af8f87f/0xdb7edb52b8334c76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.515799:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572309.515802:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572309.515803:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572309.515819:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639080832:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572309.515879:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572309.515918:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639080448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572309.515943:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572309.515965:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639081344:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572309.515986:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572309.516066:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639080960:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572309.516105:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639080448 00000100:00100000:0.0:1788572309.516111:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639080448 00000100:00100000:0.0:1788572309.516202:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842 00000100:00100000:0.0:1788572309.516209:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3650:x1875449639080448:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1788572309.516216:0:10546:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788572309.516252:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3650:x1875449639080448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (307us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788572309.516258:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842 00000100:00100000:0.0:1788572309.516285:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639081088:0@lo:6:osp-syn-1-0.0 00000100:02020000:1.0:1788572309.530179:0:3650:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788572309.530188:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572309.530200:0:3650:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572309.530206:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1788572309.530219:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1788572309.530222:0:3650:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572309.530226:0:3650:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4125 00000100:00080000:1.0:1788572309.530236:0:3650:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94e640d5d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572309.530271:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e63778c700 x1875449639082752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572309.530310:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639082752:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:1.0:1788572309.530384:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572309.530764:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639080832 00000100:00100000:2.0:1788572309.530771:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639080832 00000100:00100000:2.0:1788572309.531092:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639081344 00000100:00100000:2.0:1788572309.531098:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639081344 00000100:00100000:2.0:1788572309.531121:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:2.0:1788572309.531131:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449639080832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572309.531170:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2642 count 1 00002000:00010000:2.0:1788572309.531218:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572309.531226:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac34f86e/0xdb7edb52b8334c7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531240:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa52:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:2.0:1788572309.531244:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572309.531250:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac34f86e/0xdb7edb52b8334c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531265:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac34f86e/0xdb7edb52b8334c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531276:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac34f86e/0xdb7edb52b8334c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531289:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac34f86e/0xdb7edb52b8334c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531306:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572309.531463:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449639080832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 332us (15583us total) trans 4294968653 rc 0/0 00000100:00100000:2.0:1788572309.531470:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00100000:2.0:1788572309.531488:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:2.0:1788572309.531495:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449639081344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572309.531507:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2645 count 1 00002000:00010000:2.0:1788572309.531522:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572309.531527:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334c84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531535:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa55:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:2.0:1788572309.531538:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572309.531542:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531551:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531559:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531569:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531598:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572309.531609:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572309.531615:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac34f86e/0xdb7edb52b8334c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531622:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572309.531626:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac34f86e/0xdb7edb52b8334c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531636:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac34f86e/0xdb7edb52b8334c7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531653:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac34f86e/0xdb7edb52b8334c7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531662:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac34f86e/0xdb7edb52b8334c7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531679:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572309.531682:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531694:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572309.531697:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531704:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334c84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531713:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334c84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531720:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334c84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.531729:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572309.531731:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572309.531732:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572309.531797:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449639081344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 302us (15809us total) trans 4294968654 rc 0/0 00000100:00100000:2.0:1788572309.531803:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:2.0:1788572309.531856:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639081216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572309.531887:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572309.531908:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639081728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572309.531925:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572309.531939:0:3653:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff94e6377d2680 x1875449639082240/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572309.531972:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968651 gen 3 00000004:00080000:2.0:1788572309.531976:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47100, transno 4294968477 00000004:00080000:2.0:1788572309.531984:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3f800, transno 4294968478 00000004:00080000:2.0:1788572309.531987:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe45500, transno 4294968479 00000004:00080000:2.0:1788572309.531989:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3e680, transno 4294968480 00000004:00080000:2.0:1788572309.531992:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3c700, transno 4294968481 00000004:00080000:2.0:1788572309.531995:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46300, transno 4294968482 00000004:00080000:2.0:1788572309.531997:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3e300, transno 4294968483 00000004:00080000:2.0:1788572309.531999:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe45880, transno 4294968484 00000004:00080000:2.0:1788572309.532030:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3c000, transno 4294968485 00000004:00080000:2.0:1788572309.532033:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3ca80, transno 4294968486 00000004:00080000:2.0:1788572309.532035:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b2aa00, transno 4294968487 00000004:00080000:2.0:1788572309.532038:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b28e00, transno 4294968488 00000004:00080000:2.0:1788572309.532041:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b29f80, transno 4294968489 00000004:00080000:2.0:1788572309.532043:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b29500, transno 4294968490 00000004:00080000:2.0:1788572309.532045:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b2a300, transno 4294968491 00000004:00080000:2.0:1788572309.532047:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5063a9880, transno 4294968492 00000004:00080000:2.0:1788572309.532050:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e573b80, transno 4294968493 00000004:00080000:2.0:1788572309.532052:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d1f80, transno 4294968494 00000004:00080000:2.0:1788572309.532054:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e573800, transno 4294968495 00000004:00080000:2.0:1788572309.532057:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d3100, transno 4294968496 00000004:00080000:2.0:1788572309.532059:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d1500, transno 4294968497 00000004:00080000:2.0:1788572309.532061:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d2d80, transno 4294968498 00000004:00080000:2.0:1788572309.532063:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d2300, transno 4294968499 00000004:00080000:2.0:1788572309.532065:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d0a80, transno 4294968500 00000004:00080000:2.0:1788572309.532068:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d1880, transno 4294968501 00000004:00080000:2.0:1788572309.532070:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d0000, transno 4294968502 00000004:00080000:2.0:1788572309.532072:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d0e00, transno 4294968503 00000004:00080000:2.0:1788572309.532074:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4000, transno 4294968504 00000004:00080000:2.0:1788572309.532077:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633dfc000, transno 4294968505 00000004:00080000:2.0:1788572309.532079:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633dfe680, transno 4294968506 00000004:00080000:2.0:1788572309.532082:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633dfd880, transno 4294968507 00000004:00080000:2.0:1788572309.532084:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5c00, transno 4294968508 00000004:00080000:2.0:1788572309.532087:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329dc00, transno 4294968509 00000004:00080000:2.0:1788572309.532089:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329f800, transno 4294968510 00000004:00080000:2.0:1788572309.532091:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633dfca80, transno 4294968511 00000004:00080000:2.0:1788572309.532094:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329ce00, transno 4294968512 00000004:00080000:2.0:1788572309.532096:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db2680, transno 4294968513 00000004:00080000:2.0:1788572309.532098:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 4294968514 00000004:00080000:2.0:1788572309.532100:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329c380, transno 4294968515 00000004:00080000:2.0:1788572309.532103:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db1880, transno 4294968516 00000004:00080000:2.0:1788572309.532105:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6d80, transno 4294968517 00000004:00080000:2.0:1788572309.532107:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5880, transno 4294968518 00000004:00080000:2.0:1788572309.532109:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6680, transno 4294968519 00000004:00080000:2.0:1788572309.532111:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac6d80, transno 4294968520 00000004:00080000:2.0:1788572309.532114:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633dffb80, transno 4294968521 00000004:00080000:2.0:1788572309.532116:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329e300, transno 4294968522 00000004:00080000:2.0:1788572309.532119:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329f480, transno 4294968523 00000004:00080000:2.0:1788572309.532122:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4700, transno 4294968524 00000004:00080000:2.0:1788572309.532124:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fcdb100, transno 4294968525 00000004:00080000:2.0:1788572309.532127:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503932d80, transno 4294968526 00000004:00080000:2.0:1788572309.532129:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503932a00, transno 4294968527 00000004:00080000:2.0:1788572309.532131:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503933b80, transno 4294968528 00000004:00080000:2.0:1788572309.532133:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931f80, transno 4294968529 00000004:00080000:2.0:1788572309.532136:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931180, transno 4294968530 00000004:00080000:2.0:1788572309.532138:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503930380, transno 4294968531 00000004:00080000:2.0:1788572309.532153:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503933480, transno 4294968532 00000004:00080000:2.0:1788572309.532156:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931880, transno 4294968533 00000004:00080000:2.0:1788572309.532159:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503930a80, transno 4294968534 00000004:00080000:2.0:1788572309.532161:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57ce00, transno 4294968535 00000004:00080000:2.0:1788572309.532164:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57f100, transno 4294968536 00000004:00080000:2.0:1788572309.532166:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff5180, transno 4294968537 00000004:00080000:2.0:1788572309.532169:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d2f1c00, transno 4294968538 00000004:00080000:2.0:1788572309.532171:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d2f3480, transno 4294968539 00000004:00080000:2.0:1788572309.532173:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3b80, transno 4294968540 00000004:00080000:2.0:1788572309.532176:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b3b80, transno 4294968541 00000004:00080000:2.0:1788572309.532178:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0700, transno 4294968542 00000004:00080000:2.0:1788572309.532180:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b1880, transno 4294968543 00000004:00080000:2.0:1788572309.532183:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778ea00, transno 4294968544 00000004:00080000:2.0:1788572309.532185:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778d500, transno 4294968545 00000004:00080000:2.0:1788572309.532188:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618492300, transno 4294968546 00000004:00080000:2.0:1788572309.532190:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490a80, transno 4294968547 00000004:00080000:2.0:1788572309.532192:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b1f80, transno 4294968548 00000004:00080000:2.0:1788572309.532195:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778c380, transno 4294968549 00000004:00080000:2.0:1788572309.532197:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493b80, transno 4294968550 00000004:00080000:2.0:1788572309.532199:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b1180, transno 4294968551 00000004:00080000:2.0:1788572309.532202:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb2d80, transno 4294968552 00000004:00080000:2.0:1788572309.532205:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289880, transno 4294968553 00000004:00080000:2.0:1788572309.532207:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778df80, transno 4294968554 00000004:00080000:2.0:1788572309.532209:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493100, transno 4294968555 00000004:00080000:2.0:1788572309.532211:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289500, transno 4294968556 00000004:00080000:2.0:1788572309.532214:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288700, transno 4294968557 00000004:00080000:2.0:1788572309.532216:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28a680, transno 4294968558 00000004:00080000:2.0:1788572309.532218:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288000, transno 4294968559 00000004:00080000:2.0:1788572309.532221:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288380, transno 4294968560 00000004:00080000:2.0:1788572309.532223:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a5c00, transno 4294968561 00000004:00080000:2.0:1788572309.532225:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a7480, transno 4294968562 00000004:00080000:2.0:1788572309.532227:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28bb80, transno 4294968563 00000004:00080000:2.0:1788572309.532230:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a7100, transno 4294968564 00000004:00080000:2.0:1788572309.532232:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63c504e00, transno 4294968565 00000004:00080000:2.0:1788572309.532234:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289f80, transno 4294968566 00000004:00080000:2.0:1788572309.532237:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a6a00, transno 4294968567 00000004:00080000:2.0:1788572309.532239:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a4700, transno 4294968568 00000004:00080000:2.0:1788572309.532241:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e635f80, transno 4294968569 00000004:00080000:2.0:1788572309.532244:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e634700, transno 4294968570 00000004:00080000:2.0:1788572309.532246:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e634e00, transno 4294968571 00000004:00080000:2.0:1788572309.532248:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e635c00, transno 4294968572 00000004:00080000:2.0:1788572309.532250:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e637800, transno 4294968573 00000004:00080000:2.0:1788572309.532252:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634be9c00, transno 4294968574 00000004:00080000:2.0:1788572309.532255:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329d500, transno 4294968575 00000004:00080000:2.0:1788572309.532257:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e636680, transno 4294968576 00000004:00080000:2.0:1788572309.532260:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634be8a80, transno 4294968577 00000004:00080000:2.0:1788572309.532262:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633dfdf80, transno 4294968578 00000004:00080000:2.0:1788572309.532264:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329c000, transno 4294968579 00000004:00080000:2.0:1788572309.532267:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e635880, transno 4294968580 00000004:00080000:2.0:1788572309.532269:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634bea300, transno 4294968581 00000004:00080000:2.0:1788572309.532272:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50329d180, transno 4294968582 00000004:00080000:2.0:1788572309.532274:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d4b0380, transno 4294968583 00000004:00080000:2.0:1788572309.532277:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c0000, transno 4294968584 00000004:00080000:2.0:1788572309.532279:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c1180, transno 4294968585 00000004:00080000:2.0:1788572309.532282:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d4b1500, transno 4294968586 00000004:00080000:2.0:1788572309.532284:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c2d80, transno 4294968587 00000004:00080000:2.0:1788572309.532287:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618432680, transno 4294968588 00000004:00080000:2.0:1788572309.532289:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e635500, transno 4294968589 00000004:00080000:2.0:1788572309.532291:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e634a80, transno 4294968590 00000004:00080000:2.0:1788572309.532293:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a4a80, transno 4294968591 00000004:00080000:2.0:1788572309.532295:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c3100, transno 4294968592 00000004:00080000:2.0:1788572309.532297:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e502d5ed80, transno 4294968593 00000004:00080000:2.0:1788572309.532300:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618430000, transno 4294968594 00000004:00080000:2.0:1788572309.532302:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63c506680, transno 4294968595 00000004:00080000:2.0:1788572309.532305:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798a80, transno 4294968596 00000004:00080000:2.0:1788572309.532307:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799f80, transno 4294968597 00000004:00080000:2.0:1788572309.532309:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c0700, transno 4294968598 00000004:00080000:2.0:1788572309.532311:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798e00, transno 4294968599 00000004:00080000:2.0:1788572309.532313:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641694700, transno 4294968600 00000004:00080000:2.0:1788572309.532315:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e760000, transno 4294968601 00000004:00080000:2.0:1788572309.532318:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552d880, transno 4294968602 00000004:00080000:2.0:1788572309.532320:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618430700, transno 4294968603 00000004:00080000:2.0:1788572309.532322:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e502d5f100, transno 4294968604 00000004:00080000:2.0:1788572309.532325:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799180, transno 4294968605 00000004:00080000:2.0:1788572309.532337:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c2a00, transno 4294968606 00000004:00080000:2.0:1788572309.532340:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779bb80, transno 4294968607 00000004:00080000:2.0:1788572309.532343:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798380, transno 4294968608 00000004:00080000:2.0:1788572309.532345:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57fb80, transno 4294968609 00000004:00080000:2.0:1788572309.532347:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506553b80, transno 4294968610 00000004:00080000:2.0:1788572309.532349:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798700, transno 4294968611 00000004:00080000:2.0:1788572309.532352:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3d180, transno 4294968612 00000004:00080000:2.0:1788572309.532354:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3fb80, transno 4294968613 00000004:00080000:2.0:1788572309.532357:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3ea00, transno 4294968614 00000004:00080000:2.0:1788572309.532359:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3dc00, transno 4294968615 00000004:00080000:2.0:1788572309.532362:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3df80, transno 4294968616 00000004:00080000:2.0:1788572309.532364:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3ed80, transno 4294968617 00000004:00080000:2.0:1788572309.532366:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57f480, transno 4294968618 00000004:00080000:2.0:1788572309.532369:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3f480, transno 4294968619 00000004:00080000:2.0:1788572309.532371:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3d880, transno 4294968620 00000004:00080000:2.0:1788572309.532373:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3f100, transno 4294968621 00000004:00080000:2.0:1788572309.532375:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3ce00, transno 4294968622 00000004:00080000:2.0:1788572309.532378:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778ce00, transno 4294968623 00000004:00080000:2.0:1788572309.532381:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778f480, transno 4294968624 00000004:00080000:2.0:1788572309.532383:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac7800, transno 4294968625 00000004:00080000:2.0:1788572309.532386:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173d500, transno 4294968626 00000004:00080000:2.0:1788572309.532389:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778fb80, transno 4294968627 00000004:00080000:2.0:1788572309.532391:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d2f0e00, transno 4294968628 00000004:00080000:2.0:1788572309.532393:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b5880, transno 4294968629 00000004:00080000:2.0:1788572309.532396:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b4000, transno 4294968630 00000004:00080000:2.0:1788572309.532398:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28b100, transno 4294968631 00000004:00080000:2.0:1788572309.532400:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289180, transno 4294968632 00000004:00080000:2.0:1788572309.532402:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779b800, transno 4294968633 00000004:00080000:2.0:1788572309.532405:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779aa00, transno 4294968634 00000004:00080000:2.0:1788572309.532407:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6b480, transno 4294968635 00000004:00080000:2.0:1788572309.532409:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779a680, transno 4294968636 00000004:00080000:2.0:1788572309.532411:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289c00, transno 4294968637 00000004:00080000:2.0:1788572309.532414:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e762a00, transno 4294968638 00000004:00080000:2.0:1788572309.532417:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6131cd880, transno 4294968639 00000004:00080000:2.0:1788572309.532419:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff1500, transno 4294968640 00000004:00080000:2.0:1788572309.532421:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798000, transno 4294968641 00000004:00080000:2.0:1788572309.532424:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28a300, transno 4294968642 00000004:00080000:2.0:1788572309.532426:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6131cdc00, transno 4294968643 00000004:00080000:2.0:1788572309.532428:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b6a00, transno 4294968644 00000004:00080000:2.0:1788572309.532430:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6131cc380, transno 4294968645 00000004:00080000:2.0:1788572309.532432:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b6680, transno 4294968646 00000004:00080000:2.0:1788572309.532435:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6131cd180, transno 4294968647 00000004:00080000:2.0:1788572309.532437:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57dc00, transno 4294968648 00000004:00080000:2.0:1788572309.532439:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57e680, transno 4294968649 00000004:00080000:2.0:1788572309.532441:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac7100, transno 4294968650 00000004:00080000:2.0:1788572309.532443:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57df80, transno 4294968651 00000100:00100000:2.0:1788572309.532448:0:3653:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e61e634380 x1875449639080704/t4294968652(4294968652) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572325 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788572309.532463:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e634380/2, rc 0, transno 4294968652 00000100:00100000:2.0:1788572309.532469:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639080704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572309.532540:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00080000:2.0:1788572309.532548:0:3653:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff94e63aeb0700 x1875449639082112/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572309.532556:0:3653:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff94e637592d80 x1875449639082624/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572309.532590:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639081216 00000100:00100000:2.0:1788572309.532595:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639081216 00000100:00100000:2.0:1788572309.532624:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639081728 00000100:00100000:2.0:1788572309.532627:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639081728 00000100:00100000:2.0:1788572309.532641:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1788572309.532647:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+9:3653:x1875449639081216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572309.532665:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2644 count 1 00002000:00010000:2.0:1788572309.532685:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572309.532691:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000477478ed/0xdb7edb52b8334c8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.532702:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa54:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:2.0:1788572309.532705:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572309.532710:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000477478ed/0xdb7edb52b8334c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.532721:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000477478ed/0xdb7edb52b8334c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.532734:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000477478ed/0xdb7edb52b8334c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.532741:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000477478ed/0xdb7edb52b8334c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.532756:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572309.532857:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+10:3653:x1875449639081216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 208us (968us total) trans 4294968655 rc 0/0 00000100:00100000:2.0:1788572309.532864:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1788572309.532877:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1788572309.532883:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+9:3653:x1875449639081728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572309.532894:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2648 count 1 00002000:00010000:2.0:1788572309.532906:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572309.532912:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334c92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.532920:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa58:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:2.0:1788572309.532923:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572309.532927:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.532936:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.532950:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.532957:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.532971:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572309.533043:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+10:3653:x1875449639081728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 160us (1116us total) trans 4294968656 rc 0/0 00000100:00100000:2.0:1788572309.533049:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00010000:00010000:2.0:1788572309.533067:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572309.533072:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000477478ed/0xdb7edb52b8334c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.533079:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572309.533083:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000477478ed/0xdb7edb52b8334c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.533092:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000477478ed/0xdb7edb52b8334c8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.533105:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000477478ed/0xdb7edb52b8334c8b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.533113:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000477478ed/0xdb7edb52b8334c8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.533130:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572309.533134:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.533140:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572309.533144:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.533152:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334c92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.533161:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334c92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.533169:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a1f53ed/0xdb7edb52b8334c92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.533178:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572309.533180:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572309.533181:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572309.533207:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637715500/2, rc 0, transno 4294968655 00000100:00100000:2.0:1788572309.533212:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639081216:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572309.533219:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13b80/2, rc 0, transno 4294968656 00000100:00100000:2.0:1788572309.533222:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639081728:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572309.533240:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572309.533263:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788572309.533961:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 17 changes, 8 in progress, 5 in flight, 175 done 00000100:00100000:2.0:1788572309.535083:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639082880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572309.535403:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639082752 00000100:00100000:1.0:1788572309.535411:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639082752 00000100:00100000:1.0:1788572309.535442:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:1.0:1788572309.535449:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3649:x1875449639082752:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:1.0:1788572309.535472:0:12091:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572309.535519:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3649:x1875449639082752:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 70us (5134us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572309.535526:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00010000:00010000:1.0:1788572309.535553:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572309.535566:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572309.535608:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639081600:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572309.535630:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572309.535655:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639081088 00000100:00100000:1.0:1788572309.535659:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639081088 00000100:00100000:1.0:1788572309.535688:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639081600 00000100:00100000:1.0:1788572309.535692:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639081600 00000100:00100000:1.0:1788572309.535708:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:1.0:1788572309.535714:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449639081088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572309.535737:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2643 count 1 00002000:00010000:1.0:1788572309.535769:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572309.535777:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.535793:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa53:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:1.0:1788572309.535797:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572309.535936:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.535954:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.535964:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.535972:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.535988:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572309.536168:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3652:x1875449639081088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 454us (600us total) trans 4294968657 rc 0/0 00000100:00100000:1.0:1788572309.536175:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:1.0:1788572309.536316:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:1.0:1788572309.536339:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+11:3652:x1875449639081600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572309.536354:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2647 count 1 00002000:00010000:1.0:1788572309.536370:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572309.536375:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334ca0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536384:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa57:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:1.0:1788572309.536388:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572309.536392:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536405:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536414:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536421:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536437:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572309.536500:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3652:x1875449639081600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 176us (868us total) trans 4294968658 rc 0/0 00000100:00100000:1.0:1788572309.536507:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00080000:1.0:1788572309.536546:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572309.536551:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572309.536555:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639082752:0@lo:8:ptlrpcd_00_00.0 00010000:00010000:1.0:1788572309.536655:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572309.536662:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536670:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572309.536674:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536687:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536702:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536710:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334c99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536729:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572309.536733:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536739:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572309.536742:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536750:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334ca0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536759:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334ca0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536766:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e50ced0/0xdb7edb52b8334ca0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.536782:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572309.536784:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572309.536786:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572309.536916:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572309.536948:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572309.536968:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639081472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572309.536994:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572309.537035:0:3651:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff94e63aeb0a80 x1875449639081984/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572309.537047:0:3651:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff94e63779b100 x1875449639082496/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572309.537057:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639083136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572309.537079:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572309.537098:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572309.537104:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639083008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572309.537123:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572309.537162:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639082880 00000100:00100000:2.0:1788572309.537167:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639082880 00000004:00080000:1.0:1788572309.537348:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637717100/2, rc 0, transno 4294968657 00000100:00100000:1.0:1788572309.537363:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639081088:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572309.537378:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc13100/2, rc 0, transno 4294968658 00000100:00100000:1.0:1788572309.537381:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639081600:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788572309.537394:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572309.537423:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639080960 00000100:00100000:2.0:1788572309.537428:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639080960 00000100:00100000:1.0:1788572309.537462:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639081472 00000100:00100000:1.0:1788572309.537466:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639081472 00000100:00100000:1.0:1788572309.537487:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639083136 00000100:00100000:1.0:1788572309.537490:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639083136 00000100:00100000:1.0:1788572309.537504:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639083008 00000100:00100000:1.0:1788572309.537507:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639083008 00000100:00100000:1.0:1788572309.537525:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:1.0:1788572309.537532:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3653:x1875449639082880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572309.537552:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2649 count 1 00002000:00010000:1.0:1788572309.537573:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572309.537651:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334ca7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.537663:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa59:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:1.0:1788572309.537667:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572309.537672:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.537689:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.537698:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.537706:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.537723:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572309.537906:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3653:x1875449639082880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 373us (989us total) trans 4294968659 rc 0/0 00000100:00100000:1.0:1788572309.537914:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00100000:1.0:1788572309.537930:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:1.0:1788572309.537934:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3651:x1875449639080960:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788572309.537939:0:43965:0:(tgt_handler.c:807:tgt_request_handle()) operation 6 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788572309.537972:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3651:x1875449639080960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36us (1022us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788572309.537978:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00100000:1.0:1788572309.538118:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:1.0:1788572309.538126:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3651:x1875449639081472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572309.538139:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2646 count 1 00000100:00100000:3.0:1788572309.538408:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1788572309.538419:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3651:x1875449639083136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572309.538432:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2651 count 1 00002000:00010000:3.0:1788572309.538454:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572309.538460:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b29c1c14/0xdb7edb52b8334cae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538470:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5b:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:3.0:1788572309.538473:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572309.538478:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b29c1c14/0xdb7edb52b8334cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538488:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b29c1c14/0xdb7edb52b8334cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538497:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b29c1c14/0xdb7edb52b8334cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538511:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b29c1c14/0xdb7edb52b8334cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538528:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572309.538627:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3651:x1875449639083136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 211us (1546us total) trans 4294968660 rc 0/0 00000100:00100000:3.0:1788572309.538634:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1788572309.538648:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:3.0:1788572309.538655:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3651:x1875449639083008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572309.538667:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2650 count 1 00002000:00010000:3.0:1788572309.538681:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572309.538686:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce165227/0xdb7edb52b8334cb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538693:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5a:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:3.0:1788572309.538696:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572309.538700:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce165227/0xdb7edb52b8334cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538709:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce165227/0xdb7edb52b8334cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538716:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce165227/0xdb7edb52b8334cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538727:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce165227/0xdb7edb52b8334cb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538742:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788572309.538816:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637593b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3651:x1875449639083008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 161us (1691us total) trans 4294968661 rc 0/0 00000100:00100000:3.0:1788572309.538822:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00010000:00010000:3.0:1788572309.538852:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572309.538858:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538866:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572309.538870:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538878:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334ca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538893:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334ca7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538901:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a625287/0xdb7edb52b8334ca7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538922:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572309.538925:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b29c1c14/0xdb7edb52b8334cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538931:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572309.538934:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b29c1c14/0xdb7edb52b8334cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538941:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b29c1c14/0xdb7edb52b8334cae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538949:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b29c1c14/0xdb7edb52b8334cae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538955:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b29c1c14/0xdb7edb52b8334cae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538969:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572309.538972:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce165227/0xdb7edb52b8334cb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538978:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572309.538982:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce165227/0xdb7edb52b8334cb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.538989:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce165227/0xdb7edb52b8334cb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.539030:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce165227/0xdb7edb52b8334cb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.539038:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce165227/0xdb7edb52b8334cb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.539049:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572309.539051:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572309.539052:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572309.539058:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572309.539121:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637591180/2, rc 0, transno 4294968659 00000100:00100000:3.0:1788572309.539128:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639082880:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572309.539186:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572309.539483:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639083392:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.539519:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572309.539545:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572309.539551:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639083264:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.539583:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572309.539631:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637590000/2, rc 0, transno 4294968661 00000100:00100000:3.0:1788572309.539640:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639083008:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572309.539651:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637593100/2, rc 0, transno 4294968660 00000100:00100000:3.0:1788572309.539654:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639083136:0@lo:6:osp-syn-1-0.0 00000100:02020000:3.0:1788572309.539665:0:3651:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788572309.539671:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788572309.539676:0:3651:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff94e640d5d800 already not connected (conn 2, was 1): DISCONN 00000100:00100000:3.0:1788572309.539685:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572309.539690:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639083520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.539715:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572309.539771:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639083648:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.539792:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572309.539957:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572309.539963:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639083776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.539984:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1788572309.540204:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572309.540211:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334cbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.540224:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa56:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:1.0:1788572309.540227:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572309.540233:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.540245:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.540254:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.540261:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334cbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572309.540275:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572309.540415:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3651:x1875449639081472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2290us (3419us total) trans 4294968662 rc 0/0 00000100:00100000:1.0:1788572309.540424:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000004:00080000:3.0:1788572309.540524:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637714000/2, rc 0, transno 4294968662 00000100:00100000:3.0:1788572309.540533:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639081472:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.540570:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639083904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.540606:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572309.540837:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639083392 00000100:00100000:0.0:1788572309.540846:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639083392 00000100:00100000:0.0:1788572309.540899:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639083264 00000100:00100000:0.0:1788572309.540904:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639083264 00000100:00100000:0.0:1788572309.540922:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639083520 00000100:00100000:0.0:1788572309.540925:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639083520 00000100:00100000:0.0:1788572309.540940:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639083648 00000100:00100000:0.0:1788572309.540943:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639083648 00000100:00100000:0.0:1788572309.540956:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639083776 00000100:00100000:0.0:1788572309.540958:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639083776 00000100:00100000:0.0:1788572309.540975:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:0.0:1788572309.540983:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3653:x1875449639083392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572309.541030:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2653 count 1 00002000:00010000:0.0:1788572309.541052:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572309.541058:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069eea793/0xdb7edb52b8334cc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541069:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5d:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:0.0:1788572309.541073:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572309.541079:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069eea793/0xdb7edb52b8334cc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541091:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069eea793/0xdb7edb52b8334cc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541099:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069eea793/0xdb7edb52b8334cc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541105:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069eea793/0xdb7edb52b8334cc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541120:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572309.541232:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3653:x1875449639083392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 249us (1712us total) trans 4294968663 rc 0/0 00000100:00100000:0.0:1788572309.541239:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00100000:0.0:1788572309.541255:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:0.0:1788572309.541261:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3653:x1875449639083264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572309.541272:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2652 count 1 00002000:00010000:0.0:1788572309.541286:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572309.541291:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2edf29b/0xdb7edb52b8334cca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541299:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5c:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:0.0:1788572309.541302:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572309.541305:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2edf29b/0xdb7edb52b8334cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541314:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2edf29b/0xdb7edb52b8334cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541322:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2edf29b/0xdb7edb52b8334cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541339:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2edf29b/0xdb7edb52b8334cca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541354:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788572309.541413:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3653:x1875449639083264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 152us (1838us total) trans 4294968664 rc 0/0 00000100:00100000:0.0:1788572309.541423:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00100000:0.0:1788572309.541435:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:0.0:1788572309.541442:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3651:x1875449639083520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572309.541454:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2654 count 1 00002000:00010000:0.0:1788572309.541468:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572309.541472:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d91469/0xdb7edb52b8334cd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541480:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5e:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:0.0:1788572309.541483:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572309.541487:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093d91469/0xdb7edb52b8334cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541496:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093d91469/0xdb7edb52b8334cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541503:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d91469/0xdb7edb52b8334cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541510:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093d91469/0xdb7edb52b8334cd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.541525:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788572309.542025:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3651:x1875449639083520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 560us (2285us total) trans 4294968665 rc 0/0 00000100:00100000:0.0:1788572309.542034:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00100000:0.0:1788572309.542052:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:0.0:1788572309.542061:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3651:x1875449639083648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572309.542074:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2655 count 1 00002000:00010000:0.0:1788572309.542089:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572309.542095:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000646423d7/0xdb7edb52b8334cd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542103:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5f:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:0.0:1788572309.542106:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572309.542110:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000646423d7/0xdb7edb52b8334cd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542120:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000646423d7/0xdb7edb52b8334cd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542128:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000646423d7/0xdb7edb52b8334cd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542135:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000646423d7/0xdb7edb52b8334cd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542148:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1788572309.542223:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3651:x1875449639083648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 164us (2429us total) trans 4294968666 rc 0/0 00000100:00100000:0.0:1788572309.542229:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:0.0:1788572309.542241:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:0.0:1788572309.542248:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3653:x1875449639083776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572309.542260:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2656 count 1 00002000:00010000:0.0:1788572309.542273:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572309.542278:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334cdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542286:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa60:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:0.0:1788572309.542289:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572309.542293:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542302:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542310:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542317:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542324:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1788572309.542394:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3653:x1875449639083776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 147us (2409us total) trans 4294968667 rc 0/0 00000100:00100000:0.0:1788572309.542401:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00010000:00010000:0.0:1788572309.542431:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788572309.542439:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334cbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542452:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572309.542455:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334cbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542465:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334cbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542482:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334cbc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542489:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096e2070b/0xdb7edb52b8334cbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542512:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572309.542516:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069eea793/0xdb7edb52b8334cc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542522:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572309.542525:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069eea793/0xdb7edb52b8334cc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542533:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069eea793/0xdb7edb52b8334cc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542542:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069eea793/0xdb7edb52b8334cc3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542550:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069eea793/0xdb7edb52b8334cc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542563:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572309.542566:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2edf29b/0xdb7edb52b8334cca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542572:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572309.542575:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2edf29b/0xdb7edb52b8334cca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542713:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2edf29b/0xdb7edb52b8334cca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542724:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2edf29b/0xdb7edb52b8334cca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542733:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2edf29b/0xdb7edb52b8334cca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542747:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572309.542750:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093d91469/0xdb7edb52b8334cd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542756:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572309.542760:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d91469/0xdb7edb52b8334cd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542766:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d91469/0xdb7edb52b8334cd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542774:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093d91469/0xdb7edb52b8334cd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542779:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093d91469/0xdb7edb52b8334cd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542789:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572309.542792:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000646423d7/0xdb7edb52b8334cd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542797:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572309.542800:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000646423d7/0xdb7edb52b8334cd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542806:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000646423d7/0xdb7edb52b8334cd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542815:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000646423d7/0xdb7edb52b8334cd8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542822:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000646423d7/0xdb7edb52b8334cd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542833:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572309.542837:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542844:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572309.542847:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542855:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334cdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542864:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334cdf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542870:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334cdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.542881:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572309.542883:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572309.542885:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572309.542893:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572309.542899:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572309.542939:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412c1500/2, rc 0, transno 4294968666 00000100:00100000:0.0:1788572309.542958:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639083648:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572309.542970:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fcd8a80/2, rc 0, transno 4294968665 00000100:00100000:0.0:1788572309.542973:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639083520:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572309.543071:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639084160:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1788572309.543159:0:3650:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff94e63aeb1180 x1875449639081856/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572309.543171:0:3650:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff94e6411eb100 x1875449639082368/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788572309.543614:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637715880/2, rc 0, transno 4294968654 00000100:00100000:0.0:1788572309.543626:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639081344:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572309.543662:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639084288:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572309.543702:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e636d80/2, rc 0, transno 4294968653 00000100:00100000:0.0:1788572309.543710:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639080832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572309.543748:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639084032:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788572309.543797:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572309.543819:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572309.544593:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572309.544620:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572309.544629:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639084416:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.544658:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572309.544687:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639083904 00000100:00100000:3.0:1788572309.544694:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639083904 00000100:00100000:3.0:1788572309.544733:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639084288 00000100:00100000:3.0:1788572309.544736:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639084288 00000100:00100000:3.0:1788572309.544749:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639084416 00000100:00100000:3.0:1788572309.544752:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639084416 00000100:00100000:3.0:1788572309.544768:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:3.0:1788572309.544777:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3653:x1875449639083904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572309.544804:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2657 count 1 00002000:00010000:3.0:1788572309.544838:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572309.544847:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000668d057/0xdb7edb52b8334ce6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.544860:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa61:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:3.0:1788572309.544865:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572309.544871:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000668d057/0xdb7edb52b8334ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.544885:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000668d057/0xdb7edb52b8334ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.544895:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000668d057/0xdb7edb52b8334ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.544903:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000668d057/0xdb7edb52b8334ce6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.544921:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572309.545094:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3653:x1875449639083904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 318us (4486us total) trans 4294968668 rc 0/0 00000100:00100000:3.0:1788572309.545101:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:3.0:1788572309.545120:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:3.0:1788572309.545127:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3652:x1875449639084288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572309.545140:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2660 count 1 00002000:00010000:3.0:1788572309.545156:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572309.545161:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af980809/0xdb7edb52b8334ced lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545175:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa64:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:3.0:1788572309.545178:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572309.545182:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af980809/0xdb7edb52b8334ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545192:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af980809/0xdb7edb52b8334ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545213:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af980809/0xdb7edb52b8334ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545222:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af980809/0xdb7edb52b8334ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545237:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572309.545302:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3652:x1875449639084288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 175us (712us total) trans 4294968669 rc 0/0 00000100:00100000:3.0:1788572309.545309:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:3.0:1788572309.545322:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:3.0:1788572309.545342:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3652:x1875449639084416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572309.545355:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2661 count 1 00002000:00010000:3.0:1788572309.545369:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572309.545374:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbaae513/0xdb7edb52b8334cf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545387:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa65:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:3.0:1788572309.545390:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572309.545394:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbaae513/0xdb7edb52b8334cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545404:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbaae513/0xdb7edb52b8334cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545412:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbaae513/0xdb7edb52b8334cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545420:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbaae513/0xdb7edb52b8334cf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545436:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788572309.545497:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3652:x1875449639084416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 169us (837us total) trans 4294968670 rc 0/0 00000100:00100000:3.0:1788572309.545503:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00010000:00010000:3.0:1788572309.545530:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572309.545537:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000668d057/0xdb7edb52b8334ce6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545544:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572309.545549:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000668d057/0xdb7edb52b8334ce6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545565:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000668d057/0xdb7edb52b8334ce6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545584:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000668d057/0xdb7edb52b8334ce6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545592:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000668d057/0xdb7edb52b8334ce6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545614:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572309.545618:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af980809/0xdb7edb52b8334ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545624:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572309.545627:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af980809/0xdb7edb52b8334ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545635:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af980809/0xdb7edb52b8334ced lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545644:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af980809/0xdb7edb52b8334ced lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545651:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af980809/0xdb7edb52b8334ced lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545668:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572309.545671:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbaae513/0xdb7edb52b8334cf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545677:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572309.545680:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbaae513/0xdb7edb52b8334cf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545688:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbaae513/0xdb7edb52b8334cf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545697:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbaae513/0xdb7edb52b8334cf4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545704:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbaae513/0xdb7edb52b8334cf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545714:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572309.545716:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572309.545717:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572309.545723:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572309.545750:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12300/2, rc 0, transno 4294968670 00000100:00100000:3.0:1788572309.545762:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639084416:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572309.545773:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc10000/2, rc 0, transno 4294968669 00000100:00100000:3.0:1788572309.545776:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639084288:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572309.545789:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572309.545800:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572309.545833:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639084160 00000100:00100000:3.0:1788572309.545837:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639084160 00000100:00100000:3.0:1788572309.545861:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:3.0:1788572309.545868:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3651:x1875449639084160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572309.545879:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2659 count 1 00002000:00010000:3.0:1788572309.545893:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572309.545897:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cceadee8/0xdb7edb52b8334cfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545906:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa63:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:3.0:1788572309.545909:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572309.545914:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cceadee8/0xdb7edb52b8334cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545923:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cceadee8/0xdb7edb52b8334cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545931:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cceadee8/0xdb7edb52b8334cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545938:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cceadee8/0xdb7edb52b8334cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.545952:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572309.546048:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3651:x1875449639084160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 180us (247us total) trans 4294968671 rc 0/0 00000100:00100000:3.0:1788572309.546055:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00010000:00010000:3.0:1788572309.546070:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572309.546075:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cceadee8/0xdb7edb52b8334cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546082:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572309.546086:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cceadee8/0xdb7edb52b8334cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546094:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cceadee8/0xdb7edb52b8334cfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546106:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cceadee8/0xdb7edb52b8334cfb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546113:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cceadee8/0xdb7edb52b8334cfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546128:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572309.546130:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572309.546131:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572309.546148:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc12a00/2, rc 0, transno 4294968671 00000100:00100000:3.0:1788572309.546153:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639084160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.546226:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639084800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.546255:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572309.546281:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639084672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.546304:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572309.546323:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572309.546344:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639084544:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.546367:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572309.546393:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639084800 00000100:00100000:3.0:1788572309.546397:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639084800 00000100:00100000:3.0:1788572309.546420:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639084672 00000100:00100000:3.0:1788572309.546422:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639084672 00000100:00100000:3.0:1788572309.546437:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639084544 00000100:00100000:3.0:1788572309.546439:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639084544 00000100:00100000:3.0:1788572309.546453:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:3.0:1788572309.546459:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+27:3652:x1875449639084800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572309.546471:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2664 count 1 00002000:00010000:3.0:1788572309.546486:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572309.546491:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5898262/0xdb7edb52b8334d02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546499:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa68:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:3.0:1788572309.546503:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572309.546507:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5898262/0xdb7edb52b8334d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546516:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5898262/0xdb7edb52b8334d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546524:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5898262/0xdb7edb52b8334d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546537:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5898262/0xdb7edb52b8334d02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546551:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572309.546616:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+28:3652:x1875449639084800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 157us (360us total) trans 4294968672 rc 0/0 00000100:00100000:3.0:1788572309.546623:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:3.0:1788572309.546635:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:3.0:1788572309.546640:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449639084672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572309.546651:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2663 count 1 00002000:00010000:3.0:1788572309.546664:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572309.546669:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb97bff/0xdb7edb52b8334d09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546677:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa67:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:3.0:1788572309.546680:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572309.546684:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bb97bff/0xdb7edb52b8334d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546693:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bb97bff/0xdb7edb52b8334d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546700:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb97bff/0xdb7edb52b8334d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546713:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bb97bff/0xdb7edb52b8334d09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546725:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572309.546784:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+28:3651:x1875449639084672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 143us (479us total) trans 4294968673 rc 0/0 00000100:00100000:3.0:1788572309.546789:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:3.0:1788572309.546800:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:3.0:1788572309.546806:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449639084544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572309.546817:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2662 count 1 00002000:00010000:3.0:1788572309.546830:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572309.546835:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015eeb359/0xdb7edb52b8334d10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546843:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa66:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:3.0:1788572309.546846:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572309.546850:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015eeb359/0xdb7edb52b8334d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546859:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015eeb359/0xdb7edb52b8334d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546867:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015eeb359/0xdb7edb52b8334d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546880:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015eeb359/0xdb7edb52b8334d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546893:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788572309.546948:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+28:3651:x1875449639084544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 142us (580us total) trans 4294968674 rc 0/0 00000100:00100000:3.0:1788572309.546955:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00010000:00010000:3.0:1788572309.546982:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572309.546987:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5898262/0xdb7edb52b8334d02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.546994:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572309.546997:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5898262/0xdb7edb52b8334d02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547032:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5898262/0xdb7edb52b8334d02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547045:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5898262/0xdb7edb52b8334d02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547053:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5898262/0xdb7edb52b8334d02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547069:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572309.547073:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bb97bff/0xdb7edb52b8334d09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547079:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572309.547082:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb97bff/0xdb7edb52b8334d09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547089:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb97bff/0xdb7edb52b8334d09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547099:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bb97bff/0xdb7edb52b8334d09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547106:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bb97bff/0xdb7edb52b8334d09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547117:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572309.547120:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015eeb359/0xdb7edb52b8334d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547126:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572309.547128:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015eeb359/0xdb7edb52b8334d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547135:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015eeb359/0xdb7edb52b8334d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547147:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015eeb359/0xdb7edb52b8334d10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547154:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015eeb359/0xdb7edb52b8334d10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572309.547166:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572309.547167:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572309.547169:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572309.547196:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6184d5180/2, rc 0, transno 4294968672 00000100:00100000:3.0:1788572309.547206:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639084800:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572309.547217:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572309.547221:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572309.547234:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6184d7100/2, rc 0, transno 4294968674 00000100:00100000:3.0:1788572309.547238:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639084544:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572309.547245:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6184d5c00/2, rc 0, transno 4294968673 00000100:00100000:3.0:1788572309.547249:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639084672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.547314:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572309.547322:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639084928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572309.547940:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572309.548044:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639084032 00000100:00100000:0.0:1788572309.548051:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639084032 00000100:00100000:0.0:1788572309.548090:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:0.0:1788572309.548098:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+28:3650:x1875449639084032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572309.548117:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2658 count 1 00002000:00010000:0.0:1788572309.548140:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572309.548146:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334d17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.548156:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa62:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:0.0:1788572309.548160:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572309.548165:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.548175:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.548182:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.548201:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334d17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.548219:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572309.548327:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+29:3650:x1875449639084032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 229us (386us total) trans 4294968675 rc 0/0 00000100:00100000:0.0:1788572309.548344:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00010000:00010000:0.0:1788572309.548365:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572309.548371:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334d17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.548379:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572309.548382:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334d17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.548390:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334d17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.548408:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334d17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.548416:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b838c4b/0xdb7edb52b8334d17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.548431:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572309.548433:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572309.548435:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572309.548568:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc11880/2, rc 0, transno 4294968675 00000100:00100000:1.0:1788572309.548574:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639084032:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572309.548741:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412c0000/2, rc 0, transno 4294968668 00000100:00100000:2.0:1788572309.548747:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639083904:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572309.548756:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412c0380/2, rc 0, transno 4294968667 00000100:00100000:2.0:1788572309.548760:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639083776:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572309.548772:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fcd9c00/2, rc 0, transno 4294968664 00000100:00100000:2.0:1788572309.548774:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639083264:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572309.548783:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fcd8000/2, rc 0, transno 4294968663 00000100:00100000:2.0:1788572309.548786:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639083392:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572309.548878:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572309.551445:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639084928 00000100:00100000:1.0:1788572309.551464:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639084928 00000100:00100000:2.0:1788572309.551780:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:2.0:1788572309.551791:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3652:x1875449639084928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572309.551826:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2665 count 1 00002000:00010000:2.0:1788572309.551862:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572309.551871:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334d1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.551888:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa69:0x0].0x0 since=4226s v=(0 0) 00010000:00010000:2.0:1788572309.551894:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572309.551901:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.551916:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.551927:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.551935:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572309.551963:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788572309.552325:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633db3800/2, rc 0, transno 4294968676 00000100:00100000:1.0:1788572309.552345:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639084928:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572309.552394:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3652:x1875449639084928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 605us (3515us total) trans 4294968676 rc 0/0 00000100:00100000:2.0:1788572309.552404:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00010000:00010000:0.0:1788572309.552494:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572309.552501:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.552511:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572309.552515:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.552525:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334d1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.552544:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334d1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.552553:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074deb35d/0xdb7edb52b8334d1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572309.552579:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572309.552582:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572309.552583:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572310.020907:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572310.020954:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639085056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572310.021095:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572310.021517:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639085056 00000100:00100000:2.0:1788572310.021527:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639085056 00000100:00100000:2.0:1788572310.021587:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843 00000100:00100000:2.0:1788572310.021607:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+30:3651:x1875449639085056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572310.021828:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572310.021895:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+30:3651:x1875449639085056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 289us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572310.021902:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843 00000100:00100000:0.0:1788572310.022363:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639085056:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572310.217418:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572310.531647:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639085184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572310.531737:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572310.532080:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639085184 00000100:00100000:3.0:1788572310.532091:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639085184 00000100:00100000:3.0:1788572310.532153:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:3.0:1788572310.532161:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3651:x1875449639085184:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:3.0:1788572310.532170:0:10546:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788572310.532220:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3651:x1875449639085184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (483us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788572310.532228:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00000100:02020000:3.0:1788572310.532267:0:3651:0:(client.c:1505:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788572310.532273:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788572310.532277:0:3651:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788572310.532281:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1788572310.532291:0:3651:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:3.0:1788572310.532293:0:3651:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572310.532297:0:3651:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 484 00000100:00080000:3.0:1788572310.532303:0:3651:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff94e501c62000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788572310.532326:0:3651:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e633db2300 x1875449639085312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572310.533493:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639085312:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:1.0:1788572310.533552:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572310.533819:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639085312 00000100:00100000:3.0:1788572310.533843:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639085312 00000100:00100000:3.0:1788572310.533882:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:3.0:1788572310.533889:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3649:x1875449639085312:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:3.0:1788572310.533911:0:43967:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572310.533956:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3649:x1875449639085312:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 65us (403us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572310.533963:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00080000:1.0:1788572310.534593:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572310.534599:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572310.534604:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639085312:0@lo:8:ptlrpcd_00_01.0 00000100:00080000:1.0:1788572311.043242:0:38320:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572311.043250:0:38320:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788572311.043253:0:38320:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572311.043261:0:38320:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4227 00000100:00080000:1.0:1788572311.043267:0:38320:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572311.043273:0:38320:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff94e501c62000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572311.043295:0:38320:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e63778df80 x1875449639085824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572311.043338:0:38320:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572311.043342:0:38320:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788572311.043344:0:38320:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572311.043348:0:38320:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4226 00000100:00080000:1.0:1788572311.043351:0:38320:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788572311.043355:0:38320:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94e640d5d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572311.043366:0:38320:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b3b80 x1875449639086464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572311.043419:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639085824:0@lo:8:kworker.0 00000100:00100000:0.0:1788572311.043604:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639085696:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.043707:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.043753:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639085696 00000100:00100000:0.0:1788572311.043761:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639085696 00000100:00100000:0.0:1788572311.043817:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4517 00000100:00100000:0.0:1788572311.043827:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639085696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.043875:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639085696:12345-0@lo:400:kworker.0 Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.043883:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4517 00000100:00100000:0.0:1788572311.043956:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639085696:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.043964:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639086336:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.044032:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.044058:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639086336 00000100:00100000:0.0:1788572311.044062:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639086336 00000100:00100000:0.0:1788572311.044091:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722 00000100:00100000:0.0:1788572311.044098:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639086336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.044129:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639086336:12345-0@lo:400:kworker.0 Request processed in 32us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.044134:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722 00000100:00100000:0.0:1788572311.044161:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639086336:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.044187:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788572311.044193:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639085952:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.044216:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.044237:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639085952 00000100:00100000:0.0:1788572311.044240:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639085952 00000100:00100000:0.0:1788572311.044271:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4518 00000100:00100000:0.0:1788572311.044278:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639085952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.044307:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639085952:12345-0@lo:400:kworker.0 Request processed in 30us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.044313:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4518 00000100:00100000:0.0:1788572311.044340:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639085952:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.044345:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639086592:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.044379:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572311.044616:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572311.044642:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639086464:0@lo:8:kworker.0 00000100:00100000:1.0:1788572311.044665:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572311.044744:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639086592 00000100:00100000:0.0:1788572311.044748:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639086592 00000100:00100000:0.0:1788572311.044786:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639085824 00000100:00100000:0.0:1788572311.044790:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639085824 00000100:00100000:0.0:1788572311.044802:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639086464 00000100:00100000:0.0:1788572311.044805:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639086464 00000100:00100000:0.0:1788572311.044817:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3687 00000100:00100000:0.0:1788572311.044824:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+30:3650:x1875449639086592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.044862:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+30:3650:x1875449639086592:12345-0@lo:400:kworker.0 Request processed in 39us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.044868:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3687 00000100:00100000:0.0:1788572311.044880:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1788572311.044884:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3649:x1875449639085824:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572311.044904:0:43972:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572311.044936:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3649:x1875449639085824:12345-0@lo:8:kworker.0 Request processed in 51us (320us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572311.044942:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1788572311.044953:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:0.0:1788572311.044956:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3649:x1875449639086464:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572311.044965:0:43972:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572311.044988:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3649:x1875449639086464:12345-0@lo:8:kworker.0 Request processed in 30us (322us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572311.044993:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:0.0:1788572311.045042:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639086592:0@lo:400:kworker.0 00000100:00080000:2.0:1788572311.045214:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572311.045220:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572311.045232:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639085568:0@lo:400:kworker.0 00000100:00100000:2.0:1788572311.045261:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572311.045300:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639086208:0@lo:400:kworker.0 00000100:00100000:2.0:1788572311.045321:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572311.045343:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788572311.045350:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639085440:0@lo:400:kworker.0 00000100:00100000:2.0:1788572311.045387:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572311.045411:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639085440 00000100:00100000:2.0:1788572311.045415:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639085440 00000100:00100000:2.0:1788572311.045443:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788572311.045449:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+21:3653:x1875449639085440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572311.045587:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+21:3653:x1875449639085440:12345-0@lo:400:kworker.0 Request processed in 137us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572311.045594:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788572311.045640:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639085440:0@lo:400:kworker.0 00000100:00100000:2.0:1788572311.045647:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639086080:0@lo:400:kworker.0 00000100:00100000:2.0:1788572311.045669:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572311.045685:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639086720:0@lo:400:kworker.0 00000100:00100000:2.0:1788572311.045705:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572311.045795:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639086208 00000100:00100000:1.0:1788572311.045800:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639086208 00000100:00100000:1.0:1788572311.045842:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3688 00000100:00100000:1.0:1788572311.045848:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639086208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572311.045886:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639086208:12345-0@lo:400:kworker.0 Request processed in 38us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572311.045892:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3688 00000100:00100000:1.0:1788572311.045911:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639086080 00000100:00100000:1.0:1788572311.045915:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639086080 00000100:00100000:1.0:1788572311.045941:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639086720 00000100:00100000:1.0:1788572311.045944:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639086720 00000100:00100000:1.0:1788572311.045963:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4519 00000100:00100000:1.0:1788572311.045969:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639086080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572311.045999:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639086080:12345-0@lo:400:kworker.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572311.046028:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4519 00000100:00100000:1.0:1788572311.046040:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4520 00000100:00100000:1.0:1788572311.046046:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639086720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572311.046074:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639086720:12345-0@lo:400:kworker.0 Request processed in 29us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572311.046080:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4520 00000100:00080000:1.0:1788572311.046119:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572311.046137:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572311.046140:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639085824:0@lo:8:kworker.0 00000100:00080000:1.0:1788572311.046154:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572311.046157:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572311.046160:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639086464:0@lo:8:kworker.0 00000100:00080000:2.0:1788572311.048245:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572311.048259:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572311.048316:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639086080:0@lo:400:kworker.0 00000100:00100000:2.0:1788572311.048335:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639086720:0@lo:400:kworker.0 00000100:00100000:2.0:1788572311.048350:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639086208:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.049096:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639085568 00000100:00100000:0.0:1788572311.049105:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639085568 00000100:00100000:0.0:1788572311.049173:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00100000:0.0:1788572311.049184:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639085568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.049259:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639085568:12345-0@lo:400:kworker.0 Request processed in 77us (3996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.049267:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00100000:2.0:1788572311.049396:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639086848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572311.049436:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572311.050829:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639085568:0@lo:400:kworker.0 00000100:00100000:0.0:1788572311.051099:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639086848 00000100:00100000:0.0:1788572311.051106:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639086848 00000100:00100000:0.0:1788572311.051174:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:0.0:1788572311.051182:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639086848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572311.051219:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572311.051292:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639086848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.051299:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00100000:3.0:1788572311.051440:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639086848:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788572311.235593:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572311.466776:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572311.466955:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572311.466993:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572311.467044:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616090112 00000100:00100000:0.0:1788572311.467054:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572311.467054:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616090112 00000100:00100000:0.0:1788572311.467093:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616090368 00000100:00100000:0.0:1788572311.467097:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616090368 00000100:00100000:3.0:1788572311.467117:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 111 00000100:00100000:3.0:1788572311.467127:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616090112:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572311.467144:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616090240 00000100:00100000:0.0:1788572311.467147:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616090240 00000100:00100000:0.0:1788572311.467167:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4521 00000100:00100000:0.0:1788572311.467173:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616090368:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572311.467190:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616090112:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 65us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572311.467198:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 111 00000100:00100000:0.0:1788572311.467199:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616090368:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.467204:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4521 00000100:00100000:0.0:1788572311.467216:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4522 00000100:00100000:0.0:1788572311.467221:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2386:x1875449616090240:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572311.467242:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2386:x1875449616090240:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 21us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572311.467248:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4522 00000100:00080000:0.0:1788572311.467262:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572311.467266:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572311.469258:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616090496 00000100:00100000:2.0:1788572311.469272:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616090496 00000100:00100000:2.0:1788572311.469358:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3817 00000100:00100000:2.0:1788572311.469365:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2382:x1875449616090496:12345-192.168.202.13@tcp:8:kworker.0 00010000:00020000:2.0:1788572311.469401:0:43964:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572311.469473:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2382:x1875449616090496:12345-192.168.202.13@tcp:8:kworker.0 Request processed in 106us (2708us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572311.469481:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3817 00000100:00100000:3.0:1788572311.555486:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572311.555512:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639086976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572311.555585:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572311.555725:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639086976 00000100:00100000:2.0:1788572311.555737:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639086976 00000100:00100000:2.0:1788572311.555804:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845 00000100:00100000:2.0:1788572311.555814:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639086976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572311.555844:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572311.555897:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639086976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572311.555904:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845 00000100:00100000:3.0:1788572311.556056:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639086976:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572312.263912:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572313.283179:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572314.307857:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572314.628678:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572314.628702:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639087104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572314.628774:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572314.628995:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639087104 00000100:00100000:1.0:1788572314.629030:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639087104 00000100:00100000:1.0:1788572314.629079:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:1.0:1788572314.629089:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639087104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572314.629124:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:1.0:1788572314.629183:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639087104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572314.629191:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00100000:2.0:1788572314.629237:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639087104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572315.143447:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572315.143472:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639087232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572315.143554:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572315.143598:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639087232 00000100:00100000:3.0:1788572315.143608:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639087232 00000100:00100000:3.0:1788572315.143665:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846 00000100:00100000:3.0:1788572315.143675:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+30:3653:x1875449639087232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572315.143709:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572315.143750:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+30:3653:x1875449639087232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572315.143756:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846 00000100:00100000:3.0:1788572315.143801:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639087232:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788572315.143929:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788572315.151910:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968676 is committed 00010000:00010000:3.0:1788572315.331797:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572316.163591:0:38320:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572316.163600:0:38320:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572316.163604:0:38320:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572316.163613:0:38320:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4228 00000100:00080000:2.0:1788572316.163619:0:38320:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788572316.163627:0:38320:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff94e501c62000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572316.163648:0:38320:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e60fe45500 x1875449639087872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572316.163683:0:38320:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572316.163686:0:38320:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572316.163688:0:38320:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572316.163692:0:38320:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4228 00000100:00080000:2.0:1788572316.163695:0:38320:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788572316.163699:0:38320:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94e640d5d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572316.163710:0:38320:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e634b29f80 x1875449639088512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572316.163841:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639087360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572316.163913:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572316.163986:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639088000:0@lo:400:kworker.0 00000100:00100000:3.0:1788572316.164033:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572316.164057:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639088640:0@lo:400:kworker.0 00000100:00100000:3.0:1788572316.164081:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572316.164107:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788572316.164113:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639087744:0@lo:400:kworker.0 00000100:00100000:3.0:1788572316.164135:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572316.164150:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639088384:0@lo:400:kworker.0 00000100:00100000:3.0:1788572316.164170:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572316.164309:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639087360 00000100:00100000:2.0:1788572316.164317:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639087360 00000100:00100000:2.0:1788572316.164365:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639088384 00000100:00100000:2.0:1788572316.164368:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639088384 00000100:00100000:2.0:1788572316.164389:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00100000:2.0:1788572316.164397:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449639087360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572316.164430:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572316.164474:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449639087360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572316.164481:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00100000:2.0:1788572316.164497:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00100000:2.0:1788572316.164503:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639088384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572316.164553:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639088384:12345-0@lo:400:kworker.0 Request processed in 41us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572316.164560:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000100:00100000:1.0:1788572316.164915:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639088000 00000100:00100000:1.0:1788572316.164920:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639088000 00000100:00100000:1.0:1788572316.164969:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639087744 00000100:00100000:1.0:1788572316.164973:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639087744 00000100:00100000:1.0:1788572316.164993:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4523 00000100:00100000:1.0:1788572316.164999:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639088000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.165058:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639088000:12345-0@lo:400:kworker.0 Request processed in 60us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572316.165064:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4523 00000100:00100000:1.0:1788572316.165076:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4524 00000100:00100000:1.0:1788572316.165082:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639087744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.165108:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639087744:12345-0@lo:400:kworker.0 Request processed in 26us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572316.165113:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4524 00000100:00100000:1.0:1788572316.165141:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639087872:0@lo:8:kworker.0 00000100:00100000:1.0:1788572316.165169:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572316.165194:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639088512:0@lo:8:kworker.0 00000100:00100000:1.0:1788572316.165214:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572316.165243:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639088640 00000100:00100000:1.0:1788572316.165246:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639088640 00000100:00100000:1.0:1788572316.165270:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639087872 00000100:00100000:1.0:1788572316.165273:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639087872 00000100:00100000:1.0:1788572316.165285:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639088512 00000100:00100000:1.0:1788572316.165287:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639088512 00000100:00100000:1.0:1788572316.165299:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3689 00000100:00100000:1.0:1788572316.165305:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639088640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.165336:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639088640:12345-0@lo:400:kworker.0 Request processed in 31us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572316.165341:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3689 00000100:00100000:1.0:1788572316.165351:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:1.0:1788572316.165356:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3649:x1875449639087872:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788572316.165373:0:8663:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572316.165404:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3649:x1875449639087872:12345-0@lo:8:kworker.0 Request processed in 47us (233us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572316.165410:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:1.0:1788572316.165421:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:1.0:1788572316.165425:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3649:x1875449639088512:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788572316.165435:0:8663:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572316.165460:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3649:x1875449639088512:12345-0@lo:8:kworker.0 Request processed in 33us (245us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572316.165466:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00080000:1.0:1788572316.165498:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572316.165503:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572316.165519:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639087872:0@lo:8:kworker.0 00000100:00080000:1.0:1788572316.165532:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572316.165535:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572316.165538:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639088512:0@lo:8:kworker.0 00000100:00100000:1.0:1788572316.165579:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639087488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.165608:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572316.165631:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639088128:0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.165653:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572316.165670:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639088768:0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.165690:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572316.165712:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788572316.165718:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639087616:0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.165740:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572316.165754:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639088256:0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.165778:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572316.165801:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639087488 00000100:00100000:1.0:1788572316.165804:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639087488 00000100:00100000:1.0:1788572316.165979:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788572316.165986:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+21:3650:x1875449639087488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.166049:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+21:3650:x1875449639087488:12345-0@lo:400:kworker.0 Request processed in 64us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572316.166055:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788572316.166081:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639088128 00000100:00100000:1.0:1788572316.166084:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639088128 00000100:00100000:1.0:1788572316.166108:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639088768 00000100:00100000:1.0:1788572316.166111:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639088768 00000100:00100000:1.0:1788572316.166128:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4525 00000100:00100000:1.0:1788572316.166134:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639088128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.166163:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639088128:12345-0@lo:400:kworker.0 Request processed in 30us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572316.166169:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4525 00000100:00100000:1.0:1788572316.166179:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4526 00000100:00100000:1.0:1788572316.166184:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639088768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.166208:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639088768:12345-0@lo:400:kworker.0 Request processed in 24us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572316.166213:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4526 00000100:00100000:1.0:1788572316.166243:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639087488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.166255:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639088128:0@lo:400:kworker.0 00000100:00100000:1.0:1788572316.166263:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639088768:0@lo:400:kworker.0 00000100:00100000:3.0:1788572316.166354:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639088256 00000100:00100000:3.0:1788572316.166358:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639088256 00000100:00100000:3.0:1788572316.166393:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3690 00000100:00100000:3.0:1788572316.166400:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639088256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572316.166441:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639088256:12345-0@lo:400:kworker.0 Request processed in 42us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572316.166447:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690 00000100:00100000:3.0:1788572316.166566:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639087616 00000100:00100000:3.0:1788572316.166571:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639087616 00000100:00100000:3.0:1788572316.166594:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:3.0:1788572316.166601:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639087616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572316.166631:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639087616:12345-0@lo:400:kworker.0 Request processed in 30us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572316.166636:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:3.0:1788572316.166666:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639087744:0@lo:400:kworker.0 00000100:00100000:3.0:1788572316.166677:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639088384:0@lo:400:kworker.0 00000100:00100000:3.0:1788572316.166692:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639087360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572316.166702:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639088000:0@lo:400:kworker.0 00000100:00100000:3.0:1788572316.166710:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968676 gen 3 00000004:00080000:3.0:1788572316.166715:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e634380, transno 4294968652 00000004:00080000:3.0:1788572316.166723:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e636d80, transno 4294968653 00000004:00080000:3.0:1788572316.166726:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637715880, transno 4294968654 00000004:00080000:3.0:1788572316.166729:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637715500, transno 4294968655 00000004:00080000:3.0:1788572316.166731:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13b80, transno 4294968656 00000004:00080000:3.0:1788572316.166734:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637717100, transno 4294968657 00000004:00080000:3.0:1788572316.166736:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13100, transno 4294968658 00000004:00080000:3.0:1788572316.166738:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637591180, transno 4294968659 00000004:00080000:3.0:1788572316.166741:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637593100, transno 4294968660 00000004:00080000:3.0:1788572316.166743:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637590000, transno 4294968661 00000004:00080000:3.0:1788572316.166746:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637714000, transno 4294968662 00000004:00080000:3.0:1788572316.166748:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fcd8000, transno 4294968663 00000004:00080000:3.0:1788572316.166751:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fcd9c00, transno 4294968664 00000004:00080000:3.0:1788572316.166753:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fcd8a80, transno 4294968665 00000004:00080000:3.0:1788572316.166756:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c1500, transno 4294968666 00000004:00080000:3.0:1788572316.166758:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0380, transno 4294968667 00000004:00080000:3.0:1788572316.166761:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0000, transno 4294968668 00000004:00080000:3.0:1788572316.166763:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10000, transno 4294968669 00000004:00080000:3.0:1788572316.166765:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12300, transno 4294968670 00000004:00080000:3.0:1788572316.166767:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12a00, transno 4294968671 00000004:00080000:3.0:1788572316.166769:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d5180, transno 4294968672 00000004:00080000:3.0:1788572316.166772:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d5c00, transno 4294968673 00000004:00080000:3.0:1788572316.166775:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d7100, transno 4294968674 00000004:00080000:3.0:1788572316.166777:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11880, transno 4294968675 00000004:00080000:3.0:1788572316.166779:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 4294968676 00000100:00100000:3.0:1788572316.166784:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639088640:0@lo:400:kworker.0 00000004:00080000:3.0:1788572316.166983:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 25 done 00000100:00100000:3.0:1788572316.167037:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639087616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572316.167049:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639088256:0@lo:400:kworker.0 00000100:00080000:2.0:1788572316.167432:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572316.167437:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572316.167439:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788572316.360777:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572316.588261:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572316.588311:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572316.588385:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616091008 00000100:00100000:3.0:1788572316.588406:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616091008 00000100:00100000:3.0:1788572316.588456:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3820 00000100:00100000:3.0:1788572316.588464:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2382:x1875449616091008:12345-192.168.202.13@tcp:8:kworker.0 00010000:00020000:3.0:1788572316.588491:0:43972:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572316.588965:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2382:x1875449616091008:12345-192.168.202.13@tcp:8:kworker.0 Request processed in 498us (712us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572316.588974:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3820 00000100:00100000:1.0:1788572316.589867:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616090752 00000100:00100000:1.0:1788572316.589876:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616090752 00000100:00100000:1.0:1788572316.589953:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4527 00000100:00100000:1.0:1788572316.589962:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2385:x1875449616090752:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572316.590060:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2385:x1875449616090752:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 99us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572316.590067:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4527 00000100:00080000:2.0:1788572316.590287:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572316.604073:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572316.604114:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572316.604191:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616090624 00000100:00100000:2.0:1788572316.604202:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616090624 00000100:00100000:2.0:1788572316.604255:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 113 00000100:00100000:2.0:1788572316.604264:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616090624:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572316.604336:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616090624:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572316.604343:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 113 00000100:00100000:1.0:1788572316.604786:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616090880 00000100:00100000:1.0:1788572316.604792:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616090880 00000100:00100000:1.0:1788572316.604864:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4528 00000100:00100000:1.0:1788572316.604872:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616090880:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572316.604920:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616090880:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 49us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572316.604926:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4528 00000100:00080000:2.0:1788572316.605102:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572316.675349:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639088896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572316.675443:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572316.675606:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639088896 00000100:00100000:2.0:1788572316.675614:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639088896 00000100:00100000:2.0:1788572316.675674:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:2.0:1788572316.675684:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639088896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572316.675713:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572316.676534:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639088896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 836us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572316.676544:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00100000:0.0:1788572316.676694:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639088896:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572317.379580:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572318.404051:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572319.428936:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572319.753065:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639089024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572319.753137:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572319.753206:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639089024 00000100:00100000:2.0:1788572319.753214:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639089024 00000100:00100000:2.0:1788572319.753258:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00100000:2.0:1788572319.753267:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639089024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572319.753357:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:2.0:1788572319.753400:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639089024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572319.753407:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00100000:2.0:1788572319.753451:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639089024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572320.259197:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639089152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572320.259277:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572320.259369:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639089152 00000100:00100000:2.0:1788572320.259379:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639089152 00000100:00100000:2.0:1788572320.259435:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:2.0:1788572320.259441:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639089152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572320.259466:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788572320.259547:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572320.261218:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639089152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1770us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572320.261228:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00100000:0.0:1788572320.261413:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639089152:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572320.451206:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572321.284308:0:38320:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572321.284314:0:38320:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572321.284318:0:38320:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572321.284326:0:38320:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4233 00000100:00080000:2.0:1788572321.284333:0:38320:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788572321.284340:0:38320:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff94e501c62000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572321.284379:0:38320:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e634b29f80 x1875449639089664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572321.284417:0:38320:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572321.284420:0:38320:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788572321.284422:0:38320:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572321.284426:0:38320:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4233 00000100:00080000:2.0:1788572321.284429:0:38320:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788572321.284433:0:38320:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94e640d5d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572321.284443:0:38320:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6377d1f80 x1875449639090304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572321.284496:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639089408:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.284571:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572321.284620:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639090048:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.284643:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572321.284684:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788572321.284690:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639089280:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.284720:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572321.284744:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639089920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.284767:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572321.284780:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639090560:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.284799:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572321.284822:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639089536:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.284844:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572321.284859:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639090176:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.284877:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572321.284892:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572321.284898:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639089792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.284919:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572321.284936:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639090432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.284954:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572321.284992:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639089408 00000100:00100000:2.0:1788572321.285000:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639089408 00000100:00100000:2.0:1788572321.286639:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639090176 00000100:00100000:2.0:1788572321.286663:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639090176 00000100:00100000:2.0:1788572321.286706:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730 00000100:00100000:2.0:1788572321.286718:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639089408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.286808:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639089408:12345-0@lo:400:kworker.0 Request processed in 93us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572321.286816:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730 00000100:00100000:2.0:1788572321.286832:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:2.0:1788572321.286839:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639090176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.286870:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639090176:12345-0@lo:400:kworker.0 Request processed in 32us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572321.286876:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:2.0:1788572321.286900:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639089280 00000100:00100000:2.0:1788572321.286904:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639089280 00000100:00100000:2.0:1788572321.286931:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788572321.286936:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+21:3651:x1875449639089280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.286967:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+21:3651:x1875449639089280:12345-0@lo:400:kworker.0 Request processed in 30us (2245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572321.286973:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788572321.287022:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639089920 00000100:00100000:2.0:1788572321.287026:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639089920 00000100:00100000:1.0:1788572321.288658:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639089664:0@lo:8:kworker.0 00000100:00100000:1.0:1788572321.288724:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572321.288755:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639090304:0@lo:8:kworker.0 00000100:00100000:1.0:1788572321.288774:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572321.288807:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639090048 00000100:00100000:1.0:1788572321.288813:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639090048 00000100:00100000:0.0:1788572321.288845:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639090432 00000100:00100000:0.0:1788572321.288848:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639090432 00000100:00100000:0.0:1788572321.288886:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639089664 00000100:00100000:0.0:1788572321.288889:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639089664 00000100:00100000:0.0:1788572321.288903:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639090304 00000100:00100000:0.0:1788572321.288905:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639090304 00000100:00100000:0.0:1788572321.288919:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3691 00000100:00100000:0.0:1788572321.288927:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639090432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572321.288976:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639090432:12345-0@lo:400:kworker.0 Request processed in 49us (4020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572321.288986:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3691 00000100:00100000:0.0:1788572321.289001:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:0.0:1788572321.289031:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3649:x1875449639089664:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572321.289063:0:17011:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572321.289092:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3649:x1875449639089664:12345-0@lo:8:kworker.0 Request processed in 60us (369us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572321.289099:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00100000:0.0:1788572321.289108:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:0.0:1788572321.289112:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3649:x1875449639090304:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572321.289121:0:17011:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572321.289138:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3649:x1875449639090304:12345-0@lo:8:kworker.0 Request processed in 25us (363us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572321.289143:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:2.0:1788572321.293821:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639090560 00000100:00100000:2.0:1788572321.293831:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639090560 00000100:00100000:2.0:1788572321.293848:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639089536 00000100:00100000:2.0:1788572321.293849:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639089536 00000100:00100000:2.0:1788572321.293856:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639089792 00000100:00100000:2.0:1788572321.293858:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639089792 00000100:00100000:1.0:1788572321.303081:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3692 00000100:00100000:1.0:1788572321.303099:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639090048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572321.303197:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639090048:12345-0@lo:400:kworker.0 Request processed in 104us (18552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572321.303205:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3692 00000100:00100000:1.0:1788572321.303235:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4529 00000100:00100000:1.0:1788572321.303244:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639089920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572321.303277:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639089920:12345-0@lo:400:kworker.0 Request processed in 35us (18509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572321.303284:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4529 00000100:00100000:1.0:1788572321.303300:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4530 00000100:00100000:1.0:1788572321.303307:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639090560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572321.303348:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639090560:12345-0@lo:400:kworker.0 Request processed in 41us (18547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572321.303355:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4530 00000100:00100000:1.0:1788572321.303513:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4531 00000100:00100000:1.0:1788572321.303520:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639089536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572321.303563:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639089536:12345-0@lo:400:kworker.0 Request processed in 44us (18718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572321.303569:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4531 00000100:00080000:1.0:1788572321.303680:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572321.303685:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572321.303690:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639089664:0@lo:8:kworker.0 00000100:00080000:1.0:1788572321.303705:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572321.303708:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572321.303711:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639090304:0@lo:8:kworker.0 00000100:00100000:1.0:1788572321.303751:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572321.303761:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639090688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572321.303796:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572321.303831:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639090688 00000100:00100000:1.0:1788572321.303837:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639090688 00000100:00100000:1.0:1788572321.303866:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:1.0:1788572321.303872:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639090688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572321.303897:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572321.303954:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639090688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572321.303960:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:1.0:1788572321.303990:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639090688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572321.318120:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4532 00000100:00100000:2.0:1788572321.318141:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639089792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.318241:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639089792:12345-0@lo:400:kworker.0 Request processed in 109us (33320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572321.318248:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4532 00000100:00080000:2.0:1788572321.318280:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572321.318287:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572321.318290:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572321.318356:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639089792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.318383:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639090432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.318398:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639089536:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.318410:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639090176:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.318454:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639089280:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.318471:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639089920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.318483:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639090560:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.318495:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639089408:0@lo:400:kworker.0 00000100:00100000:2.0:1788572321.318518:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639090048:0@lo:400:kworker.0 00010000:00010000:3.0:1788572321.489901:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572321.715877:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572321.715915:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572321.715936:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572321.716000:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572321.716042:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616091392 00000100:00100000:1.0:1788572321.716051:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616091392 00000100:00100000:1.0:1788572321.716101:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616091264 00000100:00100000:1.0:1788572321.716103:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616091264 00000100:00100000:1.0:1788572321.716122:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4533 00000100:00100000:1.0:1788572321.716131:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616091392:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572321.716200:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616091392:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 70us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572321.716207:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4533 00000100:00100000:1.0:1788572321.716224:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4534 00000100:00100000:1.0:1788572321.716229:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616091264:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572321.716247:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616091264:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 18us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572321.716253:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4534 00000100:00100000:1.0:1788572321.716267:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616091520 00000100:00100000:1.0:1788572321.716270:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616091520 00000100:00100000:1.0:1788572321.716287:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3823 00000100:00100000:1.0:1788572321.716291:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2382:x1875449616091520:12345-192.168.202.13@tcp:8:kworker.0 00010000:00020000:1.0:1788572321.716309:0:8663:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572321.716329:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2382:x1875449616091520:12345-192.168.202.13@tcp:8:kworker.0 Request processed in 37us (392us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572321.716335:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3823 00000100:00080000:1.0:1788572321.718362:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572321.718372:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572321.718391:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616091136 00000100:00100000:1.0:1788572321.718400:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616091136 00000100:00100000:1.0:1788572321.718452:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 115 00000100:00100000:1.0:1788572321.718461:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616091136:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572321.718531:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616091136:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 71us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572321.718538:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 115 00000100:00100000:0.0:1788572321.812937:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639090816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572321.813029:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572321.813056:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639090816 00000100:00100000:1.0:1788572321.813064:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639090816 00000100:00100000:1.0:1788572321.813160:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:1.0:1788572321.813171:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639090816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572321.813194:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572321.813244:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639090816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572321.813251:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00100000:0.0:1788572321.819766:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639090816:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788572322.504384:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572323.523853:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572324.548185:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572324.867660:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572324.867686:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639090944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572324.867767:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572324.867831:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639090944 00000100:00100000:2.0:1788572324.867839:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639090944 00000100:00100000:2.0:1788572324.867885:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733 00000100:00100000:2.0:1788572324.867894:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639090944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572324.867926:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:2.0:1788572324.867970:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639090944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572324.867978:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733 00000100:00100000:2.0:1788572324.868040:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639090944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572325.392080:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572325.392104:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639091072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572325.392175:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572325.392300:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639091072 00000100:00100000:3.0:1788572325.392308:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639091072 00000100:00100000:3.0:1788572325.392367:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850 00000100:00100000:3.0:1788572325.392377:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639091072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572325.392407:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572325.392457:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639091072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572325.392465:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850 00000100:00100000:3.0:1788572325.392517:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639091072:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788572325.392741:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572325.572078:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572326.404242:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639091200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572326.404328:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572326.404432:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639091200 00000100:00100000:3.0:1788572326.404440:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639091200 00000100:00100000:3.0:1788572326.404498:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734 00000100:00100000:3.0:1788572326.404508:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639091200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572326.404542:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572326.404593:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639091200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572326.404601:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734 00000100:00100000:3.0:1788572326.404647:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639091200:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788572326.405218:0:38320:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572326.405223:0:38320:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788572326.405227:0:38320:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572326.405233:0:38320:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4238 00000100:00080000:1.0:1788572326.405237:0:38320:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572326.405242:0:38320:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff94e501c62000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572326.405260:0:38320:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e634b2aa00 x1875449639091712/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572326.405290:0:38320:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572326.405293:0:38320:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788572326.405296:0:38320:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572326.405299:0:38320:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4238 00000100:00080000:1.0:1788572326.405302:0:38320:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788572326.405305:0:38320:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94e640d5d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572326.405315:0:38320:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e637591180 x1875449639092224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572326.405348:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639091712:0@lo:8:kworker.0 00000100:00100000:1.0:1788572326.405384:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572326.405413:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639092224:0@lo:8:kworker.0 00000100:00100000:1.0:1788572326.405434:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572326.405462:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639091584:0@lo:400:kworker.0 00000100:00100000:1.0:1788572326.405487:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572326.405507:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639092352:0@lo:400:kworker.0 00000100:00100000:1.0:1788572326.405528:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572326.405545:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788572326.405550:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639091840:0@lo:400:kworker.0 00000100:00100000:1.0:1788572326.405571:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572326.405593:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639092480:0@lo:400:kworker.0 00000100:00100000:1.0:1788572326.405613:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572326.405644:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639091584 00000100:00100000:1.0:1788572326.405648:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639091584 00000100:00100000:1.0:1788572326.405681:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639091840 00000100:00100000:1.0:1788572326.405684:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639091840 00000100:00100000:1.0:1788572326.405708:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639092480 00000100:00100000:1.0:1788572326.405711:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639092480 00000100:00100000:1.0:1788572326.405730:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4535 00000100:00100000:1.0:1788572326.405737:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639091584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572326.405779:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639091584:12345-0@lo:400:kworker.0 Request processed in 42us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572326.405796:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4535 00000100:00100000:1.0:1788572326.405813:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4536 00000100:00100000:1.0:1788572326.405819:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639091840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572326.405846:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639091840:12345-0@lo:400:kworker.0 Request processed in 27us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572326.405851:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4536 00000100:00100000:1.0:1788572326.405865:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4537 00000100:00100000:1.0:1788572326.405870:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639092480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572326.405895:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639092480:12345-0@lo:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572326.405901:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4537 00000100:00080000:1.0:1788572326.405924:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572326.405952:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639091840:0@lo:400:kworker.0 00000100:00100000:1.0:1788572326.405962:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639092480:0@lo:400:kworker.0 00000100:00100000:1.0:1788572326.405971:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639091584:0@lo:400:kworker.0 00000100:00100000:0.0:1788572326.406099:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639091456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572326.406131:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572326.406163:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639092096:0@lo:400:kworker.0 00000100:00100000:0.0:1788572326.406184:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572326.406204:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788572326.406208:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639091328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572326.406230:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572326.406247:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639091968:0@lo:400:kworker.0 00000100:00100000:0.0:1788572326.406267:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572326.406289:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639091712 00000100:00100000:0.0:1788572326.406292:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639091712 00000100:00100000:0.0:1788572326.406311:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639092224 00000100:00100000:0.0:1788572326.406314:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639092224 00000100:00100000:0.0:1788572326.406325:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639092352 00000100:00100000:0.0:1788572326.406328:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639092352 00000100:00100000:0.0:1788572326.406348:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639092096 00000100:00100000:0.0:1788572326.406350:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639092096 00000100:00100000:0.0:1788572326.406369:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3693 00000100:00100000:0.0:1788572326.406376:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639092352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572326.406409:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637592a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639092352:12345-0@lo:400:kworker.0 Request processed in 35us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572326.406415:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3693 00000100:00100000:0.0:1788572326.406427:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3694 00000100:00100000:0.0:1788572326.406432:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639092096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572326.406462:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639092096:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572326.406468:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3694 00000100:00100000:0.0:1788572326.406479:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:0.0:1788572326.406483:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3649:x1875449639091712:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572326.406502:0:43976:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572326.406532:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3649:x1875449639091712:12345-0@lo:8:kworker.0 Request processed in 48us (1148us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572326.406538:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:0.0:1788572326.406548:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:0.0:1788572326.406552:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3649:x1875449639092224:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572326.406561:0:43976:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572326.406582:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3649:x1875449639092224:12345-0@lo:8:kworker.0 Request processed in 28us (1148us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572326.406588:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00100000:0.0:1788572326.406626:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639092096:0@lo:400:kworker.0 00000100:00100000:3.0:1788572326.406723:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639091328 00000100:00100000:3.0:1788572326.406727:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639091328 00000100:00100000:3.0:1788572326.406767:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788572326.406774:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+21:3653:x1875449639091328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572326.406827:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+21:3653:x1875449639091328:12345-0@lo:400:kworker.0 Request processed in 53us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572326.406833:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788572326.406869:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639091328:0@lo:400:kworker.0 00000100:00100000:1.0:1788572326.406972:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639091456 00000100:00100000:1.0:1788572326.406976:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639091456 00000100:00100000:1.0:1788572326.407090:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735 00000100:00100000:1.0:1788572326.407098:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639091456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572326.407135:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639091456:12345-0@lo:400:kworker.0 Request processed in 40us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572326.407142:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735 00000100:00100000:3.0:1788572326.409920:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639091456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572326.413934:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639092352:0@lo:400:kworker.0 00000100:00080000:0.0:1788572326.413990:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572326.413996:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572326.414000:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639091712:0@lo:8:kworker.0 00000100:00080000:0.0:1788572326.414036:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572326.414041:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572326.414044:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639092224:0@lo:8:kworker.0 00000100:00080000:3.0:1788572326.416692:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572326.416720:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639091968 00000100:00100000:3.0:1788572326.416729:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639091968 00000100:00080000:1.0:1788572326.416856:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572326.416896:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4538 00000100:00100000:3.0:1788572326.416907:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639091968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572326.417054:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639091968:12345-0@lo:400:kworker.0 Request processed in 149us (10785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572326.417062:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4538 00000100:00100000:2.0:1788572326.417158:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639091968:0@lo:400:kworker.0 00010000:00010000:3.0:1788572326.605758:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572326.820572:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572326.820658:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572326.820691:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572326.820779:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572326.820828:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616091648 00000100:00100000:2.0:1788572326.820840:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616091648 00000100:00100000:2.0:1788572326.820896:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 117 00000100:00100000:2.0:1788572326.820905:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616091648:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572326.820974:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616091648:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 70us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572326.820982:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 117 00000100:00100000:0.0:1788572326.821456:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616092032 00000100:00100000:0.0:1788572326.821463:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616092032 00000100:00100000:0.0:1788572326.821499:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3826 00000100:00100000:0.0:1788572326.821506:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2382:x1875449616092032:12345-192.168.202.13@tcp:8:kworker.0 00010000:00020000:0.0:1788572326.821527:0:17011:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572326.821562:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2382:x1875449616092032:12345-192.168.202.13@tcp:8:kworker.0 Request processed in 55us (999us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572326.821568:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3826 00000100:00100000:3.0:1788572326.823174:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616091904 00000100:00100000:3.0:1788572326.823186:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616091904 00000100:00100000:3.0:1788572326.823291:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616091776 00000100:00100000:3.0:1788572326.823294:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616091776 00000100:00100000:2.0:1788572326.823342:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4539 00000100:00100000:2.0:1788572326.823354:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616091904:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572326.823437:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616091904:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 85us (2744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572326.823445:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4539 00000100:00080000:1.0:1788572326.824338:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572326.824346:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572326.824582:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4540 00000100:00100000:3.0:1788572326.824592:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2385:x1875449616091776:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572326.824650:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2385:x1875449616091776:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 59us (3870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572326.824656:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4540 00000100:00100000:0.0:1788572326.916356:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572326.916378:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639092608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572326.916452:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572326.916505:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639092608 00000100:00100000:0.0:1788572326.916513:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639092608 00000100:00100000:0.0:1788572326.917177:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:0.0:1788572326.917190:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639092608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572326.917215:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572326.917269:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639092608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572326.917277:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:0.0:1788572326.917326:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639092608:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788572327.620121:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572328.657329:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572329.669770:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572329.993459:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572329.993487:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639092736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572329.993565:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572329.994764:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639092736 00000100:00100000:3.0:1788572329.994776:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639092736 00000100:00100000:3.0:1788572329.995918:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736 00000100:00100000:3.0:1788572329.995936:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639092736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572329.995977:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572329.996084:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639092736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572329.996093:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736 00000100:00100000:1.0:1788572329.999938:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639092736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572330.501393:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572330.501410:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639092864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572330.501486:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572330.502629:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639092864 00000100:00100000:3.0:1788572330.502641:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639092864 00000100:00100000:3.0:1788572330.502712:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:3.0:1788572330.502731:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639092864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572330.502767:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572330.502830:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639092864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572330.502837:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:2.0:1788572330.503044:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639092864:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788572330.503639:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572330.691347:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572331.523157:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639092992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572331.523234:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788572331.523294:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572331.523300:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788572331.523309:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788572331.523343:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639093376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572331.523377:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572331.527988:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639092992 00000100:00100000:1.0:1788572331.528018:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639092992 00000100:00100000:1.0:1788572331.528082:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737 00000100:00100000:1.0:1788572331.528092:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639092992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572331.528129:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572331.528210:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639092992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (4977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572331.528217:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737 00000100:00100000:1.0:1788572331.528862:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639093120:0@lo:400:kworker.0 00000100:00100000:2.0:1788572331.529059:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639093248:0@lo:400:kworker.0 00000100:00100000:2.0:1788572331.529104:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572331.529164:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639093248 00000100:00100000:2.0:1788572331.529169:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639093248 00000100:00100000:2.0:1788572331.529213:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738 00000100:00100000:2.0:1788572331.529220:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639093248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572331.529264:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639093248:12345-0@lo:400:kworker.0 Request processed in 44us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572331.529271:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738 00000100:00100000:2.0:1788572331.529310:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639093248:0@lo:400:kworker.0 00000100:00100000:1.0:1788572331.529353:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572331.529400:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639093120 00000100:00100000:1.0:1788572331.529404:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639093120 00000100:00100000:1.0:1788572331.529434:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788572331.529440:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+21:3652:x1875449639093120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572331.529477:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+21:3652:x1875449639093120:12345-0@lo:400:kworker.0 Request processed in 36us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572331.529483:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788572331.529521:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639093120:0@lo:400:kworker.0 00000100:00100000:1.0:1788572331.529559:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639092992:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788572331.530885:0:93352:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4243 00000100:00080000:0.0:1788572331.530892:0:93352:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572331.530899:0:93352:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff94e501c62000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572331.531018:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e63ae3c000 x1875449639093504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572331.531081:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572331.531086:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788572331.531089:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572331.531094:0:93352:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4243 00000100:00080000:0.0:1788572331.531097:0:93352:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572331.531101:0:93352:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94e640d5d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572331.531113:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e63ae3ea00 x1875449639094016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572331.531159:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639093376 00000100:00100000:0.0:1788572331.531166:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639093376 00000100:00100000:0.0:1788572331.531281:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4541 00000100:00100000:0.0:1788572331.531288:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639093376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572331.531356:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639093376:12345-0@lo:400:kworker.0 Request processed in 68us (7978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572331.531364:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4541 00000100:00100000:0.0:1788572331.531391:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639093504:0@lo:8:kworker.0 00000100:00100000:2.0:1788572331.531487:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639093888:0@lo:400:kworker.0 00000100:00100000:2.0:1788572331.531524:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572331.531554:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572331.531559:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639093760:0@lo:400:kworker.0 00000100:00100000:2.0:1788572331.531582:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572331.531605:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639093760 00000100:00100000:2.0:1788572331.531609:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639093760 00000100:00100000:2.0:1788572331.531641:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4542 00000100:00100000:2.0:1788572331.531647:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639093760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572331.531678:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639093760:12345-0@lo:400:kworker.0 Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572331.531685:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4542 00000100:00100000:2.0:1788572331.531717:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639093760:0@lo:400:kworker.0 00000100:00100000:0.0:1788572331.531882:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572331.531903:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639094016:0@lo:8:kworker.0 00000100:00100000:0.0:1788572331.531982:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572331.532040:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639093888 00000100:00100000:0.0:1788572331.532044:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639093888 00000100:00100000:0.0:1788572331.532077:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639093504 00000100:00100000:0.0:1788572331.532080:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639093504 00000100:00100000:0.0:1788572331.532094:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639094016 00000100:00100000:1.0:1788572331.532122:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3695 00000100:00100000:1.0:1788572331.532134:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639093888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572331.532180:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639093888:12345-0@lo:400:kworker.0 Request processed in 50us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572331.532187:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3695 00000100:00100000:1.0:1788572331.532202:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:1.0:1788572331.532207:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3649:x1875449639093504:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788572331.532226:0:43966:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572331.532274:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3649:x1875449639093504:12345-0@lo:8:kworker.0 Request processed in 65us (391us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572331.532280:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:1.0:1788572331.532308:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639093888:0@lo:400:kworker.0 00000100:00100000:0.0:1788572331.532860:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639094016 00000100:00100000:0.0:1788572331.532889:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:0.0:1788572331.532894:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3649:x1875449639094016:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788572331.532907:0:43973:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572331.533036:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3649:x1875449639094016:12345-0@lo:8:kworker.0 Request processed in 140us (1053us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572331.533043:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00080000:0.0:1788572331.533061:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572331.533065:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572331.533093:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639094144:0@lo:400:kworker.0 00000100:00100000:0.0:1788572331.533124:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572331.533159:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639093376:0@lo:400:kworker.0 00000100:00100000:0.0:1788572331.533992:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788572331.534023:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639093632:0@lo:400:kworker.0 00000100:00100000:0.0:1788572331.534061:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572331.534083:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639094272:0@lo:400:kworker.0 00000100:00100000:0.0:1788572331.534103:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788572331.534148:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572331.534154:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572331.534157:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639093504:0@lo:8:kworker.0 00000100:00080000:0.0:1788572331.534169:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1788572331.534288:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639093632 00000100:00100000:2.0:1788572331.534294:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639093632 00000100:00100000:3.0:1788572331.534687:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639094272 00000100:00100000:3.0:1788572331.534693:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639094272 00000100:00100000:3.0:1788572331.534727:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4543 00000100:00100000:3.0:1788572331.534735:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639094272:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788572331.534977:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572331.534981:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639094016:0@lo:8:kworker.0 00000100:00080000:0.0:1788572331.535032:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572331.535117:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4544 00000100:00100000:2.0:1788572331.535126:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639093632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572331.535265:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639094144 00000100:00100000:1.0:1788572331.535271:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639094144 00000100:00100000:1.0:1788572331.535305:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696 00000100:00100000:1.0:1788572331.535313:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639094144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572331.535517:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639094272:12345-0@lo:400:kworker.0 Request processed in 782us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572331.535525:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4543 00000100:00100000:2.0:1788572331.535596:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639093632:12345-0@lo:400:kworker.0 Request processed in 472us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572331.535603:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4544 00000100:00100000:1.0:1788572331.535689:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639094144:12345-0@lo:400:kworker.0 Request processed in 376us (2563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572331.535696:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696 00000100:00100000:0.0:1788572331.542048:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639094272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572331.543459:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639094144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572331.543504:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639093632:0@lo:400:kworker.0 00010000:00010000:3.0:1788572331.716475:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572331.954113:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572331.954156:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572331.954185:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616092160 00000100:00100000:0.0:1788572331.954196:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616092160 00000100:00100000:0.0:1788572331.954756:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00100000:0.0:1788572331.954767:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616092160:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572331.955195:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616092160:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 429us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572331.955204:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 119 00000100:00100000:1.0:1788572331.956474:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572331.956512:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572331.956931:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616092544 00000100:00100000:0.0:1788572331.956951:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616092544 00000100:00100000:0.0:1788572331.956996:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3829 00000100:00100000:0.0:1788572331.957023:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2382:x1875449616092544:12345-192.168.202.13@tcp:8:kworker.0 00010000:00020000:0.0:1788572331.957049:0:43976:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572331.958537:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2382:x1875449616092544:12345-192.168.202.13@tcp:8:kworker.0 Request processed in 1522us (2060us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572331.958548:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3829 00000100:00100000:2.0:1788572331.961174:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616092416 00000100:00100000:2.0:1788572331.961189:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616092416 00000100:00080000:1.0:1788572331.961384:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572331.961588:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616092288 00000100:00100000:2.0:1788572331.961593:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616092288 00000100:00100000:2.0:1788572331.961638:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4545 00000100:00100000:2.0:1788572331.961647:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616092416:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572331.961726:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616092416:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 80us (7569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572331.961735:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4545 00000100:00100000:2.0:1788572331.961864:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4546 00000100:00100000:2.0:1788572331.961873:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616092288:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572331.961902:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616092288:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 31us (5391us total) trans 0 rc 0/0 00000100:00080000:0.0:1788572331.962037:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572331.962121:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4546 00000100:00100000:0.0:1788572332.037060:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572332.037094:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639094400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572332.037170:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572332.037221:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639094400 00000100:00100000:0.0:1788572332.037229:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639094400 00000100:00100000:0.0:1788572332.037277:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:0.0:1788572332.037286:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639094400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572332.037313:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572332.037359:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639094400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572332.037365:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:0.0:1788572332.037411:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639094400:0@lo:13:osp-pre-1-1.0 00000020:01000004:2.0:1788572332.090965:0:114774:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788572332.090969:0:114774:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788572332.090970:0:114774:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788572332.091304:0:114774:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94e506b20000 00000020:01000004:2.0:1788572332.091320:0:114774:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788572332.091335:0:114774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788572332.091349:0:114774:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff94e5033ccd40) 00000020:00000080:2.0:1788572332.091366:0:114774:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1788572332.749753:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788572333.133209:0:114774:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788572333.143326:0:114774:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788572333.143757:0:114774:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788572333.144433:0:114774:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788572333.144748:0:114774:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788572333.145232:0:114774:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788572333.150143:0:114774:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1788572333.155458:0:114774:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788572333.155688:0:114774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788572333.155702:0:114774:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788572333.155713:0:114774:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdb7edb52b8334d2c 00000020:01000004:2.0:1788572333.155719:0:114774:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788572333.155743:0:114774:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788572333.155746:0:114774:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788572333.155753:0:114774:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788572333.155782:0:114774:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788572333.155787:0:114774:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788572333.178422:0:114774:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788572333.178470:0:114774:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.113@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788572333.178475:0:114774:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788572333.178476:0:114774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572333.178478:0:114774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572333.178479:0:114774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572333.178480:0:114774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572333.178481:0:114774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572333.178483:0:114774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572333.178484:0:114774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572333.178486:0:114774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788572333.178489:0:114774:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788572333.178492:0:114774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788572333.178493:0:114774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572333.178494:0:114774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572333.178495:0:114774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572333.178496:0:114774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572333.178497:0:114774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572333.178498:0:114774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572333.178499:0:114774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572333.178500:0:114774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788572333.178528:0:114774:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788572333.178550:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639094528:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788572333.178624:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.178679:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61eb19f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572333.179035:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639094528 00000100:00100000:2.0:1788572333.179053:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639094528 00000100:00100000:2.0:1788572333.179111:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788572333.179122:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+21:114774:x1875449639094528:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788572333.179156:0:111984:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788572333.179160:0:111984:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788572333.179166:0:111984:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788572333.183374:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+21:114774:x1875449639094528:12345-0@lo:253:mount.lustre.0 Request processed in 4240us (4735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.183394:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788572333.185271:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639094528:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788572333.185295:0:114774:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788572333.185299:0:114774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788572333.185301:0:114774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572333.185302:0:114774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572333.185304:0:114774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572333.185305:0:114774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572333.185307:0:114774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572333.185308:0:114774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572333.185311:0:114774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572333.185312:0:114774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788572333.185344:0:114774:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94e506b20000 from lustre-OST0000 10000000:01000000:3.0:1788572333.185378:0:114774:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788572333.185381:0:114774:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788572333.185391:0:114774:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff94e62d25b380 local copy 00010000:00010000:3.0:1788572333.185402:0:114774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ae3b400/0xdb7edb52b831cb4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b831cb53 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572333.185509:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639094656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572333.185566:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.185623:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61eb19a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572333.186097:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639094656 00000100:00100000:2.0:1788572333.186105:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639094656 00000100:00100000:2.0:1788572333.186148:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788572333.186157:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+21:114774:x1875449639094656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572333.186254:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+21:114774:x1875449639094656:12345-0@lo:501:mount.lustre.0 Request processed in 98us (687us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572333.186262:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788572333.187367:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639094656:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788572333.187396:0:114774:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788572333.187433:0:114774:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788572333.187441:0:114774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ae3b400/0xdb7edb52b831cb4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b831cb53 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.187452:0:114774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e63ae3b400/0xdb7edb52b831cb4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b831cb53 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572333.187493:0:114774:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94e506b20000 10000000:01000000:3.0:1788572333.187498:0:114774:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788572333.187504:0:114774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788572333.187506:0:114774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788572333.187511:0:114774:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788572333.187513:0:114774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788572333.187547:0:114774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e609745a00/0xdb7edb52b8334d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.187555:0:114774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e609745a00/0xdb7edb52b8334d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.187565:0:114774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e609745a00/0xdb7edb52b8334d33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572333.187584:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639094784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572333.187628:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.187666:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61eb19a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572333.188180:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639094784 00000100:00100000:2.0:1788572333.188188:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639094784 00000100:00100000:2.0:1788572333.188305:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788572333.188316:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+21:114774:x1875449639094784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788572333.188330:0:111983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572333.188345:0:111983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e637701a00/0xdb7edb52b8334d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b8334d33 expref: -99 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.188368:0:111983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e637701a00/0xdb7edb52b8334d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b8334d33 expref: 22 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.188383:0:111983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e637701a00/0xdb7edb52b8334d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b8334d33 expref: 22 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.188392:0:111983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e637701a00, rc 0) 00000100:00100000:2.0:1788572333.188499:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+22:114774:x1875449639094784:12345-0@lo:101:mount.lustre.0 Request processed in 185us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.188506:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788572333.194706:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639094784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572333.194746:0:114774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e609745a00/0xdb7edb52b8334d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334d3a expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.194761:0:114774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e609745a00/0xdb7edb52b8334d33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b8334d3a expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788572333.196509:0:114774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788572333.196985:0:114774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572333.202892:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788572333.204452:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788572333.204482:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788572333.204499:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788572333.204515:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788572333.204530:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788572333.204545:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788572333.204561:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788572333.204575:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1788572333.204591:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1788572333.204609:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1788572333.204625:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1788572333.204661:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1788572333.204669:0:114774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1788572333.204804:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639094912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572333.204883:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572333.206256:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e50492b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572333.218449:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639094912 00000100:00100000:2.0:1788572333.218467:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639094912 00000100:00100000:2.0:1788572333.218543:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788572333.218553:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+22:114774:x1875449639094912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572333.218725:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+22:114774:x1875449639094912:12345-0@lo:501:mount.lustre.0 Request processed in 173us (13841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.218733:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788572333.218837:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639094912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788572333.218891:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572333.218980:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572333.219061:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e50492b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572333.219351:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639095040 00000100:00100000:2.0:1788572333.219356:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639095040 00000100:00100000:2.0:1788572333.219389:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788572333.219397:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+22:114774:x1875449639095040:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572333.219492:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+22:114774:x1875449639095040:12345-0@lo:503:mount.lustre.0 Request processed in 95us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.219499:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788572333.219677:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095040:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788572333.220325:0:114774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788572333.220402:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572333.220454:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572333.220493:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e50492b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572333.220620:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639095168 00000100:00100000:3.0:1788572333.220626:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639095168 00000100:00100000:3.0:1788572333.220668:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788572333.220677:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+22:114774:x1875449639095168:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572333.221250:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+22:114774:x1875449639095168:12345-0@lo:502:mount.lustre.0 Request processed in 572us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.221258:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788572333.221464:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572333.221644:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788572333.221671:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788572333.221684:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788572333.221696:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788572333.221707:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788572333.221718:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788572333.221732:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788572333.221744:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788572333.221756:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788572333.221767:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788572333.221778:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788572333.221790:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788572333.221816:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572333.221858:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572333.221939:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e50492b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788572333.224874:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639095296 00000100:00100000:2.0:1788572333.224892:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639095296 00000100:00100000:3.0:1788572333.225754:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788572333.225766:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+22:114774:x1875449639095296:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572333.226386:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+22:114774:x1875449639095296:12345-0@lo:502:mount.lustre.0 Request processed in 619us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.226394:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788572333.228419:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095296:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572333.228545:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788572333.228560:0:114774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788572333.235677:0:114778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788572333.235690:0:114778:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788572333.235697:0:114778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572333.235700:0:114778:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788572333.235708:0:114778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788572333.235725:0:114778:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94e62d2599c0) 00000020:00000080:1.0:1788572333.235754:0:114778:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788572333.235760:0:114778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788572333.235828:0:114778:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94e506b20000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788572333.235836:0:114778:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788572333.235843:0:114778:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdb7edb52b8334d48 00010000:00010000:1.0:1788572333.244398:0:114778:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00080000:1.0:1788572333.244537:0:114778:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967297 srv lr: 8589935538 lx: 1875449636482432 gen 0 00000001:00080000:1.0:1788572333.244572:0:114778:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 8589935776 srv lr: 8589935538 lx: 1875449639023360 gen 0 00000001:00080000:1.0:1788572333.244590:0:114778:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 35eb2d60-2de0-4b00-9815-d5153edd0057 idx: 2 lr: 8589935763 srv lr: 8589935538 lx: 1875449615414912 gen 0 00000001:00000004:1.0:1788572333.244605:0:114778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589935776 00080000:10000000:1.0:1788572333.246862:0:114778:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788572333.249281:0:114778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788572333.249296:0:114778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572333.249303:0:114778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572333.249305:0:114778:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788572333.249310:0:114778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788572333.249313:0:114778:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788572333.249315:0:114778:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788572333.249316:0:114778:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788572333.249318:0:114778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788572333.249321:0:114778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572333.249322:0:114778:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788572333.249324:0:114778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572333.249327:0:114778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572333.249328:0:114778:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788572333.249331:0:114778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788572333.249332:0:114778:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788572333.249335:0:114778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572333.249337:0:114778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572333.249338:0:114778:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788572333.249341:0:114778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572333.249343:0:114778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572333.249345:0:114778:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788572333.249347:0:114778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788572333.249380:0:114778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572333.249383:0:114778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572333.249384:0:114778:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788572333.249387:0:114778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788572333.253359:0:114774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788572333.253411:0:114774:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788572333.253426:0:114774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e609745a00/0xdb7edb52b8334d33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334d3a expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.253439:0:114774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e609745a00/0xdb7edb52b8334d33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334d3a expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572333.253447:0:114774:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94e506b20000 from 1 10000000:01000000:3.0:1788572333.253451:0:114774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572333.253489:0:114774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e609744000/0xdb7edb52b8334d64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.253498:0:114774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e609744000/0xdb7edb52b8334d64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.253510:0:114774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e609744000/0xdb7edb52b8334d64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572333.253538:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572333.253607:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.253665:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639095424 00000100:00100000:3.0:1788572333.253672:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639095424 00000100:00100000:3.0:1788572333.253718:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788572333.253726:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+22:114774:x1875449639095424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572333.253739:0:111983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572333.253751:0:111983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e609744e00/0xdb7edb52b8334d6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b8334d64 expref: -99 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.253775:0:111983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e609744e00/0xdb7edb52b8334d6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b8334d64 expref: 23 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.253785:0:111983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e609744e00/0xdb7edb52b8334d6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b8334d64 expref: 23 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.253794:0:111983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e609744e00, rc 0) 00000100:00100000:3.0:1788572333.253826:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+23:114774:x1875449639095424:12345-0@lo:101:mount.lustre.0 Request processed in 101us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.253832:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788572333.253876:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61eb19a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788572333.253912:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095424:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572333.254287:0:114774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e609744000/0xdb7edb52b8334d64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334d6b expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.254299:0:114774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e609744000/0xdb7edb52b8334d64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b8334d6b expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572333.254517:0:114774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000040:00080000:3.0:1788572333.254791:0:114774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572333.256913:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788572333.257737:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788572333.257754:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788572333.257767:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788572333.257778:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788572333.257800:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788572333.257806:0:114774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 6 count 7 00000100:00100000:3.0:1788572333.257927:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572333.258056:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.258091:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e505db9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572333.258468:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639095552 00000100:00100000:2.0:1788572333.258476:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639095552 00000100:00100000:2.0:1788572333.258532:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788572333.258541:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+23:114774:x1875449639095552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572333.258670:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+23:114774:x1875449639095552:12345-0@lo:501:mount.lustre.0 Request processed in 129us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.258678:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788572333.258802:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572333.258838:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572333.258883:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.259086:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e505db9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572333.259376:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639095680 00000100:00100000:0.0:1788572333.259381:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639095680 00000100:00100000:0.0:1788572333.259415:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788572333.259422:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+23:114774:x1875449639095680:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572333.259555:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+23:114774:x1875449639095680:12345-0@lo:503:mount.lustre.0 Request processed in 132us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572333.259562:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788572333.267062:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095680:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788572333.267689:0:114774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788572333.267782:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572333.267863:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.267915:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e505db90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572333.268224:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639095808 00000100:00100000:2.0:1788572333.268231:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639095808 00000100:00100000:2.0:1788572333.268281:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788572333.268291:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+23:114774:x1875449639095808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572333.269349:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+23:114774:x1875449639095808:12345-0@lo:502:mount.lustre.0 Request processed in 1055us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.269359:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788572333.281302:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788572333.281703:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788572333.281738:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788572333.281751:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788572333.281762:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788572333.281774:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000100:00100000:2.0:1788572333.281816:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e573800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788572333.281910:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572333.282147:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e633dcf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572333.283096:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639095936 00000100:00100000:0.0:1788572333.283108:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639095936 00000100:00100000:0.0:1788572333.283173:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788572333.283183:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+23:114774:x1875449639095936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572333.283471:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+23:114774:x1875449639095936:12345-0@lo:502:mount.lustre.0 Request processed in 289us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572333.283479:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788572333.284101:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e573800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639095936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788572333.284188:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788572333.284203:0:114774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1788572333.295567:0:114782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572333.295584:0:114782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572333.295586:0:114782:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788572333.295594:0:114782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94e506b20000 00000020:00000080:1.0:1788572333.295597:0:114782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788572333.295604:0:114782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572333.295607:0:114782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572333.295609:0:114782:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788572333.295611:0:114782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788572333.295613:0:114782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572333.295614:0:114782:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788572333.295618:0:114782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94e506b20000 00000020:00000080:1.0:1788572333.295620:0:114782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788572333.295692:0:114782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572333.295696:0:114782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572333.295697:0:114782:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788572333.295700:0:114782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000020:01000000:3.0:1788572333.304330:0:114774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788572333.304383:0:114774:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572333.304410:0:114774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e609744000/0xdb7edb52b8334d64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334d6b expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.304422:0:114774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e609744000/0xdb7edb52b8334d64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334d6b expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572333.304485:0:114774:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788572333.304489:0:114774:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94e506b20000 10000000:01000000:3.0:1788572333.304492:0:114774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94e506b20000 10000000:01000000:3.0:1788572333.304498:0:114774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788572333.304504:0:114774:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94e506b20000 from 1 10000000:01000000:3.0:1788572333.304507:0:114774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788572333.304545:0:114774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e609745400/0xdb7edb52b8334d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.304554:0:114774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e609745400/0xdb7edb52b8334d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.304565:0:114774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e609745400/0xdb7edb52b8334d72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572333.304590:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572333.304660:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.304708:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e505db9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572333.306653:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639096064 00000100:00100000:1.0:1788572333.306668:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639096064 00000100:00100000:1.0:1788572333.306736:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788572333.306746:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+23:114774:x1875449639096064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572333.306763:0:111983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572333.306782:0:111983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e637781000/0xdb7edb52b8334d79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b8334d72 expref: -99 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572333.306810:0:111983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e637781000/0xdb7edb52b8334d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b8334d72 expref: 24 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572333.306821:0:111983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e637781000/0xdb7edb52b8334d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b8334d72 expref: 24 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572333.306831:0:111983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e637781000, rc 0) 00000100:00100000:1.0:1788572333.309630:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639096064:12345-0@lo:101:mount.lustre.0 Request processed in 2874us (4959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572333.309643:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788572333.311677:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572333.311708:0:114774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e609745400/0xdb7edb52b8334d72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334d79 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.311722:0:114774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e609745400/0xdb7edb52b8334d72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b8334d79 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788572333.314162:0:114774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788572333.314657:0:114774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572333.314874:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788572333.316086:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788572333.316124:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788572333.316138:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788572333.316151:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788572333.316165:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788572333.316183:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788572333.316196:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788572333.316208:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788572333.316284:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788572333.316306:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788572333.316485:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788572333.316503:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788572333.316517:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788572333.316529:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788572333.316542:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788572333.316553:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788572333.316568:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788572333.316581:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788572333.316595:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788572333.316608:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788572333.316622:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788572333.316636:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788572333.316649:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788572333.316663:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788572333.316676:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788572333.316689:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788572333.316702:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788572333.316716:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788572333.316732:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788572333.316745:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788572333.316757:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788572333.316771:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788572333.316783:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788572333.316799:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788572333.316812:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788572333.316824:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788572333.316839:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788572333.316853:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788572333.316868:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788572333.316880:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788572333.316910:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788572333.317048:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788572333.317071:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788572333.317087:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788572333.317103:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788572333.317120:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788572333.317134:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788572333.317444:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788572333.317466:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788572333.317484:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788572333.317489:0:114774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788572333.317611:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572333.317681:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.317740:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639096192 00000100:00100000:3.0:1788572333.317747:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639096192 00000100:00100000:3.0:1788572333.317792:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788572333.317801:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639096192:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572333.318401:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639096192:12345-0@lo:501:mount.lustre.0 Request processed in 596us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.318410:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788572333.318457:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e505db9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788572333.318480:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572333.318525:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572333.318573:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.318598:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e505db9540 going to sleep for 11 seconds 00000100:00100000:0.0:1788572333.321261:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639096320 00000100:00100000:0.0:1788572333.321277:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639096320 00000100:00100000:0.0:1788572333.321337:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788572333.321347:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639096320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572333.321528:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639096320:12345-0@lo:503:mount.lustre.0 Request processed in 180us (2952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572333.321535:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788572333.324542:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096320:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788572333.325336:0:114774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788572333.325449:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572333.325537:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.325623:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e505db9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572333.329321:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639096448 00000100:00100000:1.0:1788572333.329335:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639096448 00000100:00100000:1.0:1788572333.329404:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788572333.329414:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639096448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788572333.329612:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639096448:12345-0@lo:502:mount.lustre.0 Request processed in 199us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572333.329624:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788572333.330383:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572333.330597:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788572333.330624:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788572333.330637:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788572333.330648:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788572333.330659:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788572333.330670:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788572333.330681:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788572333.330692:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788572333.330703:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788572333.330713:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788572333.330724:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788572333.330734:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788572333.330747:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788572333.330758:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788572333.330768:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788572333.330779:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788572333.330789:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788572333.330800:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788572333.330810:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788572333.330821:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788572333.330832:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788572333.330843:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788572333.330854:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788572333.330865:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788572333.330876:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788572333.330886:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788572333.331379:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788572333.331409:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788572333.331424:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788572333.331438:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788572333.331452:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788572333.331464:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788572333.331475:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788572333.331485:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788572333.331496:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788572333.331508:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788572333.331518:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788572333.331529:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788572333.331540:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788572333.331552:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788572333.331562:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788572333.331573:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788572333.331583:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788572333.331594:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788572333.331605:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788572333.331615:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788572333.331626:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788572333.331637:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788572333.331684:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572333.331753:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572333.331836:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e50492bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572333.336925:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639096576 00000100:00100000:3.0:1788572333.336942:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639096576 00000100:00100000:3.0:1788572333.337041:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788572333.337052:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639096576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572333.337538:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639096576:12345-0@lo:502:mount.lustre.0 Request processed in 486us (5782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.337548:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788572333.337705:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572333.337942:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788572333.337982:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788572333.338064:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788572333.338112:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572333.338149:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e50492bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572333.338501:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639096704 00000100:00100000:3.0:1788572333.338508:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639096704 00000100:00100000:3.0:1788572333.338553:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788572333.338561:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639096704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788572333.338664:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501cb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639096704:12345-0@lo:502:mount.lustre.0 Request processed in 103us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.338672:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788572333.338988:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639096704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788572333.339257:0:114774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788572333.339269:0:114774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788572333.349082:0:114785:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788572333.349104:0:114785:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff94e505624d40) 00000020:00000080:0.0:1788572333.349136:0:114785:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788572333.349344:0:114785:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94e506b20000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788572333.349349:0:114785:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94e506b20000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788572333.349352:0:114785:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94e506b20000 3 00010000:00080000:0.0:1788572333.349387:0:114785:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94e6056e8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788572333.361595:0:114785:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000080:1.0:1788572333.361807:0:114785:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788572333.361854:0:114785:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788572333.361869:0:114785:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdb7edb52b8334d87 00000100:00080000:1.0:1788572333.361880:0:114785:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788572333.361887:0:114785:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94e6056e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572333.361925:0:114785:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e634b28e00 x1875449639096832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572333.361957:0:114785:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788572333.363375:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639096832:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788572333.363456:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572333.363526:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639096832 00000100:00100000:2.0:1788572333.363534:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639096832 00000100:00100000:2.0:1788572333.363570:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14679 00000100:00100000:2.0:1788572333.363578:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639096832:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788572333.363604:0:9276:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 4250 last 0 00000020:00000080:2.0:1788572333.363642:0:9276:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdb7edb52b8334d8e 00000004:00100000:2.0:1788572333.363659:0:9276:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788572333.363694:0:9276:0:(import.c:65:import_set_state_nolock()) ffff94e506b25800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572333.363747:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875449639096832:12345-0@lo:38:llog_process_th.0 Request processed in 168us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.363755:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14679 00000100:00100000:2.0:1788572333.363799:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788572333.363808:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 51 00000100:00080000:2.0:1788572333.363815:0:3649:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788572333.363820:0:3649:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788572333.363823:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788572333.363829:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639096832:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788572333.364483:0:38320:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572333.364488:0:38320:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788572333.364491:0:38320:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572333.364495:0:38320:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 4248 00000100:00080000:3.0:1788572333.364500:0:38320:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572333.364504:0:38320:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff94e501c62000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788572333.364522:0:38320:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6377d3100 x1875449639097216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572333.364562:0:38320:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788572333.364565:0:38320:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788572333.364567:0:38320:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788572333.364571:0:38320:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 4248 00000100:00080000:3.0:1788572333.364573:0:38320:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788572333.364577:0:38320:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94e640d5d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788572333.364587:0:38320:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e637714000 x1875449639097856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572333.364740:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639097472:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.364781:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.364806:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639098112:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.364828:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.364848:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572333.364854:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639096960:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.364878:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.364910:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639097600:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.364933:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.364962:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639097088:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.364996:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.365042:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639097728:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.365063:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.365086:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572333.365091:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639097344:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.365112:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.365130:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639097984:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.365150:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.365190:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639097472 00000100:00100000:3.0:1788572333.365195:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639097472 00000100:00100000:2.0:1788572333.368394:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639098112 00000100:00100000:2.0:1788572333.368410:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639098112 00000100:00100000:2.0:1788572333.368477:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639097088 00000100:00100000:2.0:1788572333.368481:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639097088 00000100:00100000:2.0:1788572333.368499:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639097344 00000100:00100000:2.0:1788572333.368502:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639097344 00000100:00100000:2.0:1788572333.368528:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4547 00000100:00100000:2.0:1788572333.368537:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639098112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572333.368639:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639098112:12345-0@lo:400:kworker.0 Request processed in 103us (3809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.368649:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4547 00000100:00100000:2.0:1788572333.368670:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4548 00000100:00100000:2.0:1788572333.368676:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639097088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572333.368711:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639097088:12345-0@lo:400:kworker.0 Request processed in 36us (3714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.368717:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4548 00000100:00100000:2.0:1788572333.368730:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4549 00000100:00100000:2.0:1788572333.368737:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639097344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572333.368764:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639097344:12345-0@lo:400:kworker.0 Request processed in 29us (3651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.368770:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4549 00000100:00100000:3.0:1788572333.369384:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639098112:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369419:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4550 00000100:00100000:3.0:1788572333.369428:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639097472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369473:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639097472:12345-0@lo:400:kworker.0 Request processed in 48us (4692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.369480:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4550 00000100:00100000:3.0:1788572333.369503:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639096960 00000100:00100000:3.0:1788572333.369508:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639096960 00000100:00100000:3.0:1788572333.369535:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639097728 00000100:00100000:3.0:1788572333.369538:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639097728 00000100:00100000:3.0:1788572333.369557:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739 00000100:00100000:3.0:1788572333.369563:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639096960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369596:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639096960:12345-0@lo:400:kworker.0 Request processed in 34us (4717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.369602:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739 00000100:00100000:3.0:1788572333.369616:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740 00000100:00100000:3.0:1788572333.369622:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639097728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369653:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639097728:12345-0@lo:400:kworker.0 Request processed in 32us (4589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.369658:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740 00000100:00100000:3.0:1788572333.369684:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639097600 00000100:00100000:3.0:1788572333.369688:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639097600 00000100:00100000:3.0:1788572333.369718:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639097984 00000100:00100000:3.0:1788572333.369721:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639097984 00000100:00100000:3.0:1788572333.369741:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3697 00000100:00100000:3.0:1788572333.369747:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639097600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369777:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639097600:12345-0@lo:400:kworker.0 Request processed in 31us (4843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.369783:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697 00000100:00100000:3.0:1788572333.369793:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698 00000100:00100000:3.0:1788572333.369799:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639097984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369824:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639097984:12345-0@lo:400:kworker.0 Request processed in 26us (4673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.369828:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698 00000100:00080000:3.0:1788572333.369844:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572333.369848:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572333.369851:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572333.369883:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639097344:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369895:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639097984:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369906:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639097088:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369915:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639097728:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369949:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639096960:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369959:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639097600:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.369970:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639097472:0@lo:400:kworker.0 00000100:00100000:3.0:1788572333.370029:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639097216:0@lo:8:kworker.0 00000100:00100000:3.0:1788572333.370064:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.370089:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639097856:0@lo:8:kworker.0 00000100:00100000:3.0:1788572333.370109:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.370137:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639097216 00000100:00100000:3.0:1788572333.370140:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639097216 00000100:00100000:3.0:1788572333.370159:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639097856 00000100:00100000:3.0:1788572333.370162:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639097856 00000100:00100000:3.0:1788572333.370176:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:3.0:1788572333.370179:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3649:x1875449639097216:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788572333.371388:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:2.0:1788572333.371399:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3649:x1875449639097856:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788572333.374338:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3649:x1875449639097216:12345-0@lo:8:kworker.0 Request processed in 4144us (4261us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788572333.374352:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:2.0:1788572333.378540:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3649:x1875449639097856:12345-0@lo:8:kworker.0 Request processed in 7131us (8419us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788572333.378556:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000020:01000004:1.0:1788572333.380173:0:114785:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788572333.380194:0:114785:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff94e62d25cd40) 00000020:00000080:1.0:1788572333.380388:0:114785:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788572333.380479:0:114785:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94e506b20000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788572333.380484:0:114785:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94e506b20000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788572333.380486:0:114785:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94e506b20000 3 00010000:00080000:1.0:1788572333.380517:0:114785:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94e633ec0000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788572333.382844:0:114785:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000080:1.0:1788572333.383761:0:114785:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788572333.383806:0:114785:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788572333.383819:0:114785:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xdb7edb52b8334d9c 00000100:00080000:1.0:1788572333.383831:0:114785:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788572333.383837:0:114785:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff94e633ec0000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572333.383874:0:114785:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e634b2a300 x1875449639098240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572333.383891:0:114785:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788572333.391714:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572333.391725:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572333.391728:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639097216:0@lo:8:kworker.0 00000100:00080000:3.0:1788572333.391853:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572333.391857:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788572333.391859:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639097856:0@lo:8:kworker.0 00000100:00100000:3.0:1788572333.391888:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1875449639098240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572333.391954:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.392024:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639098240 00000100:00100000:3.0:1788572333.392030:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639098240 00000100:00100000:3.0:1788572333.392062:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14680 00000100:00100000:3.0:1788572333.392117:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875449639098240:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788572333.392144:0:95742:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 4250 last 0 00000020:00000080:3.0:1788572333.392173:0:95742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdb7edb52b8334da3 00000004:00100000:3.0:1788572333.392187:0:95742:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572333.392216:0:95742:0:(import.c:65:import_set_state_nolock()) ffff94e6056fe800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572333.392260:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875449639098240:12345-0@lo:38:llog_process_th.0 Request processed in 190us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572333.392268:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14680 00000100:00100000:3.0:1788572333.392306:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788572333.392312:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788572333.392318:0:3649:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788572333.392321:0:3649:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788572333.392322:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e633ec0000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788572333.392326:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1875449639098240:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788572333.396446:0:114785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788572333.398196:0:114774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788572333.399114:0:114774:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788572333.399145:0:114774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e609745400/0xdb7edb52b8334d72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334d79 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.399157:0:114774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e609745400/0xdb7edb52b8334d72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334d79 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788572333.399219:0:114774:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788572333.399221:0:114774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572333.399231:0:114774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572333.399233:0:114774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572333.399234:0:114774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572333.399236:0:114774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572333.399237:0:114774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572333.399239:0:114774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572333.399241:0:114774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788572333.399246:0:114774:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788572333.399248:0:114774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788572333.399249:0:114774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572333.399250:0:114774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572333.399251:0:114774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572333.399252:0:114774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572333.399253:0:114774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572333.399254:0:114774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572333.399255:0:114774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572333.399256:0:114774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788572333.399286:0:114774:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788572333.399307:0:114774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639098368:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788572333.399381:0:114774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572333.399423:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639098368 00000100:00100000:3.0:1788572333.399437:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639098368 00000100:00100000:3.0:1788572333.399486:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788572333.399495:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:114774:x1875449639098368:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788572333.399526:0:111984:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788572333.399537:0:111984:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788572333.399686:0:114774:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e505db9a80 going to sleep for 11 seconds 20000000:01000000:3.0:1788572333.413250:0:111984:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788572333.413272:0:111984:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788572333.413411:0:111988:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788572333.413417:0:111988:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788572333.413441:0:111988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.413463:0:111988:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94e63ae3ae00/0xdb7edb52b831ca7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a40 expref: 9 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.413472:0:111988:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94e63ae3a000/0xdb7edb52b831ca9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b831ca96 expref: 24 pid: 111985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.413482:0:111988:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94e63af8ca00/0xdb7edb52b831cb0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b831cb06 expref: 24 pid: 111985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.413489:0:111988:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.413531:0:111988:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94e63af8ca00/0xdb7edb52b831cb0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb7edb52b831cb06 expref: 24 pid: 111985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.413544:0:111988:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94e63af8ca00/0xdb7edb52b831cb0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb7edb52b831cb06 expref: 24 pid: 111985 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572333.413558:0:111988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5063a9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:111988:1875449639098496:0@lo:104: 00000100:00100000:2.0:1788572333.413627:0:111988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572333.413677:0:111988:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94e63ae3a000/0xdb7edb52b831ca9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb7edb52b831ca96 expref: 24 pid: 111985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.413685:0:111988:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94e63ae3a000/0xdb7edb52b831ca9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb7edb52b831ca96 expref: 24 pid: 111985 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572333.413692:0:111988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:111988:1875449639098624:0@lo:104: 00000100:00100000:2.0:1788572333.413710:0:111988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572333.413738:0:111988:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94e63ae3ae00/0xdb7edb52b831ca7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a40 expref: 9 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.413747:0:111988:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94e63ae3ae00/0xdb7edb52b831ca7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a40 expref: 9 pid: 111991 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572333.413756:0:111988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e760000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:111988:1875449639098752:192.168.202.13@tcp:104: 00000100:00100000:2.0:1788572333.413812:0:111988:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e633dcf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572333.413868:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639098496 00000100:00100000:0.0:1788572333.413876:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639098496 00000100:00100000:0.0:1788572333.413921:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639098624 00000100:00100000:0.0:1788572333.413924:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639098624 00000100:00100000:0.0:1788572333.413940:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788572333.413947:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d74e0a07-d05f-49a8-aa32-40b653992526+4:111988:x1875449639098496:12345-0@lo:104: 00010000:00010000:0.0:1788572333.413960:0:6533:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff94e63ade8a00/0xdb7edb52b831cb06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb7edb52b831cb0d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414054:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788572333.414059:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d74e0a07-d05f-49a8-aa32-40b653992526+4:111988:x1875449639098496:12345-0@lo:104: Request processed in 113us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572333.414067:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788572333.414085:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788572333.414092:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e763100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d74e0a07-d05f-49a8-aa32-40b653992526+3:111988:x1875449639098624:12345-0@lo:104: 00010000:00010000:0.0:1788572333.414100:0:6533:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff94e637697e00/0xdb7edb52b831ca96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb7edb52b831ca9d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414131:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788572333.414136:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e763100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d74e0a07-d05f-49a8-aa32-40b653992526+3:111988:x1875449639098624:12345-0@lo:104: Request processed in 46us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.414366:0:111988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5063a9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:111988:1875449639098496:0@lo:104: 00000100:00100000:2.0:1788572333.414374:0:111988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:111988:1875449639098624:0@lo:104: 00000100:00100000:0.0:1788572333.414442:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:0.0:1788572333.414462:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572333.414467:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff94e63ade8a00/0xdb7edb52b831cb06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb7edb52b831cb0d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414475:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade8a00 already unused, calling callback (ffffffffc11ccc20) 10000000:00010000:0.0:1788572333.414478:0:6538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff94e63ade8a00/0xdb7edb52b831cb06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb7edb52b831cb0d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414490:0:6538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ade8a00/0xdb7edb52b831cb06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb7edb52b831cb0d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572333.414497:0:6538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ade8a00/0xdb7edb52b831cb06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb7edb52b831cb0d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572333.414503:0:6538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572333.414540:0:6538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff94e63ade8a00/0xdb7edb52b831cb06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb7edb52b831cb0d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414547:0:6538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572333.414577:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff94e63ade8a00/0xdb7edb52b831cb06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb7edb52b831cb0d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414584:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ade8a00/0xdb7edb52b831cb06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb7edb52b831cb0d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414597:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572333.414600:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff94e637697e00/0xdb7edb52b831ca96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb7edb52b831ca9d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414605:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637697e00 already unused, calling callback (ffffffffc11ccc20) 10000000:00010000:0.0:1788572333.414608:0:6538:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff94e637697e00/0xdb7edb52b831ca96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb7edb52b831ca9d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414614:0:6538:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e637697e00/0xdb7edb52b831ca96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb7edb52b831ca9d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788572333.414619:0:6538:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e637697e00/0xdb7edb52b831ca96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb7edb52b831ca9d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572333.414625:0:6538:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788572333.414639:0:6538:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff94e637697e00/0xdb7edb52b831ca96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb7edb52b831ca9d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414644:0:6538:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788572333.414659:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff94e637697e00/0xdb7edb52b831ca96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb7edb52b831ca9d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414666:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e637697e00/0xdb7edb52b831ca96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb7edb52b831ca9d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.414678:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572333.414680:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572333.414681:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572333.414687:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572333.414698:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572333.414701:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639099008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572333.414709:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639098880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572333.414734:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572333.414750:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572333.414812:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639098880 00000100:00100000:2.0:1788572333.414817:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639098880 00010000:00010000:2.0:1788572333.414838:0:6536:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94e63af8ca00/0xdb7edb52b831cb0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb7edb52b831cb06 expref: 25 pid: 111985 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572333.414867:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639099008 00000100:00100000:2.0:1788572333.414870:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639099008 00010000:00010000:2.0:1788572333.414881:0:6536:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94e63ae3a000/0xdb7edb52b831ca9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb7edb52b831ca96 expref: 26 pid: 111985 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572333.414905:0:8491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788572333.414910:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788572333.414915:0:8491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d74e0a07-d05f-49a8-aa32-40b653992526+26:3652:x1875449639098880:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572333.414915:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d74e0a07-d05f-49a8-aa32-40b653992526+26:3650:x1875449639099008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572333.414925:0:8491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572333.414925:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572333.414931:0:8491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94e63af8ca00/0xdb7edb52b831cb0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb7edb52b831cb06 expref: 26 pid: 111985 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.414931:0:6536:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94e63ae3a000/0xdb7edb52b831ca9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb7edb52b831ca96 expref: 26 pid: 111985 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572333.414942:0:8491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94e63af8ca00/0xdb7edb52b831cb0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb7edb52b831cb06 expref: 26 pid: 111985 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572333.415394:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+26:114774:x1875449639098368:12345-0@lo:253:mount.lustre.0 Request processed in 15897us (16011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572333.415404:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788572333.415491:0:114774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:114774:1875449639098368:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788572333.415503:0:114774:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788572333.415506:0:114774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788572333.415507:0:114774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572333.415509:0:114774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572333.415510:0:114774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572333.415512:0:114774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572333.415513:0:114774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572333.415514:0:114774:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572333.415516:0:114774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572333.415517:0:114774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788572333.415534:0:114774:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788572333.417719:0:6536:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94e63ae3a000/0xdb7edb52b831ca9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb7edb52b831ca96 expref: 25 pid: 111985 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.417744:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63ae3a000/0xdb7edb52b831ca9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb7edb52b831ca96 expref: 25 pid: 111985 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572333.417760:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572333.417834:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639099008:12345-0@lo:103:ldlm_bl.0 Request processed in 2917us (3081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572333.417843:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788572333.418064:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639099008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572333.421103:0:8491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63af8ca00/0xdb7edb52b831cb0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb7edb52b831cb06 expref: 23 pid: 111985 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572333.421128:0:8491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572333.421268:0:8491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d74e0a07-d05f-49a8-aa32-40b653992526+22:3652:x1875449639098880:12345-0@lo:103:ldlm_bl.0 Request processed in 6352us (6529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572333.421278:0:8491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788572333.422156:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639098880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572333.427077:0:111988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e760000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:111988:1875449639098752:192.168.202.13@tcp:104: 00010000:00010000:2.0:1788572333.427123:0:111988:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788572333.428207:0:114774:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 8589935776 00000100:00100000:2.0:1788572333.428627:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572333.428701:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616092672 00000100:00100000:0.0:1788572333.428711:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616092672 00010000:00010000:0.0:1788572333.428754:0:6535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94e63ae3ae00/0xdb7edb52b831ca7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a40 expref: 10 pid: 111991 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572333.428801:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 389 00000100:00100000:0.0:1788572333.428811:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e760000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616092672:12345-192.168.202.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788572333.428826:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788572333.428832:0:6535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94e63ae3ae00/0xdb7edb52b831ca7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a40 expref: 10 pid: 111991 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.428845:0:6535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94e63ae3ae00/0xdb7edb52b831ca7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a40 expref: 10 pid: 111991 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.428864:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63ae3ae00/0xdb7edb52b831ca7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a40 expref: 10 pid: 111991 timeout: 4350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.428879:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.428888:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788572333.428914:0:6535:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015497602s 00010000:00010000:0.0:1788572333.428920:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.428927:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.428935:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.428942:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.428949:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572333.428953:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.428964:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.428993:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572333.429026:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788572333.429194:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e760000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+9:2384:x1875449616092672:12345-192.168.202.13@tcp:103:ldlm_bl.0 Request processed in 383us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572333.429203:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 389 00010000:00010000:3.0:1788572333.429454:0:111988:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.429463:0:111988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572333.429469:0:111988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e637701c00/0xdb7edb52b8334daa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788572333.430239:0:114791:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-OST0000: started recovery thread pid 114791 00010000:02000000:1.0:1788572333.430255:0:114791:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1788572333.431083:0:114774:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788572333.431147:0:114774:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788572333.431168:0:114774:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788572333.431202:0:114774:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788572333.432066:0:114774:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572333.432313:0:114774:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:1.0:1788572333.455498:0:114791:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:1.0:1788572333.455505:0:114791:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:2.0:1788572333.769032:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788572334.548665:0:114840:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788572334.548969:0:114840:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788572334.805377:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572335.107716:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639099136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572335.107791:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.112881:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639099136 00000100:00100000:3.0:1788572335.112900:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639099136 00000100:00100000:3.0:1788572335.112973:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741 00000100:00100000:3.0:1788572335.112984:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639099136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572335.113166:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572335.113261:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639099136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 278us (5468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572335.113268:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741 00000100:00100000:0.0:1788572335.117307:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639099136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572335.199496:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572335.199628:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616092800 00000100:00100000:3.0:1788572335.199639:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616092800 00000100:00100000:3.0:1788572335.199707:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 139 00000100:00100000:3.0:1788572335.199717:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+9:15207:x1875449616092800:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572335.199735:0:111991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572335.199754:0:111991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e609744800/0xdb7edb52b8334db1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4a74e expref: -99 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.199784:0:111991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e609744800/0xdb7edb52b8334db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4a74e expref: 10 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.199795:0:111991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e609744800/0xdb7edb52b8334db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4a74e expref: 10 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.199805:0:111991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e609744800, rc 0) 00000100:00100000:3.0:1788572335.199868:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:15207:x1875449616092800:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 152us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572335.199875:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 139 00000100:00100000:3.0:1788572335.203351:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572335.204133:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616092928 00000100:00100000:0.0:1788572335.204146:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616092928 00000100:00100000:0.0:1788572335.204215:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 140 00000100:00100000:0.0:1788572335.204226:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:15207:x1875449616092928:12345-192.168.202.13@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788572335.204253:0:111983:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788572335.204272:0:111983:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788572335.204276:0:111983:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 208 00000100:00100000:0.0:1788572335.214286:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:15207:x1875449616092928:12345-192.168.202.13@tcp:256:ll_cfg_requeue.0 Request processed in 10051us (10934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572335.214304:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 140 00000100:00100000:0.0:1788572335.221810:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572335.221909:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616093056 00000100:00100000:1.0:1788572335.221919:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616093056 00000100:00100000:1.0:1788572335.221976:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3832 00000100:00100000:1.0:1788572335.221984:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2382:x1875449616093056:12345-192.168.202.13@tcp:8:ll_cfg_requeue.0 00010000:00080000:1.0:1788572335.222063:0:43966:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '35eb2d60-2de0-4b00-9815-d5153edd0057' at ffff94e62d804800, cookie 0xdb7edb52b8334d5d 00010000:00080000:1.0:1788572335.222069:0:43966:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp recovering/t0 exp ffff94e62d804800 cur 4252 last 1788572333 00010000:02000400:1.0:1788572335.222077:0:43966:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:1.0:1788572335.222083:0:43966:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00002000:00100000:1.0:1788572335.222095:0:43966:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35eb2d60-2de0-4b00-9815-d5153edd0057/ffff94e62d804800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788572335.222112:0:43966:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788572335.222253:0:43966:0:(import.c:65:import_set_state_nolock()) ffff94e64155f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572335.222320:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2382:x1875449616093056:12345-192.168.202.13@tcp:8:ll_cfg_requeue.0 Request processed in 334us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572335.222329:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3832 00000100:00100000:3.0:1788572335.233502:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572335.233587:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616093184 00000100:00100000:0.0:1788572335.233600:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616093184 00000100:00100000:0.0:1788572335.233665:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3699 00000100:00100000:0.0:1788572335.233676:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2382:x1875449616093184:12345-192.168.202.13@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788572335.233698:0:43973:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff94e637715880 x1875449616093184/t0(0) o400->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:751/0 lens 224/0 e 0 to 0 dl 1788572346 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.233724:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2382:x1875449616093184:12345-192.168.202.13@tcp:400:ldlm_lock_repla.0 Request processed in 51us (235us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.233731:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3699 00010000:00080000:2.0:1788572335.233777:0:114791:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 10000000:01000000:2.0:1788572335.377495:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788572335.377504:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94e6056ea000 from 208 10000000:01000000:2.0:1788572335.377510:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788572335.377754:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.377768:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.377781:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572335.377811:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639099264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572335.377902:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.378066:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e6186a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572335.400788:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639099264 00000100:00100000:3.0:1788572335.400803:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639099264 00000100:00100000:3.0:1788572335.401450:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788572335.401463:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+22:6548:x1875449639099264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572335.401479:0:111991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572335.401499:0:111991:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e609744400/0xdb7edb52b8334dbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b8334db8 expref: -99 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.401527:0:111991:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e609744400/0xdb7edb52b8334dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b8334db8 expref: 23 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.401538:0:111991:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e609744400/0xdb7edb52b8334dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b8334db8 expref: 23 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.401547:0:111991:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e609744400, rc 0) 00000100:00100000:3.0:1788572335.401626:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+23:6548:x1875449639099264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (23724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572335.401633:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788572335.402479:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639099264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572335.402507:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.402518:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572335.402602:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639099392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788572335.402652:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.402690:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e6186a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572335.405524:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639099392 00000100:00100000:3.0:1788572335.405542:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639099392 00000100:00100000:3.0:1788572335.405613:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788572335.405625:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+23:6548:x1875449639099392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788572335.405656:0:111989:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788572335.405675:0:111989:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788572335.405678:0:111989:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 208 00000100:00100000:3.0:1788572335.405809:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+23:6548:x1875449639099392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572335.405818:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788572335.406251:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639099392:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1788572335.406299:0:6548:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff94e640d5d800 already not connected (conn 8, was 0): DISCONN 00010000:00080000:2.0:1788572335.406311:0:6548:0:(ldlm_lib.c:85:import_set_conn()) imp ffff94e640d5d800@lustre-OST0000-osc-MDT0000: found existing conn 192.168.202.113@tcp, moved to head 00000100:00080000:2.0:1788572335.406317:0:6548:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572335.406325:0:6548:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94e640d5d800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572335.406355:0:6548:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e64173d500 x1875449639099520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1788572335.406408:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:3.0:1788572335.406418:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639099520:0@lo:8:ll_cfg_requeue.0 00010000:00010000:2.0:1788572335.406419:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.406429:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572335.406439:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788572335.406441:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94e63ad0e800 from 208 10000000:01000000:2.0:1788572335.406445:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:3.0:1788572335.406455:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572335.406468:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637700c00/0xdb7edb52b8334dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.406476:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e637700c00/0xdb7edb52b8334dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.406485:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e637700c00/0xdb7edb52b8334dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572335.406501:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639099648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572335.406529:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.406573:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e6186a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572335.406596:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639099648 00000100:00100000:3.0:1788572335.406601:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639099648 00000100:00100000:3.0:1788572335.406643:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788572335.406651:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+23:6548:x1875449639099648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572335.406662:0:111983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572335.406675:0:111983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e609745800/0xdb7edb52b8334dcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b8334dc6 expref: -99 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.406700:0:111983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e609745800/0xdb7edb52b8334dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b8334dc6 expref: 24 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.406710:0:111983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e609745800/0xdb7edb52b8334dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b8334dc6 expref: 24 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.406724:0:111983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e609745800, rc 0) 00000100:00100000:3.0:1788572335.406753:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:6548:x1875449639099648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572335.406759:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788572335.406827:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639099648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572335.406842:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e637700c00/0xdb7edb52b8334dc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334dcd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.406856:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e637700c00/0xdb7edb52b8334dc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b8334dcd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572335.406885:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639099520 00000100:00100000:0.0:1788572335.406889:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639099520 00000100:00100000:2.0:1788572335.406897:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639099776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788572335.406912:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:0.0:1788572335.406917:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3649:x1875449639099520:12345-0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1788572335.406926:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788572335.406938:0:43968:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff94e603bce000, cookie 0xdb7edb52b8334d56 00010000:00080000:0.0:1788572335.406943:0:43968:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t8589935777 exp ffff94e603bce000 cur 4252 last 1788572333 00002000:00100000:0.0:1788572335.406965:0:43968:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff94e603bce000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788572335.406969:0:43968:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788572335.406972:0:43968:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1788572335.407151:0:43968:0:(import.c:65:import_set_state_nolock()) ffff94e633fba800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572335.407207:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3649:x1875449639099520:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 288us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572335.407215:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00010000:00080000:0.0:1788572335.407263:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94e64173d500 x1875449639099520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788572360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.407278:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788572335.407287:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788572335.407354:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.407357:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.407363:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.407370:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 0 00000100:00080000:0.0:1788572335.407375:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.407385:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639099520:0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1788572335.407400:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639032576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.407424:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.414884:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639032576 00000100:00100000:0.0:1788572335.414905:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639032576 00000100:00100000:0.0:1788572335.414988:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:0.0:1788572335.414999:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875449639032576:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.415041:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935777, current: 8589935777, replaying 00000100:00100000:0.0:1788572335.415064:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875449639032576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 68us (7639us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.415072:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:3.0:1788572335.429466:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639099776 00010000:00080000:2.0:1788572335.429482:0:114791:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1788572335.429482:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639099776 00000100:00100000:2.0:1788572335.429516:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e6186a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572335.430111:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788572335.430129:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:6548:x1875449639099776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788572335.430174:0:111984:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788572335.430201:0:111984:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788572335.430205:0:111984:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 208 00000100:00100000:3.0:1788572335.430365:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:6548:x1875449639099776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 241us (23436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572335.430470:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639099776:0@lo:256:ll_cfg_requeue.0 00000100:00080000:2.0:1788572335.430524:0:6548:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff94e501c62000 already not connected (conn 15, was 0): DISCONN 00010000:00080000:2.0:1788572335.430537:0:6548:0:(ldlm_lib.c:85:import_set_conn()) imp ffff94e501c62000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.202.113@tcp, moved to head 00000100:00080000:2.0:1788572335.430543:0:6548:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572335.430551:0:6548:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff94e501c62000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572335.430586:0:6548:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e5063a9880 x1875449639099904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:2.0:1788572335.430636:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788572335.430647:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637700c00/0xdb7edb52b8334dc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334dcd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.430657:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e637700c00/0xdb7edb52b8334dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334dcd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572335.431620:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639099904:0@lo:8:ll_cfg_requeue.0 00000100:00100000:0.0:1788572335.431686:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.431777:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639099904 00000100:00100000:0.0:1788572335.431783:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639099904 00000100:00100000:0.0:1788572335.431823:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:0.0:1788572335.431829:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3649:x1875449639099904:12345-0@lo:8:ll_cfg_requeue.0 00010000:00080000:0.0:1788572335.431858:0:43976:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff94e603bcc800, cookie 0xdb7edb52b8334d4f 00010000:00080000:0.0:1788572335.431863:0:43976:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff94e603bcc800 cur 4252 last 1788572333 00002000:00100000:0.0:1788572335.431883:0:43976:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff94e603bcc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788572335.431887:0:43976:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788572335.431891:0:43976:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:0.0:1788572335.431934:0:43976:0:(import.c:65:import_set_state_nolock()) ffff94e633fbb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572335.431990:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3649:x1875449639099904:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 160us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572335.431997:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00010000:00080000:0.0:1788572335.432051:0:114791:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1788572335.432057:0:114791:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 8589935777 00010000:00080000:0.0:1788572335.432061:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 1, req_transno: 8589935777, next_transno: 8589935777 00010000:00080000:0.0:1788572335.432064:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935777) 00010000:00080000:0.0:1788572335.432073:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639032576 t8589935777 from 0@lo req@ffff94e63ae3fb80 x1875449639032576/t0(8589935777) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.432103:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2467 count 1 00010000:00080000:0.0:1788572335.433430:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94e5063a9880 x1875449639099904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788572360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.433454:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788572335.433468:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1788572335.433474:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.433478:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00080000:0.0:1788572335.433482:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e501c62000 from lustre-OST0000_UUID committed 4294967297 last 0 00000100:00080000:0.0:1788572335.433486:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00002000:00010000:0.0:1788572335.434494:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.434506:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334dd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.434529:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a3:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.434534:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.434664:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.434687:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.434697:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334dd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.434705:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.434725:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.434907:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.434931:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 8589935778 00010000:00080000:0.0:1788572335.434937:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 8589935778 00010000:00010000:0.0:1788572335.434958:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.434964:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.434972:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.434978:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334dd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.434993:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334dd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.435110:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334dd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.435119:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8334dd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.435136:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.435138:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.435140:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572335.436869:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639099904:0@lo:8:ll_cfg_requeue.0 00000100:00080000:0.0:1788572335.436924:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.436933:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.436936:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.436941:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.436948:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935777 00000100:00080000:0.0:1788572335.436956:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377c1f80 x1875449639033088/t8589935778(8589935778) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.436966:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639032576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.437021:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639033088:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.437093:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.443184:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639033088 00000100:00100000:2.0:1788572335.443201:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639033088 00000100:00100000:2.0:1788572335.443265:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:2.0:1788572335.443275:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3649:x1875449639033088:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.443289:0:43974:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935778, current: 8589935778, replaying 00000100:00100000:2.0:1788572335.443416:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3649:x1875449639033088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 142us (6321us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.443424:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00010000:00080000:1.0:1788572335.445453:0:114865:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:1.0:1788572335.445462:0:114865:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:1.0:1788572335.445469:0:114865:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:1.0:1788572335.445516:0:114865:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788572335.445813:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639100032:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788572335.445892:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.445987:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639100032 00000100:00100000:1.0:1788572335.445995:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639100032 00000100:00100000:1.0:1788572335.446089:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700 00000100:00100000:1.0:1788572335.446098:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5063a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3649:x1875449639100032:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788572335.446115:0:43967:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff94e5063a9880 x1875449639100032/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:751/0 lens 224/0 e 0 to 0 dl 1788572346 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.446127:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5063a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3649:x1875449639100032:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 32us (237us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.446134:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700 00010000:00080000:0.0:1788572335.447155:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935778, next_transno: 8589935778 00010000:00080000:0.0:1788572335.447170:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935778) 00010000:00080000:0.0:1788572335.447182:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639033088 t8589935778 from 0@lo req@ffff94e63ae3f800 x1875449639033088/t0(8589935778) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.447227:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2471 count 1 00002000:00010000:0.0:1788572335.447351:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.447359:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ddb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.447375:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a7:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.447380:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.447386:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.447401:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.447413:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ddb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.447420:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.447444:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.447599:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.447615:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935779 00010000:00080000:0.0:1788572335.447619:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935779 00000100:00080000:0.0:1788572335.447659:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377c1f80 x1875449639033088/t8589935778(8589935778) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.447669:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.447671:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.447677:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.447684:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935778 00000100:00080000:0.0:1788572335.447690:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377c1500 x1875449639032960/t8589935779(8589935779) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.447701:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639033088:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.447714:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639032960:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.447741:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.448618:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788572335.448657:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639032960 00000100:00100000:3.0:1788572335.448664:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639032960 00010000:00010000:1.0:1788572335.448703:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788572335.448705:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00010000:00010000:1.0:1788572335.448711:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572335.448714:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1875449639032960:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572335.448722:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280200 already unused, calling callback (ffffffffc0be44f0) 00010000:00080000:3.0:1788572335.448723:0:8464:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935779, current: 8589935779, replaying 00010000:00010000:1.0:1788572335.448726:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ddb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572335.448734:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1875449639032960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23us (994us total) trans 0 rc 0/-999 00010000:00010000:1.0:1788572335.448737:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ddb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572335.448740:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00010000:00080000:3.0:1788572335.448754:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935779, next_transno: 8589935779 00010000:00080000:3.0:1788572335.448757:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935779) 00010000:00010000:1.0:1788572335.448759:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ddb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788572335.448764:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639032960 t8589935779 from 0@lo req@ffff94e63ae3c700 x1875449639032960/t0(8589935779) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572335.448767:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ddb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.448788:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.448790:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.448792:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788572335.448796:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2470 count 1 00002000:00010000:3.0:1788572335.448887:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.448893:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334de2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.448902:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a6:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.448905:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.448911:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.448923:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.448932:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334de2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.448938:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.448964:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.449111:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.449121:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935780 00010000:00080000:3.0:1788572335.449125:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935780 00000100:00080000:3.0:1788572335.449154:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377c1500 x1875449639032960/t8589935779(8589935779) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.449274:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.449277:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.449282:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.449290:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935779 00000100:00080000:3.0:1788572335.449296:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377c1880 x1875449639033472/t8589935780(8589935780) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.449305:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639032960:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.449320:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639033472:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.449347:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.449383:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639033472 00000100:00100000:2.0:1788572335.449388:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639033472 00000100:00100000:2.0:1788572335.449426:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:2.0:1788572335.449434:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3649:x1875449639033472:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.449441:0:17011:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935780, current: 8589935780, replaying 00000100:00100000:2.0:1788572335.449449:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3649:x1875449639033472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18us (103us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.449458:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00010000:00080000:3.0:1788572335.449508:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935780, next_transno: 8589935780 00010000:00080000:3.0:1788572335.449511:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935780) 00010000:00080000:3.0:1788572335.449517:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639033472 t8589935780 from 0@lo req@ffff94e637717100 x1875449639033472/t0(8589935780) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.449601:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2474 count 1 00002000:00010000:3.0:1788572335.449663:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.449669:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334de9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.449679:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9aa:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.449682:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.449686:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.449697:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.449706:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334de9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.449713:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334de9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.449735:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00080000:3.0:1788572335.449816:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.449828:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935781 00010000:00080000:3.0:1788572335.449831:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935781 00000100:00080000:3.0:1788572335.449855:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377c1880 x1875449639033472/t8589935780(8589935780) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.449862:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.449864:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.449868:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.449875:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935780 00000100:00080000:3.0:1788572335.449881:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377c0e00 x1875449639032704/t8589935781(8589935781) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.449888:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639033472:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.449897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639032704:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.449922:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572335.449984:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572335.449991:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.449999:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.450045:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334de2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.450055:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334de2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.450071:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334de2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.450079:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334de2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.450099:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.450103:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334de9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.450109:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.450112:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334de9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.450126:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334de9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.450136:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334de9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.450144:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334de9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.450156:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.450157:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.450159:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.450294:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572335.450305:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639032704 00000100:00100000:1.0:1788572335.450309:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639032704 00000100:00100000:1.0:1788572335.450343:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:1.0:1788572335.450351:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3649:x1875449639032704:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.450358:0:43966:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935781, current: 8589935781, replaying 00000100:00100000:1.0:1788572335.450376:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3649:x1875449639032704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27us (454us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.450382:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00010000:00080000:2.0:1788572335.451173:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935781, next_transno: 8589935781 00010000:00080000:2.0:1788572335.451180:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935781) 00010000:00080000:2.0:1788572335.451190:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639032704 t8589935781 from 0@lo req@ffff94e637714000 x1875449639032704/t0(8589935781) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.451226:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2468 count 1 00002000:00010000:2.0:1788572335.451392:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.451400:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334df0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.451413:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a4:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.451418:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.451424:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.451444:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.451455:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334df0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.451463:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.451483:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.452069:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.452088:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935782 00010000:00080000:2.0:1788572335.452093:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935782 00000100:00080000:3.0:1788572335.452209:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377c0e00 x1875449639032704/t8589935781(8589935781) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.452218:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.452221:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.452225:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.452232:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935781 00000100:00080000:3.0:1788572335.452239:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377c3480 x1875449639033216/t8589935782(8589935782) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.452249:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639032704:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.452265:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639033216:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.452309:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.452356:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639033216 00000100:00100000:3.0:1788572335.452361:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639033216 00000100:00100000:3.0:1788572335.452401:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:3.0:1788572335.452409:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+10:3649:x1875449639033216:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.452418:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935782, current: 8589935782, replaying 00000100:00100000:3.0:1788572335.452429:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+10:3649:x1875449639033216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22us (132us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.452436:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00010000:00080000:3.0:1788572335.452446:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935782, next_transno: 8589935782 00010000:00080000:3.0:1788572335.452448:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935782) 00010000:00080000:3.0:1788572335.452453:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639033216 t8589935782 from 0@lo req@ffff94e633db3800 x1875449639033216/t0(8589935782) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.452480:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2472 count 1 00002000:00010000:3.0:1788572335.452570:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.452577:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334df7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.452589:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a8:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.452593:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.452598:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.452610:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.452620:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334df7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.452628:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.452644:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00080000:3.0:1788572335.452727:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.452739:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935783 00010000:00080000:3.0:1788572335.452743:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935783 00000100:00080000:3.0:1788572335.452766:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377c3480 x1875449639033216/t8589935782(8589935782) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.452773:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.452775:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.452779:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.452791:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935782 00000100:00080000:3.0:1788572335.452796:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377c3800 x1875449639032832/t8589935783(8589935783) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.452805:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639033216:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.452814:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639032832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.452836:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.452865:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639032832 00000100:00100000:3.0:1788572335.452869:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639032832 00000100:00100000:3.0:1788572335.452893:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:3.0:1788572335.452900:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3649:x1875449639032832:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.452906:0:43968:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935783, current: 8589935783, replaying 00000100:00100000:3.0:1788572335.452914:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3649:x1875449639032832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16us (78us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.452920:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00010000:00010000:3.0:1788572335.452932:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572335.452939:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.452947:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.452951:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334df0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.452961:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334df0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.452983:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334df0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.452991:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334df0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453051:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.453055:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453062:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.453065:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334df7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453073:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334df7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453084:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334df7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453091:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334df7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453104:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.453106:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.453108:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572335.453115:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935783, next_transno: 8589935783 00010000:00080000:3.0:1788572335.453117:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935783) 00010000:00080000:3.0:1788572335.453123:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639032832 t8589935783 from 0@lo req@ffff94e633db0000 x1875449639032832/t0(8589935783) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.453142:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2469 count 1 00002000:00010000:3.0:1788572335.453196:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.453201:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334dfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453210:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a5:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.453212:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.453217:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334dfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453226:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334dfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453235:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334dfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453241:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334dfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453255:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.453327:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.453338:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935784 00010000:00080000:3.0:1788572335.453342:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935784 00000100:00080000:3.0:1788572335.453365:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377c3800 x1875449639032832/t8589935783(8589935783) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.453372:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.453374:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.453377:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.453383:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935783 00000100:00080000:3.0:1788572335.453387:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377c2300 x1875449639033344/t8589935784(8589935784) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.453395:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639032832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.453404:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639033344:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.453426:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.453454:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639033344 00000100:00100000:3.0:1788572335.453457:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639033344 00000100:00100000:3.0:1788572335.453478:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:3.0:1788572335.453484:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3649:x1875449639033344:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.453490:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935784, current: 8589935784, replaying 00000100:00100000:3.0:1788572335.453497:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3649:x1875449639033344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14us (71us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.453503:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00010000:00080000:3.0:1788572335.453512:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935784, next_transno: 8589935784 00010000:00080000:3.0:1788572335.453515:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935784) 00010000:00080000:3.0:1788572335.453519:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639033344 t8589935784 from 0@lo req@ffff94e6377d3100 x1875449639033344/t0(8589935784) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.453542:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2473 count 1 00002000:00010000:3.0:1788572335.453592:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.453598:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453606:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a9:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.453609:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.453613:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453623:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453631:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453637:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453652:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00080000:3.0:1788572335.453719:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.453729:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935785 00010000:00080000:3.0:1788572335.453732:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935785 00010000:00010000:3.0:1788572335.453742:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572335.453747:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334dfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453760:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.453763:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334dfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453771:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334dfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453783:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334dfe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453790:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334dfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453803:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.453806:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453813:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.453816:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453824:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453833:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453841:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.453853:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.453855:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.453857:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572335.453878:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377c2300 x1875449639033344/t8589935784(8589935784) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.453885:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.453887:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.453891:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.453898:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935784 00000100:00080000:3.0:1788572335.453903:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62d952a00 x1875449639034624/t8589935785(8589935785) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.453913:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639033344:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.453923:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639034624:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.453946:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.453974:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639034624 00000100:00100000:3.0:1788572335.453978:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639034624 00000100:00100000:3.0:1788572335.454025:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:3.0:1788572335.454047:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+13:3649:x1875449639034624:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.454054:0:43976:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935785, current: 8589935785, replaying 00000100:00100000:3.0:1788572335.454062:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+13:3649:x1875449639034624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32us (117us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.454068:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00010000:00080000:3.0:1788572335.454081:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935785, next_transno: 8589935785 00010000:00080000:3.0:1788572335.454084:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935785) 00010000:00080000:3.0:1788572335.454088:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639034624 t8589935785 from 0@lo req@ffff94e6377d1f80 x1875449639034624/t0(8589935785) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.454105:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2475 count 1 00002000:00010000:3.0:1788572335.454165:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.454170:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.454179:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ab:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.454182:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.454186:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.454196:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.454205:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.454212:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.454225:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.454295:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.454306:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935786 00010000:00080000:3.0:1788572335.454309:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935786 00000100:00080000:3.0:1788572335.454330:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62d952a00 x1875449639034624/t8589935785(8589935785) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.454336:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.454338:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.454341:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.454346:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935785 00000100:00080000:3.0:1788572335.454351:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e50552d500 x1875449639035136/t8589935786(8589935786) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.454357:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639034624:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.454366:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.454388:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572335.454530:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.454537:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.454544:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.454548:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.454556:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.454567:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.454574:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.454590:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.454591:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.454593:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.454599:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572335.454608:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639035136 00000100:00100000:1.0:1788572335.454612:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639035136 00000100:00100000:1.0:1788572335.454650:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:1.0:1788572335.454656:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3649:x1875449639035136:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.454662:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935786, current: 8589935786, replaying 00000100:00100000:1.0:1788572335.454672:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3649:x1875449639035136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17us (284us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.454677:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00010000:00010000:1.0:1788572335.454686:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.454695:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935786, next_transno: 8589935786 00010000:00080000:1.0:1788572335.454698:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935786) 00010000:00080000:1.0:1788572335.454702:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639035136 t8589935786 from 0@lo req@ffff94e63c5d1050 x1875449639035136/t0(8589935786) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.454720:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2479 count 1 00002000:00010000:1.0:1788572335.454780:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.454785:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.454793:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9af:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.454796:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.454800:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.454809:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.454818:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.454825:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.454845:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.454927:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.454937:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935787 00010000:00080000:1.0:1788572335.454940:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935787 00000100:00080000:1.0:1788572335.454962:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e50552d500 x1875449639035136/t8589935786(8589935786) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.454970:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.454972:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.454976:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.454982:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935786 00000100:00080000:1.0:1788572335.454987:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62d950380 x1875449639035008/t8589935787(8589935787) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.454995:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.455022:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035008:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.455061:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.455089:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639035008 00000100:00100000:1.0:1788572335.455093:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639035008 00000100:00100000:1.0:1788572335.455119:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:1.0:1788572335.455126:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3649:x1875449639035008:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.455132:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935787, current: 8589935787, replaying 00000100:00100000:1.0:1788572335.455140:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3649:x1875449639035008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16us (80us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.455149:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00010000:00010000:1.0:1788572335.455168:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.455173:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.455180:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.455184:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.455192:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.455204:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.455211:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.455226:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.455228:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.455230:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.455237:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935787, next_transno: 8589935787 00010000:00080000:1.0:1788572335.455239:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935787) 00010000:00080000:1.0:1788572335.455244:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639035008 t8589935787 from 0@lo req@ffff94e60fe46300 x1875449639035008/t0(8589935787) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.455262:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2478 count 1 00002000:00010000:1.0:1788572335.455315:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.455320:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334e1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.455328:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ae:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.455331:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.455335:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.455345:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.455353:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334e1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.455361:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.455382:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572335.455399:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.455404:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.455411:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.455414:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334e1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.455422:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334e1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.455432:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334e1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.455440:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334e1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788572335.455453:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00010000:3.0:1788572335.455453:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.455455:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.455457:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.455462:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935788 00010000:00080000:1.0:1788572335.455466:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935788 00000100:00080000:2.0:1788572335.455502:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62d950380 x1875449639035008/t8589935787(8589935787) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.455510:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.455512:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.455515:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.455521:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935787 00000100:00080000:2.0:1788572335.455527:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e50552f480 x1875449639035520/t8589935788(8589935788) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.455536:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.455557:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.455584:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.455713:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639035520 00000100:00100000:3.0:1788572335.455718:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639035520 00000100:00100000:3.0:1788572335.455756:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1788572335.455763:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+16:3649:x1875449639035520:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.455769:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935788, current: 8589935788, replaying 00000100:00100000:3.0:1788572335.455782:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+16:3649:x1875449639035520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21us (199us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.455787:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00010000:00080000:0.0:1788572335.469238:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935788, next_transno: 8589935788 00010000:00080000:0.0:1788572335.469250:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935788) 00010000:00080000:0.0:1788572335.469266:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639035520 t8589935788 from 0@lo req@ffff94e61e762a00 x1875449639035520/t0(8589935788) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.469322:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2482 count 1 00002000:00010000:0.0:1788572335.469462:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.469471:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334e21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.469487:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b2:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.469492:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.469498:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.469513:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.469523:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334e21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.469530:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.469560:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.469727:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.469750:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935789 00010000:00080000:0.0:1788572335.469755:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935789 00010000:00010000:2.0:1788572335.470195:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.470204:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.470213:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.470218:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334e21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.470228:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334e21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.470246:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334e21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.470253:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334e21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.470273:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.470274:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.470276:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.470334:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e50552f480 x1875449639035520/t8589935788(8589935788) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.470343:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.470346:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.470352:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.470366:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935788 00000100:00080000:2.0:1788572335.470375:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e50552ed80 x1875449639035648/t8589935789(8589935789) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.470387:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.470406:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035648:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.470448:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.478364:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639035648 00000100:00100000:0.0:1788572335.478381:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639035648 00000100:00100000:0.0:1788572335.478438:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:0.0:1788572335.478449:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3649:x1875449639035648:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.478463:0:17011:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935789, current: 8589935789, replaying 00000100:00100000:0.0:1788572335.478477:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3649:x1875449639035648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31us (8029us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.478484:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00010000:00080000:0.0:1788572335.478512:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935789, next_transno: 8589935789 00010000:00080000:0.0:1788572335.478516:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935789) 00010000:00080000:0.0:1788572335.478525:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639035648 t8589935789 from 0@lo req@ffff94e63ae6b480 x1875449639035648/t0(8589935789) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.478582:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2483 count 1 00002000:00010000:0.0:1788572335.478881:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.478891:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334e28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.478908:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b3:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.478912:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.478919:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334e28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.478934:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334e28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.478945:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334e28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.478953:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334e28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.478974:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.479186:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00080000:0.0:1788572335.479202:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935790 00010000:00080000:0.0:1788572335.479207:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935790 00010000:00010000:1.0:1788572335.479364:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.479371:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334e28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.479378:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.479383:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334e28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.479392:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334e28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.479409:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334e28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.479417:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334e28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.479433:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.479435:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.479436:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.479777:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e50552ed80 x1875449639035648/t8589935789(8589935789) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.479786:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.479789:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.479794:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.479801:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935789 00000100:00080000:2.0:1788572335.479810:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e50552d180 x1875449639036032/t8589935790(8589935790) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.479820:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035648:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.479836:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639036032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.479875:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.479964:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639036032 00000100:00100000:1.0:1788572335.479982:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639036032 00000100:00100000:1.0:1788572335.480057:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:1.0:1788572335.480067:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3649:x1875449639036032:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.480076:0:43966:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935790, current: 8589935790, replaying 00000100:00100000:1.0:1788572335.480090:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3649:x1875449639036032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26us (215us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.480096:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00010000:00080000:0.0:1788572335.480352:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935790, next_transno: 8589935790 00010000:00080000:0.0:1788572335.480357:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935790) 00010000:00080000:0.0:1788572335.480365:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639036032 t8589935790 from 0@lo req@ffff94e62d2f1c00 x1875449639036032/t0(8589935790) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.480399:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2486 count 1 00002000:00010000:0.0:1788572335.480495:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.480502:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.480513:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b6:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.480517:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.480522:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.480533:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.480553:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.480560:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.480581:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572335.480610:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.480616:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.480629:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.480632:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.480639:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.480653:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.480660:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.480676:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.480678:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.480680:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572335.480699:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.480714:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935791 00010000:00080000:0.0:1788572335.480718:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935791 00000100:00080000:2.0:1788572335.480728:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e50552d180 x1875449639036032/t8589935790(8589935790) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.480736:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.480738:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.480742:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.480750:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935790 00000100:00080000:2.0:1788572335.480757:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e50552e680 x1875449639036160/t8589935791(8589935791) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.480767:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639036032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.480779:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639036160:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.480805:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.483192:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639036160 00000100:00100000:0.0:1788572335.483213:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639036160 00000100:00100000:0.0:1788572335.483294:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:0.0:1788572335.483305:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+19:3649:x1875449639036160:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.483319:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935791, current: 8589935791, replaying 00000100:00100000:0.0:1788572335.483337:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+19:3649:x1875449639036160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36us (2532us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.483344:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00010000:00080000:2.0:1788572335.483610:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935791, next_transno: 8589935791 00010000:00080000:2.0:1788572335.483615:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935791) 00010000:00080000:2.0:1788572335.483626:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639036160 t8589935791 from 0@lo req@ffff94e62d2f3480 x1875449639036160/t0(8589935791) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.483667:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2487 count 1 00002000:00010000:2.0:1788572335.483797:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.483806:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b8334e36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.483822:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b7:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.483826:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.483833:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b8334e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.483847:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b8334e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.483858:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b8334e36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.483872:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b8334e36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.483900:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.484103:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.484117:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935792 00010000:00080000:2.0:1788572335.484121:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935792 00000100:00080000:2.0:1788572335.484162:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e50552e680 x1875449639036160/t8589935791(8589935791) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.484172:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.484175:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.484180:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.484187:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935791 00000100:00080000:2.0:1788572335.484196:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62d950e00 x1875449639034880/t8589935792(8589935792) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.484207:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639036160:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.484224:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639034880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.484253:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.484289:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639034880 00000100:00100000:2.0:1788572335.484294:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639034880 00000100:00100000:2.0:1788572335.484329:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:2.0:1788572335.484337:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3649:x1875449639034880:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.484344:0:43964:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935792, current: 8589935792, replaying 00000100:00100000:2.0:1788572335.484355:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3649:x1875449639034880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20us (101us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.484360:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00010000:00080000:2.0:1788572335.484375:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935792, next_transno: 8589935792 00010000:00080000:2.0:1788572335.484378:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935792) 00010000:00080000:2.0:1788572335.484382:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639034880 t8589935792 from 0@lo req@ffff94e62d2f0e00 x1875449639034880/t0(8589935792) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.484403:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2477 count 1 00002000:00010000:2.0:1788572335.484463:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.484469:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334e3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484479:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ad:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.484482:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.484487:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334e3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484496:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334e3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484504:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334e3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484511:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334e3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484525:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00080000:2.0:1788572335.484600:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.484611:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935793 00010000:00080000:2.0:1788572335.484615:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935793 00010000:00010000:2.0:1788572335.484626:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572335.484632:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b8334e36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484639:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.484644:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b8334e36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484654:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b8334e36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484671:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b8334e36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484679:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b8334e36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484700:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.484704:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334e3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484710:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.484714:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334e3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484727:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334e3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484737:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334e3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484744:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8334e3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.484756:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.484757:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.484759:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.484781:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62d950e00 x1875449639034880/t8589935792(8589935792) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.484788:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.484791:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.484794:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.484799:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935792 00000100:00080000:2.0:1788572335.484805:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e50552c000 x1875449639035392/t8589935793(8589935793) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.484812:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639034880:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.484821:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.484845:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.484876:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639035392 00000100:00100000:2.0:1788572335.484880:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639035392 00000100:00100000:2.0:1788572335.484903:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:2.0:1788572335.484909:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+21:3649:x1875449639035392:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.484916:0:43976:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935793, current: 8589935793, replaying 00000100:00100000:2.0:1788572335.484923:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+21:3649:x1875449639035392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15us (78us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.484928:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00010000:00080000:2.0:1788572335.484940:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935793, next_transno: 8589935793 00010000:00080000:2.0:1788572335.484942:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935793) 00010000:00080000:2.0:1788572335.484947:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639035392 t8589935793 from 0@lo req@ffff94e501ff1500 x1875449639035392/t0(8589935793) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.484966:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2481 count 1 00002000:00010000:2.0:1788572335.485061:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.485066:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334e44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.485075:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b1:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.485078:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.485082:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.485091:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.485099:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.485111:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334e44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.485125:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.485191:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.485200:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935794 00010000:00080000:2.0:1788572335.485203:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935794 00010000:00010000:2.0:1788572335.485213:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.485218:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334e44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.485225:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.485229:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334e44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.485237:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334e44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.485249:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334e44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.485255:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334e44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.485269:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.485271:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.485272:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.485290:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e50552c000 x1875449639035392/t8589935793(8589935793) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.485297:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.485299:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.485303:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.485309:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935793 00000100:00080000:2.0:1788572335.485314:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e50552dc00 x1875449639035904/t8589935794(8589935794) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.485322:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.485331:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.485352:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.486424:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639035904 00000100:00100000:1.0:1788572335.486436:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639035904 00000100:00100000:1.0:1788572335.486490:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1788572335.486501:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3649:x1875449639035904:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.486511:0:43968:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935794, current: 8589935794, replaying 00000100:00100000:1.0:1788572335.486520:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3649:x1875449639035904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24us (1169us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.486526:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00010000:00080000:2.0:1788572335.490562:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935794, next_transno: 8589935794 00010000:00080000:2.0:1788572335.490574:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935794) 00010000:00080000:2.0:1788572335.490589:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639035904 t8589935794 from 0@lo req@ffff94e637798a80 x1875449639035904/t0(8589935794) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.490644:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2485 count 1 00002000:00010000:2.0:1788572335.490779:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.490786:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8334e4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.490801:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b5:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.490804:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.490810:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8334e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.490823:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8334e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.490833:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8334e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.490840:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8334e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.490864:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.491073:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.491093:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935795 00010000:00080000:2.0:1788572335.491099:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935795 00000100:00080000:2.0:1788572335.491140:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e50552dc00 x1875449639035904/t8589935794(8589935794) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.491149:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.491151:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.491157:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.491164:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935794 00000100:00080000:2.0:1788572335.491174:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e61e570a80 x1875449639036416/t8589935795(8589935795) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.491184:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.491201:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639036416:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.491233:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.491272:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639036416 00000100:00100000:2.0:1788572335.491277:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639036416 00000100:00100000:2.0:1788572335.491332:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:2.0:1788572335.491341:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3649:x1875449639036416:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.491349:0:12091:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935795, current: 8589935795, replaying 00000100:00100000:2.0:1788572335.491358:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3649:x1875449639036416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19us (125us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.491364:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00010000:00080000:2.0:1788572335.491377:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935795, next_transno: 8589935795 00010000:00080000:2.0:1788572335.491380:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935795) 00010000:00080000:2.0:1788572335.491385:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639036416 t8589935795 from 0@lo req@ffff94e637799f80 x1875449639036416/t0(8589935795) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.491402:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2489 count 1 00002000:00010000:2.0:1788572335.491465:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.491472:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334e52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.491482:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b9:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.491485:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.491489:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.491499:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.491507:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.491514:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334e52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.491528:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00080000:2.0:1788572335.491603:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.491614:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935796 00010000:00080000:2.0:1788572335.491617:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935796 00000100:00080000:2.0:1788572335.491638:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e61e570a80 x1875449639036416/t8589935795(8589935795) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.491645:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.491647:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.491651:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.491656:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935795 00000100:00080000:2.0:1788572335.491663:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62d950a80 x1875449639034752/t8589935796(8589935796) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.491671:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639036416:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.491680:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639034752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.491703:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572335.491778:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572335.491786:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8334e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.491792:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.491795:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.491797:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334e52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.491799:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8334e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.491806:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.491808:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334e52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.491810:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8334e4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.491816:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334e52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.491828:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8334e4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.491828:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334e52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.491838:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8334e4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.491838:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b8334e52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.491862:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.491864:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.491871:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.491877:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572335.491885:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639034752 00000100:00100000:1.0:1788572335.491889:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639034752 00000100:00100000:1.0:1788572335.491920:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:1.0:1788572335.491926:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3649:x1875449639034752:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.491933:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935796, current: 8589935796, replaying 00000100:00100000:1.0:1788572335.491939:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3649:x1875449639034752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15us (237us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.491948:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00010000:00080000:2.0:1788572335.498246:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935796, next_transno: 8589935796 00010000:00080000:2.0:1788572335.498259:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935796) 00010000:00080000:2.0:1788572335.498276:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639034752 t8589935796 from 0@lo req@ffff94e637798e00 x1875449639034752/t0(8589935796) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.498712:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2476 count 1 00002000:00010000:2.0:1788572335.498838:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.498847:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334e59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.498863:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ac:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.498867:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.498874:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334e59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.498890:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334e59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.498901:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334e59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.498909:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.498927:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572335.498940:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.498946:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.498953:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.498957:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.499142:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334e59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.499164:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334e59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.499173:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334e59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788572335.503676:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.503702:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935797 00010000:00080000:3.0:1788572335.503707:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935797 00010000:00010000:0.0:1788572335.504697:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.504703:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.504706:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.511557:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62d950a80 x1875449639034752/t8589935796(8589935796) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.511570:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.511573:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.511579:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.511588:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935796 00000100:00080000:2.0:1788572335.511598:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e50552ca80 x1875449639035776/t8589935797(8589935797) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.511609:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639034752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.511632:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.511692:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572335.511932:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.511935:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.511937:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572335.521933:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639035776 00000100:00100000:3.0:1788572335.521952:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639035776 00000100:00100000:3.0:1788572335.522060:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1788572335.522072:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+25:3649:x1875449639035776:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.522087:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935797, current: 8589935797, replaying 00000100:00100000:3.0:1788572335.522103:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+25:3649:x1875449639035776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34us (10411us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.522110:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00010000:00080000:3.0:1788572335.522128:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935797, next_transno: 8589935797 00010000:00080000:3.0:1788572335.522132:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935797) 00010000:00080000:3.0:1788572335.522141:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639035776 t8589935797 from 0@lo req@ffff94e637799180 x1875449639035776/t0(8589935797) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.522183:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2484 count 1 00002000:00010000:3.0:1788572335.522348:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.522357:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.522373:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b4:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.522377:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.522384:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.522398:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.522408:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.522416:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.522438:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572335.522451:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.522458:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.522469:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.522474:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.522481:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.522496:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.522502:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da4108e/0xdb7edb52b8334e60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.522522:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.522524:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.522526:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572335.522695:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.522713:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935798 00010000:00080000:3.0:1788572335.522717:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935798 00000100:00080000:3.0:1788572335.522760:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e50552ca80 x1875449639035776/t8589935797(8589935797) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.522768:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.522771:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.522776:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.522788:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935797 00000100:00080000:3.0:1788572335.522796:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e50552c380 x1875449639035264/t8589935798(8589935798) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.522806:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.522822:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035264:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.522854:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.522888:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639035264 00000100:00100000:3.0:1788572335.522892:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639035264 00000100:00100000:3.0:1788572335.522921:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1788572335.522927:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3649:x1875449639035264:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.522934:0:8465:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935798, current: 8589935798, replaying 00000100:00100000:3.0:1788572335.522943:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3649:x1875449639035264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17us (90us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.522948:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00010000:00080000:3.0:1788572335.522959:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935798, next_transno: 8589935798 00010000:00080000:3.0:1788572335.522962:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935798) 00010000:00080000:3.0:1788572335.522967:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639035264 t8589935798 from 0@lo req@ffff94e6184d5180 x1875449639035264/t0(8589935798) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.522989:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2480 count 1 00002000:00010000:3.0:1788572335.523088:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.523095:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334e67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523104:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b0:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.523107:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.523112:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523122:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523129:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523136:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523153:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.523226:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.523237:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935799 00010000:00080000:3.0:1788572335.523240:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935799 00000100:00080000:3.0:1788572335.523263:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e50552c380 x1875449639035264/t8589935798(8589935798) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.523270:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.523272:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.523276:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.523283:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935798 00000100:00080000:3.0:1788572335.523289:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e61e572a00 x1875449639036288/t8589935799(8589935799) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.523297:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639035264:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.523307:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639036288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.523330:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.523359:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639036288 00000100:00100000:3.0:1788572335.523363:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639036288 00000100:00100000:3.0:1788572335.523389:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:3.0:1788572335.523396:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3649:x1875449639036288:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.523403:0:43966:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935799, current: 8589935799, replaying 00000100:00100000:3.0:1788572335.523411:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3649:x1875449639036288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17us (82us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.523417:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00010000:00080000:3.0:1788572335.523431:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935799, next_transno: 8589935799 00010000:00080000:3.0:1788572335.523434:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935799) 00010000:00080000:3.0:1788572335.523439:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639036288 t8589935799 from 0@lo req@ffff94e6184d5c00 x1875449639036288/t0(8589935799) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.523458:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2488 count 1 00002000:00010000:3.0:1788572335.523516:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.523523:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334e6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523532:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b8:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.523535:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.523540:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523550:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523563:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523570:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523586:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572335.523596:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572335.523602:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523609:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.523613:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523621:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334e67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523634:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334e67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523641:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029d9ceaa/0xdb7edb52b8334e67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523656:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.523660:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523665:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.523668:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523675:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334e6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523683:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334e6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523689:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006af8f87f/0xdb7edb52b8334e6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.523699:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.523701:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.523702:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572335.523773:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.523782:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935800 00010000:00080000:3.0:1788572335.523785:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935800 00000100:00080000:3.0:1788572335.523807:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e61e572a00 x1875449639036288/t8589935799(8589935799) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.523814:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.523816:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.523819:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.523825:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935799 00000100:00080000:3.0:1788572335.523832:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e641107b80 x1875449639038720/t8589935800(8589935800) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.523839:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639036288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.523847:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639038720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.523867:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.523892:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639038720 00000100:00100000:3.0:1788572335.523895:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639038720 00000100:00100000:3.0:1788572335.523918:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1788572335.523923:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+28:3649:x1875449639038720:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.523930:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935800, current: 8589935800, replaying 00000100:00100000:3.0:1788572335.523937:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+28:3649:x1875449639038720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15us (70us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.523942:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00010000:00080000:3.0:1788572335.523954:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935800, next_transno: 8589935800 00010000:00080000:3.0:1788572335.523957:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935800) 00010000:00080000:3.0:1788572335.523961:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639038720 t8589935800 from 0@lo req@ffff94e641196d80 x1875449639038720/t0(8589935800) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.523979:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2491 count 1 00002000:00010000:3.0:1788572335.524065:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.524071:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.524079:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9bb:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.524083:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.524088:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.524097:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.524105:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.524112:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.524126:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572335.524134:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.524138:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.524145:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609744600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.524147:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.524154:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.524164:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.524177:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086ca8aa3/0xdb7edb52b8334e75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.524191:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.524192:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.524194:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572335.524266:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.524275:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935801 00010000:00080000:3.0:1788572335.524279:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935801 00000100:00080000:3.0:1788572335.524301:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e641107b80 x1875449639038720/t8589935800(8589935800) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.524308:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.524310:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.524314:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.524319:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935800 00000100:00080000:3.0:1788572335.524325:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62dac4700 x1875449639039232/t8589935801(8589935801) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.524332:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639038720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.524342:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639039232:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.524363:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.524467:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639039232 00000100:00100000:2.0:1788572335.524472:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639039232 00000100:00100000:2.0:1788572335.524502:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:2.0:1788572335.524508:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+29:3649:x1875449639039232:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.524514:0:43975:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935801, current: 8589935801, replaying 00000100:00100000:2.0:1788572335.524520:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+29:3649:x1875449639039232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14us (157us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.524526:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00010000:00010000:0.0:1788572335.533467:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572335.535770:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935801, next_transno: 8589935801 00010000:00080000:3.0:1788572335.535780:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935801) 00010000:00080000:3.0:1788572335.535794:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639039232 t8589935801 from 0@lo req@ffff94e6412c1500 x1875449639039232/t0(8589935801) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.535851:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2495 count 1 00002000:00010000:3.0:1788572335.543989:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.544026:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334e7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.544055:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9bf:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.544061:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.544069:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.544088:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.544101:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.544110:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.544141:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572335.544561:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.544569:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.544578:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.544583:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.544593:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334e7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.544610:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334e7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.544617:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b29c1c14/0xdb7edb52b8334e7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.544639:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.544640:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.544642:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572335.544727:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.544750:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935802 00010000:00080000:3.0:1788572335.544755:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935802 00000100:00080000:1.0:1788572335.544837:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62dac4700 x1875449639039232/t8589935801(8589935801) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.544846:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.544849:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.544855:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.544863:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935801 00000100:00080000:1.0:1788572335.544874:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e641104a80 x1875449639038592/t8589935802(8589935802) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.544886:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639039232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.544904:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639038592:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.544938:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.549523:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639038592 00000100:00100000:3.0:1788572335.549539:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639038592 00000100:00100000:3.0:1788572335.549605:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:3.0:1788572335.549616:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+30:3649:x1875449639038592:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.549630:0:43974:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935802, current: 8589935802, replaying 00000100:00100000:3.0:1788572335.549645:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+30:3649:x1875449639038592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32us (4708us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.549652:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00010000:00080000:3.0:1788572335.549670:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935802, next_transno: 8589935802 00010000:00080000:3.0:1788572335.549673:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935802) 00010000:00080000:3.0:1788572335.549682:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639038592 t8589935802 from 0@lo req@ffff94e60fe47100 x1875449639038592/t0(8589935802) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.549720:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2490 count 1 00002000:00010000:3.0:1788572335.549834:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.549842:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334e83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.549857:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ba:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.549861:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.549868:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.549881:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.549891:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.549899:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.549916:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572335.549928:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.549933:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.549940:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e609745e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.549944:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.549952:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334e83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.549966:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334e83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.549990:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce165227/0xdb7edb52b8334e83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.550026:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.550028:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.550030:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572335.550219:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.550237:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935803 00010000:00080000:3.0:1788572335.550242:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935803 00000100:00080000:1.0:1788572335.550520:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e641104a80 x1875449639038592/t8589935802(8589935802) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.550529:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.550532:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.550536:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.550544:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935802 00000100:00080000:1.0:1788572335.550556:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62dac6680 x1875449639039104/t8589935803(8589935803) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.550567:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639038592:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.550586:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639039104:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.550620:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.550737:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639039104 00000100:00100000:3.0:1788572335.550744:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639039104 00000100:00100000:3.0:1788572335.550783:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:3.0:1788572335.550791:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3649:x1875449639039104:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.550799:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935803, current: 8589935803, replaying 00000100:00100000:3.0:1788572335.550808:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3649:x1875449639039104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19us (190us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.550813:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00010000:00080000:3.0:1788572335.550824:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935803, next_transno: 8589935803 00010000:00080000:3.0:1788572335.550827:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935803) 00010000:00080000:3.0:1788572335.550831:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639039104 t8589935803 from 0@lo req@ffff94e60fe45880 x1875449639039104/t0(8589935803) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.550853:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2494 count 1 00002000:00010000:3.0:1788572335.550927:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.550934:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8334e8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.550945:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9be:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.550949:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.550955:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8334e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.550966:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8334e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.551122:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8334e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.551136:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8334e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.551455:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.551582:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.551597:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935804 00010000:00080000:3.0:1788572335.551601:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935804 00000100:00080000:2.0:1788572335.553187:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62dac6680 x1875449639039104/t8589935803(8589935803) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.553202:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.553206:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.553213:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.553221:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935803 00000100:00080000:2.0:1788572335.553233:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62dac5880 x1875449639038976/t8589935804(8589935804) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.553244:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639039104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.553266:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639038976:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.553341:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.553392:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639038976 00000100:00100000:2.0:1788572335.553398:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639038976 00000100:00100000:2.0:1788572335.553443:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:2.0:1788572335.553452:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3649:x1875449639038976:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.553465:0:12091:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935804, current: 8589935804, replaying 00000100:00100000:2.0:1788572335.553477:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3649:x1875449639038976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27us (137us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.553484:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00010000:00080000:3.0:1788572335.554127:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935804, next_transno: 8589935804 00010000:00080000:3.0:1788572335.554134:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935804) 00010000:00080000:3.0:1788572335.554143:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639038976 t8589935804 from 0@lo req@ffff94e63779bb80 x1875449639038976/t0(8589935804) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.554187:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2493 count 1 00002000:00010000:3.0:1788572335.554410:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.554419:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334e91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.554436:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9bd:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.554441:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.554448:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.554463:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.554473:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.554482:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.565960:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572335.565987:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8334e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.566020:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.566026:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8334e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.566049:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8334e8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.566073:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8334e8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.566082:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8334e8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.566105:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.566109:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334e91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.566116:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.566119:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334e91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.566127:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334e91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.566137:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334e91 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.566145:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.566147:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.566150:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.568615:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.568998:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572335.569027:0:114791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334e91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788572335.569302:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00000100:00080000:2.0:1788572335.569424:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62dac5880 x1875449639038976/t8589935804(8589935804) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.569435:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.569438:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.569444:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.569451:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935804 00000100:00080000:2.0:1788572335.569462:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62dac5500 x1875449639038848/t8589935805(8589935805) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.569474:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639038976:0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.569492:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935805 00000100:00100000:2.0:1788572335.569496:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639038848:0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.569500:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935805 00000100:00100000:2.0:1788572335.569534:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.569610:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639038848 00000100:00100000:1.0:1788572335.569618:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639038848 00000100:00100000:1.0:1788572335.569668:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:1.0:1788572335.569679:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3649:x1875449639038848:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.569689:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935805, current: 8589935805, replaying 00000100:00100000:1.0:1788572335.569710:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3649:x1875449639038848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34us (177us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.569716:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00010000:00080000:0.0:1788572335.569741:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935805, next_transno: 8589935805 00010000:00080000:0.0:1788572335.569744:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935805) 00010000:00080000:0.0:1788572335.569752:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639038848 t8589935805 from 0@lo req@ffff94e637798380 x1875449639038848/t0(8589935805) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.569786:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2492 count 1 00002000:00010000:0.0:1788572335.569893:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.569900:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.569915:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9bc:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.569920:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.569926:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.569939:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.569949:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.569955:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.569978:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572335.570001:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.570028:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.570046:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.570051:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.570060:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.570078:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.570086:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8334e98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.570102:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.570105:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.570106:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572335.570114:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.570126:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935806 00010000:00080000:0.0:1788572335.570130:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935806 00000100:00080000:3.0:1788572335.570200:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62dac5500 x1875449639038848/t8589935805(8589935805) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.570208:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.570210:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.570214:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.570220:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935805 00000100:00080000:3.0:1788572335.570228:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62dac6300 x1875449639039360/t8589935806(8589935806) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.570236:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639038848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.570247:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639039360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.570275:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.570322:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639039360 00000100:00100000:0.0:1788572335.570327:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639039360 00000100:00100000:0.0:1788572335.570361:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:0.0:1788572335.570369:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+34:3649:x1875449639039360:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.570376:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935806, current: 8589935806, replaying 00000100:00100000:0.0:1788572335.570391:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+34:3649:x1875449639039360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24us (116us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.570397:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00010000:00080000:1.0:1788572335.570430:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935806, next_transno: 8589935806 00010000:00080000:1.0:1788572335.570433:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935806) 00010000:00080000:1.0:1788572335.570438:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639039360 t8589935806 from 0@lo req@ffff94e6412c0380 x1875449639039360/t0(8589935806) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.570459:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2496 count 1 00002000:00010000:1.0:1788572335.570527:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.570533:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.570542:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c0:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.570546:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.570550:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.570560:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.570569:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.570577:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.570600:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.570677:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.570687:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935807 00010000:00080000:1.0:1788572335.570691:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935807 00000100:00080000:3.0:1788572335.570750:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62dac6300 x1875449639039360/t8589935806(8589935806) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.570758:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.570760:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.570763:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.570769:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935806 00000100:00080000:3.0:1788572335.570776:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377d3800 x1875449639039872/t8589935807(8589935807) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.570784:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639039360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.570795:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639039872:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572335.570809:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.570814:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572335.570817:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572335.570822:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.570826:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.570835:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.570847:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.570854:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334e9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.570868:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.570871:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.570873:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572335.570879:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639039872 00000100:00100000:1.0:1788572335.570882:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639039872 00000100:00100000:1.0:1788572335.570915:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:1.0:1788572335.570922:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3649:x1875449639039872:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.570928:0:17011:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935807, current: 8589935807, replaying 00000100:00100000:1.0:1788572335.570942:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3649:x1875449639039872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21us (124us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.570948:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00010000:00080000:0.0:1788572335.570985:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935807, next_transno: 8589935807 00010000:00080000:0.0:1788572335.570989:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935807) 00010000:00080000:0.0:1788572335.570994:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639039872 t8589935807 from 0@lo req@ffff94e6412c0000 x1875449639039872/t0(8589935807) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.571030:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2497 count 1 00002000:00010000:0.0:1788572335.571109:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.571114:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334ea6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.571123:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c1:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.571126:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.571129:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.571138:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.571146:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.571154:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.571293:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.571373:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.571384:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935808 00010000:00080000:0.0:1788572335.571387:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935808 00010000:00010000:1.0:1788572335.571474:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.571480:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.571487:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.571490:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.571497:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334ea6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.571509:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334ea6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.571516:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8334ea6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.571536:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.571537:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.571539:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572335.572054:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377d3800 x1875449639039872/t8589935807(8589935807) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.572064:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.572067:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.572078:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.572086:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935807 00000100:00080000:3.0:1788572335.572096:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377d0700 x1875449639040000/t8589935808(8589935808) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.572106:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639039872:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.572129:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639040000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.572169:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.572620:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639040000 00000100:00100000:2.0:1788572335.572627:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639040000 00000100:00100000:2.0:1788572335.572687:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:2.0:1788572335.572696:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3649:x1875449639040000:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.572713:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935808, current: 8589935808, replaying 00000100:00100000:2.0:1788572335.572726:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3649:x1875449639040000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33us (558us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.572759:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00010000:00080000:0.0:1788572335.573381:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935808, next_transno: 8589935808 00010000:00080000:0.0:1788572335.573386:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935808) 00010000:00080000:0.0:1788572335.573396:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639040000 t8589935808 from 0@lo req@ffff94e6412c1180 x1875449639040000/t0(8589935808) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.573434:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2498 count 1 00002000:00010000:0.0:1788572335.573569:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.573577:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ead lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.573590:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c2:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.573595:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.573600:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.573613:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.573623:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.573630:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.573654:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.573802:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.573817:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935809 00010000:00080000:0.0:1788572335.573821:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935809 00010000:00010000:1.0:1788572335.576915:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.576931:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.576946:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.576951:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.576963:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.576990:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ead lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.576998:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8334ead lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.577061:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.577063:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.577065:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572335.577198:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377d0700 x1875449639040000/t8589935808(8589935808) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.577209:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.577212:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.577219:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.577227:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935808 00000100:00080000:3.0:1788572335.577240:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2c000 x1875449639040256/t8589935809(8589935809) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.577251:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639040000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.577273:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639040256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.577352:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.577566:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639040256 00000100:00100000:1.0:1788572335.577573:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639040256 00000100:00100000:1.0:1788572335.577627:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:1.0:1788572335.577638:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3649:x1875449639040256:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.577649:0:43964:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935809, current: 8589935809, replaying 00000100:00100000:1.0:1788572335.577663:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3649:x1875449639040256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28us (312us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.577670:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00010000:00080000:1.0:1788572335.577686:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935809, next_transno: 8589935809 00010000:00080000:1.0:1788572335.577690:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935809) 00010000:00080000:1.0:1788572335.577696:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639040256 t8589935809 from 0@lo req@ffff94e6412c2a00 x1875449639040256/t0(8589935809) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.577731:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2500 count 1 00002000:00010000:1.0:1788572335.577846:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.577854:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334eb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.577867:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c4:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.577871:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.577878:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.577891:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.577901:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.577909:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.577934:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.578107:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.578123:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935810 00010000:00080000:1.0:1788572335.578128:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935810 00010000:00010000:0.0:1788572335.578160:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.578240:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.578248:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.578253:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.578261:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.578276:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334eb4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.578282:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334eb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.578297:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.578299:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.578300:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572335.578534:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2c000 x1875449639040256/t8589935809(8589935809) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.578544:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.578547:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.578552:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.578559:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935809 00000100:00080000:3.0:1788572335.578570:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377d1c00 x1875449639040128/t8589935810(8589935810) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.578580:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639040256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.578596:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639040128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.578629:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.578709:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639040128 00000100:00100000:2.0:1788572335.578715:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639040128 00000100:00100000:2.0:1788572335.578760:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:2.0:1788572335.578769:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3649:x1875449639040128:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.578777:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935810, current: 8589935810, replaying 00000100:00100000:2.0:1788572335.578792:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3649:x1875449639040128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26us (164us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.578797:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00010000:00080000:1.0:1788572335.578845:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935810, next_transno: 8589935810 00010000:00080000:1.0:1788572335.578848:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935810) 00010000:00080000:1.0:1788572335.578864:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639040128 t8589935810 from 0@lo req@ffff94e6412c1c00 x1875449639040128/t0(8589935810) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.578894:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2499 count 1 00002000:00010000:1.0:1788572335.578965:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.578981:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334ebb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.578991:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c3:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.578995:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.579000:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334ebb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.579051:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334ebb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.579060:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334ebb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.579067:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334ebb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.579081:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.579175:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.579186:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935811 00010000:00080000:1.0:1788572335.579190:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935811 00000100:00080000:3.0:1788572335.579488:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377d1c00 x1875449639040128/t8589935810(8589935810) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.579498:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.579500:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.579505:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.579511:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935810 00000100:00080000:3.0:1788572335.579522:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2c380 x1875449639042944/t8589935811(8589935811) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.579530:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639040128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.579542:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639042944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.579569:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572335.579713:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.579720:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334ebb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572335.579723:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639042944 00000100:00100000:0.0:1788572335.579728:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639042944 00010000:00010000:2.0:1788572335.579728:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.579732:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334ebb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.579740:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334ebb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.579755:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334ebb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.579762:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334ebb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572335.579764:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1788572335.579770:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+39:3649:x1875449639042944:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.579779:0:43976:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935811, current: 8589935811, replaying 00010000:00010000:2.0:1788572335.579780:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.579782:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.579783:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572335.579787:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+39:3649:x1875449639042944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18us (218us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.579793:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00010000:00080000:1.0:1788572335.579865:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935811, next_transno: 8589935811 00010000:00080000:1.0:1788572335.579869:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935811) 00010000:00080000:1.0:1788572335.579874:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639042944 t8589935811 from 0@lo req@ffff94e6412c1f80 x1875449639042944/t0(8589935811) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.579897:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2504 count 1 00002000:00010000:1.0:1788572335.579958:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.579964:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334ec2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.579985:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.579988:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.579992:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.580030:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.580049:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.580056:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.580071:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572335.580228:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.580234:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.580246:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.580250:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.580257:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334ec2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.580270:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334ec2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.580277:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334ec2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.580292:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.580294:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.580295:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572335.580616:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2c380 x1875449639042944/t8589935811(8589935811) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.580625:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.580628:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.580632:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.580639:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935811 00000100:00080000:3.0:1788572335.580649:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2e680 x1875449639043456/t8589935812(8589935812) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.580659:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639042944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.580673:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043456:0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.580716:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.580733:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935812 00010000:00080000:0.0:1788572335.580737:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935812 00000100:00100000:2.0:1788572335.586657:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.586789:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639043456 00000100:00100000:3.0:1788572335.586798:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639043456 00000100:00100000:3.0:1788572335.586850:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:3.0:1788572335.586859:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3649:x1875449639043456:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.586873:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935812, current: 8589935812, replaying 00000100:00100000:3.0:1788572335.586892:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3649:x1875449639043456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35us (243us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.586898:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00010000:00080000:0.0:1788572335.587138:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935812, next_transno: 8589935812 00010000:00080000:0.0:1788572335.587143:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935812) 00010000:00080000:0.0:1788572335.587153:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639043456 t8589935812 from 0@lo req@ffff94e637798700 x1875449639043456/t0(8589935812) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.587428:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2508 count 1 00002000:00010000:0.0:1788572335.588792:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.588808:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334ec9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.588826:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.588830:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.588837:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.588853:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.588865:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.588878:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.588908:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.589131:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.589154:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935813 00010000:00080000:0.0:1788572335.589158:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935813 00000100:00080000:2.0:1788572335.595258:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2e680 x1875449639043456/t8589935812(8589935812) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.595275:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.595280:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.595286:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.595293:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935812 00000100:00080000:2.0:1788572335.595308:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2ce00 x1875449639042816/t8589935813(8589935813) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.595319:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043456:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.595345:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639042816:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.595416:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572335.595652:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.595661:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.595674:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.595678:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.595690:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.595712:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334ec9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.595719:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334ec9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.595740:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.595742:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.595744:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572335.596019:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639042816 00000100:00100000:0.0:1788572335.596027:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639042816 00000100:00100000:0.0:1788572335.596097:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:0.0:1788572335.596107:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3649:x1875449639042816:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.596119:0:12091:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935813, current: 8589935813, replaying 00000100:00100000:0.0:1788572335.596141:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3649:x1875449639042816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36us (726us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.596147:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00010000:00080000:1.0:1788572335.596187:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935813, next_transno: 8589935813 00010000:00080000:1.0:1788572335.596191:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935813) 00010000:00080000:1.0:1788572335.596199:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639042816 t8589935813 from 0@lo req@ffff94e63779b800 x1875449639042816/t0(8589935813) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.596241:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2503 count 1 00002000:00010000:1.0:1788572335.596374:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.596382:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334ed0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.596396:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c7:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.596400:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.596407:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.596420:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.596430:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.596438:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.596463:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.596627:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.596644:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935814 00010000:00080000:1.0:1788572335.596649:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935814 00010000:00010000:2.0:1788572335.596703:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.596709:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.596717:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.596721:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.596729:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.596743:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334ed0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.596750:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334ed0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.596766:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.596767:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.596769:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572335.597492:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2ce00 x1875449639042816/t8589935813(8589935813) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.597505:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.597508:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.597514:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.597522:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935813 00000100:00080000:0.0:1788572335.597535:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2ed80 x1875449639043328/t8589935814(8589935814) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.597563:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639042816:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.597580:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043328:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.597627:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.598114:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639043328 00000100:00100000:1.0:1788572335.598122:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639043328 00000100:00100000:1.0:1788572335.598170:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:1.0:1788572335.598179:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3649:x1875449639043328:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.598191:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935814, current: 8589935814, replaying 00000100:00100000:1.0:1788572335.598201:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3649:x1875449639043328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24us (575us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.598207:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00010000:00080000:0.0:1788572335.598416:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935814, next_transno: 8589935814 00010000:00080000:0.0:1788572335.598420:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935814) 00010000:00080000:0.0:1788572335.598428:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639043328 t8589935814 from 0@lo req@ffff94e63ae3ea00 x1875449639043328/t0(8589935814) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.598461:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2507 count 1 00002000:00010000:0.0:1788572335.598572:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.598580:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334ed7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.598595:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.598599:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.598606:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.598620:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.598630:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.598638:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.598665:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.598785:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.598799:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935815 00010000:00080000:0.0:1788572335.598803:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935815 00000100:00080000:2.0:1788572335.599067:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2ed80 x1875449639043328/t8589935814(8589935814) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.599081:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.599084:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.599088:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.599095:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935814 00000100:00080000:2.0:1788572335.599106:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377d1180 x1875449639043840/t8589935815(8589935815) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.599115:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.599131:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043840:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.599165:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572335.599453:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.599463:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.599473:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.599478:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.599489:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.599509:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334ed7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.599518:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334ed7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.599540:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.599542:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.599544:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572335.601178:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639043840 00000100:00100000:0.0:1788572335.601194:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639043840 00000100:00100000:0.0:1788572335.601270:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:0.0:1788572335.601281:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+43:3649:x1875449639043840:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.601296:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935815, current: 8589935815, replaying 00000100:00100000:0.0:1788572335.601312:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+43:3649:x1875449639043840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34us (2147us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.601319:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00010000:00080000:2.0:1788572335.601578:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935815, next_transno: 8589935815 00010000:00080000:2.0:1788572335.601583:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935815) 00010000:00080000:2.0:1788572335.601594:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639043840 t8589935815 from 0@lo req@ffff94e63c5d0c50 x1875449639043840/t0(8589935815) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.601633:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2511 count 1 00002000:00010000:2.0:1788572335.601745:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.601753:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334ede lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.601767:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cf:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.601771:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.601777:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334ede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.601791:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334ede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.601801:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334ede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.601807:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334ede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.601832:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.601978:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00000100:00080000:0.0:1788572335.602028:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377d1180 x1875449639043840/t8589935815(8589935815) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.602051:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.602054:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.602060:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.602067:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935815 00000100:00080000:0.0:1788572335.602079:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377d2a00 x1875449639043712/t8589935816(8589935816) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.602090:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043840:0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.602092:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935816 00010000:00080000:2.0:1788572335.602096:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935816 00000100:00100000:0.0:1788572335.602106:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043712:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.602142:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572335.602149:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.602155:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334ede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.602164:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.602168:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334ede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.602178:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334ede lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.602194:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334ede lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.602202:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b8334ede lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.602224:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.602226:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.602227:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572335.602493:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639043712 00000100:00100000:2.0:1788572335.602500:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639043712 00000100:00100000:2.0:1788572335.602551:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:2.0:1788572335.602560:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3649:x1875449639043712:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.602568:0:17011:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935816, current: 8589935816, replaying 00000100:00100000:2.0:1788572335.602585:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3649:x1875449639043712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27us (443us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.602591:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00010000:00080000:0.0:1788572335.602787:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935816, next_transno: 8589935816 00010000:00080000:0.0:1788572335.602791:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935816) 00010000:00080000:0.0:1788572335.602797:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639043712 t8589935816 from 0@lo req@ffff94e63ae3ce00 x1875449639043712/t0(8589935816) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.602824:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2510 count 1 00002000:00010000:0.0:1788572335.602898:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.602905:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334ee5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.602914:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ce:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.602918:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.602923:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.602934:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.602942:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.602949:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.602972:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.603129:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.603144:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935817 00010000:00080000:0.0:1788572335.603148:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935817 00000100:00080000:1.0:1788572335.603168:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377d2a00 x1875449639043712/t8589935816(8589935816) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.603182:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.603184:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.603189:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.603195:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935816 00000100:00080000:1.0:1788572335.603205:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5038c2a00 x1875449639044224/t8589935817(8589935817) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.603215:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.603228:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639044224:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.603257:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.603672:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639044224 00000100:00100000:3.0:1788572335.603678:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639044224 00000100:00100000:3.0:1788572335.603721:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:3.0:1788572335.603729:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3649:x1875449639044224:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.603738:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935817, current: 8589935817, replaying 00000100:00100000:3.0:1788572335.603755:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3649:x1875449639044224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27us (498us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.603760:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00010000:00080000:1.0:1788572335.603799:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935817, next_transno: 8589935817 00010000:00080000:1.0:1788572335.603802:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935817) 00010000:00080000:1.0:1788572335.603808:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639044224 t8589935817 from 0@lo req@ffff94e60fe45500 x1875449639044224/t0(8589935817) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.603833:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2514 count 1 00002000:00010000:1.0:1788572335.603906:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.603913:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334eec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.603925:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d2:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.603928:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.603933:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.603943:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.603953:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.603961:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.603985:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00080000:1.0:1788572335.604136:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.604147:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935818 00010000:00080000:1.0:1788572335.604151:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935818 00010000:00010000:3.0:1788572335.604201:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572335.604208:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.604215:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.604219:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.604227:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334ee5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.604243:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334ee5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.604250:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334ee5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.604268:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.604271:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.604292:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.604296:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.604314:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334eec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.604330:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334eec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.604337:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334eec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.604349:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.604351:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.604353:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572335.604563:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5038c2a00 x1875449639044224/t8589935817(8589935817) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.604571:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.604574:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.604578:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.604585:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935817 00000100:00080000:0.0:1788572335.604596:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5038c0000 x1875449639044352/t8589935818(8589935818) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.604606:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639044224:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.604619:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639044352:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.604651:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.604862:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639044352 00000100:00100000:1.0:1788572335.604867:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639044352 00000100:00100000:1.0:1788572335.604903:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:1.0:1788572335.604912:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3649:x1875449639044352:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.604920:0:43964:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935818, current: 8589935818, replaying 00000100:00100000:1.0:1788572335.604932:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3649:x1875449639044352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22us (281us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.604938:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00010000:00080000:1.0:1788572335.604951:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935818, next_transno: 8589935818 00010000:00080000:1.0:1788572335.604954:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935818) 00010000:00080000:1.0:1788572335.604959:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639044352 t8589935818 from 0@lo req@ffff94e63ae3ea00 x1875449639044352/t0(8589935818) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.604983:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2515 count 1 00002000:00010000:1.0:1788572335.605096:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.605104:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334ef3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.605114:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d3:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.605117:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.605123:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.605135:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.605150:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.605160:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.605175:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.605259:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.605272:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935819 00010000:00080000:1.0:1788572335.605276:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935819 00000100:00080000:0.0:1788572335.605562:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5038c0000 x1875449639044352/t8589935818(8589935818) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.605570:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.605573:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.605577:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.605583:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935818 00000100:00080000:0.0:1788572335.605592:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2f100 x1875449639042560/t8589935819(8589935819) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.605601:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639044352:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.605613:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639042560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.605639:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.605770:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639042560 00000100:00100000:3.0:1788572335.605775:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639042560 00000100:00100000:3.0:1788572335.605823:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:3.0:1788572335.605831:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+47:3649:x1875449639042560:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.605839:0:43975:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935819, current: 8589935819, replaying 00000100:00100000:3.0:1788572335.605847:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+47:3649:x1875449639042560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19us (208us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.605853:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00010000:00010000:2.0:1788572335.606363:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.606371:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.606381:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.606385:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.606398:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.606415:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334ef3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.606422:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334ef3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.606440:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.606441:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.606443:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.606449:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.608145:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935819, next_transno: 8589935819 00010000:00080000:1.0:1788572335.608157:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935819) 00010000:00080000:1.0:1788572335.608171:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639042560 t8589935819 from 0@lo req@ffff94e64173d500 x1875449639042560/t0(8589935819) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.608226:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2501 count 1 00002000:00010000:1.0:1788572335.608354:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.608362:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334efa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.608378:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c5:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.608383:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.608390:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.608405:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.608416:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.608425:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334efa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.608453:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.608608:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.608627:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935820 00010000:00080000:1.0:1788572335.608632:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935820 00000100:00080000:0.0:1788572335.608905:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2f100 x1875449639042560/t8589935819(8589935819) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.608916:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.608919:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.608925:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.608932:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935819 00000100:00080000:0.0:1788572335.608946:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2f800 x1875449639043072/t8589935820(8589935820) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.608957:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639042560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.608975:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.609060:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.609291:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639043072 00000100:00100000:1.0:1788572335.609299:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639043072 00000100:00100000:1.0:1788572335.609336:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:1.0:1788572335.609345:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3649:x1875449639043072:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.609356:0:43968:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935820, current: 8589935820, replaying 00000100:00100000:1.0:1788572335.609371:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3649:x1875449639043072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28us (313us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.609377:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00010000:00080000:1.0:1788572335.609388:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935820, next_transno: 8589935820 00010000:00080000:1.0:1788572335.609391:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935820) 00010000:00080000:1.0:1788572335.609396:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639043072 t8589935820 from 0@lo req@ffff94e62d288a80 x1875449639043072/t0(8589935820) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.609423:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2505 count 1 00002000:00010000:1.0:1788572335.609493:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.609500:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.609512:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.609515:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.609517:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.609521:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.609524:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334efa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.609532:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.609532:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.609537:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334efa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.609540:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.609548:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.609558:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334efa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.609564:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572335.609572:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.609574:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334efa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.609576:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.609583:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.609583:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334efa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.609587:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.609593:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.609601:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.609602:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.609604:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.609605:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.609609:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.609619:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.609621:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.609623:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.609724:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.609739:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935821 00010000:00080000:1.0:1788572335.609743:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935821 00000100:00080000:2.0:1788572335.610379:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2f800 x1875449639043072/t8589935820(8589935820) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.610388:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.610391:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.610396:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.610404:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935820 00000100:00080000:2.0:1788572335.610416:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5038c0700 x1875449639043968/t8589935821(8589935821) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.610425:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.610441:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.610476:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.610560:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639043968 00000100:00100000:1.0:1788572335.610566:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639043968 00000100:00100000:1.0:1788572335.610604:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:1.0:1788572335.610612:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3649:x1875449639043968:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.610625:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935821, current: 8589935821, replaying 00000100:00100000:1.0:1788572335.610645:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3649:x1875449639043968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35us (169us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.610651:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00010000:00080000:0.0:1788572335.610791:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935821, next_transno: 8589935821 00010000:00080000:0.0:1788572335.610796:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935821) 00010000:00080000:0.0:1788572335.610802:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639043968 t8589935821 from 0@lo req@ffff94e637798a80 x1875449639043968/t0(8589935821) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.610830:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2512 count 1 00002000:00010000:0.0:1788572335.610915:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.610923:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.610934:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d0:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.610938:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.610944:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.610957:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.610967:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.610974:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.611027:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.611142:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.611156:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935822 00010000:00080000:0.0:1788572335.611159:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935822 00000100:00080000:2.0:1788572335.611162:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5038c0700 x1875449639043968/t8589935821(8589935821) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.611180:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.611183:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.611188:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.611199:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935821 00000100:00080000:2.0:1788572335.611208:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5038c0380 x1875449639044480/t8589935822(8589935822) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.611217:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.611228:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639044480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.611252:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.611370:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639044480 00000100:00100000:0.0:1788572335.611374:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639044480 00000100:00100000:0.0:1788572335.611410:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:0.0:1788572335.611419:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3649:x1875449639044480:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.611426:0:8464:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935822, current: 8589935822, replaying 00000100:00100000:0.0:1788572335.611437:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3649:x1875449639044480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20us (185us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.611442:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00010000:00080000:0.0:1788572335.611453:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935822, next_transno: 8589935822 00010000:00080000:0.0:1788572335.611456:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935822) 00010000:00080000:0.0:1788572335.611460:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639044480 t8589935822 from 0@lo req@ffff94e637799f80 x1875449639044480/t0(8589935822) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.611485:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2516 count 1 00002000:00010000:0.0:1788572335.611541:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.611547:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.611557:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d4:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.611561:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.611565:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.611575:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.611582:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.611589:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.611602:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00080000:0.0:1788572335.611677:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.611687:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935823 00010000:00080000:0.0:1788572335.611691:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935823 00010000:00010000:1.0:1788572335.611778:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572335.611785:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.611793:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.611797:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.611806:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.611821:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.611828:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.611848:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.611850:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.611856:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.611859:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.611866:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.611874:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.611882:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.611894:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.611896:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.611898:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.612385:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.612427:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5038c0380 x1875449639044480/t8589935822(8589935822) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.612437:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.612440:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.612444:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.612451:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935822 00000100:00080000:2.0:1788572335.612462:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2d880 x1875449639042688/t8589935823(8589935823) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.612471:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639044480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.612485:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639042688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.612517:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.615947:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639042688 00000100:00100000:1.0:1788572335.615963:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639042688 00000100:00100000:1.0:1788572335.616071:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:1.0:1788572335.616083:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3649:x1875449639042688:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.616099:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935823, current: 8589935823, replaying 00000100:00100000:1.0:1788572335.616115:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3649:x1875449639042688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36us (3597us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.616122:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00010000:00080000:0.0:1788572335.616935:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935823, next_transno: 8589935823 00010000:00080000:0.0:1788572335.616941:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935823) 00010000:00080000:0.0:1788572335.616953:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639042688 t8589935823 from 0@lo req@ffff94e637798e00 x1875449639042688/t0(8589935823) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.617576:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2502 count 1 00002000:00010000:0.0:1788572335.617693:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.617702:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.617719:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c6:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.617723:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.617729:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.617744:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.617762:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.617769:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.617834:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.617998:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00000100:00080000:0.0:1788572335.618071:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2d880 x1875449639042688/t8589935823(8589935823) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.618080:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.618084:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.618090:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.618098:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935823 00000100:00080000:0.0:1788572335.618111:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2d180 x1875449639043200/t8589935824(8589935824) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.618122:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639042688:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.618140:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043200:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.618172:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.618201:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639043200 00000100:00100000:0.0:1788572335.618207:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639043200 00000100:00100000:0.0:1788572335.618242:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:0.0:1788572335.618249:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+53:3649:x1875449639043200:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.618257:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935823, current: 8589935824, replaying 00000100:00100000:0.0:1788572335.618264:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+53:3649:x1875449639043200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16us (93us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.618270:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00010000:00080000:0.0:1788572335.618314:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935824, next_transno: 8589935824 00010000:00080000:0.0:1788572335.618317:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935824) 00010000:00080000:0.0:1788572335.618323:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639043200 t8589935824 from 0@lo req@ffff94e62d28b800 x1875449639043200/t0(8589935824) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.618343:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2506 count 1 00002000:00010000:0.0:1788572335.618397:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.618403:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.618413:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.618417:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.618421:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.618431:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.618440:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.618448:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.618691:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572335.618700:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.618708:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.618713:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.618722:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.618740:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.618748:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.618765:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.618768:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.618775:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.618778:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.618785:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.618801:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f1d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.618809:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.618810:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.618813:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.618880:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572335.618886:0:114791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788572335.619025:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.619046:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935825 00010000:00080000:0.0:1788572335.619051:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935825 00000100:00080000:1.0:1788572335.619187:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2d180 x1875449639043200/t8589935824(8589935824) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.619197:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.619200:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.619205:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.619211:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935824 00000100:00080000:1.0:1788572335.619223:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377d3480 x1875449639043584/t8589935825(8589935825) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.619233:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.619247:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043584:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.619278:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.619397:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639043584 00000100:00100000:0.0:1788572335.619402:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639043584 00000100:00100000:0.0:1788572335.619438:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:0.0:1788572335.619445:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3649:x1875449639043584:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.619454:0:17011:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935825, current: 8589935825, replaying 00000100:00100000:0.0:1788572335.619465:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3649:x1875449639043584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21us (186us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.619473:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00010000:00080000:0.0:1788572335.619484:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935825, next_transno: 8589935825 00010000:00080000:0.0:1788572335.619487:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935825) 00010000:00080000:0.0:1788572335.619492:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639043584 t8589935825 from 0@lo req@ffff94e60fe46300 x1875449639043584/t0(8589935825) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.619514:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2509 count 1 00002000:00010000:0.0:1788572335.619577:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.619582:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.619593:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.619597:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.619602:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.619613:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.619621:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.619630:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.619708:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.619714:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.619721:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.619724:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.619732:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.619744:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f24 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.619751:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.619752:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.619754:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.619811:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572335.619816:0:114791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788572335.619950:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.619960:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935826 00010000:00080000:0.0:1788572335.619963:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935826 00000100:00100000:0.0:1788572335.620158:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639100160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572335.620192:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.620231:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639100160 00000100:00100000:0.0:1788572335.620235:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639100160 00000100:00100000:0.0:1788572335.620280:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854 00000100:00100000:0.0:1788572335.620288:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639100160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572335.620321:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572335.620358:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639100160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572335.620365:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854 00000100:00100000:0.0:1788572335.620398:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639100160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572335.620518:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572335.620575:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377d3480 x1875449639043584/t8589935825(8589935825) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.620585:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.620589:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.620594:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.620600:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935825 00000100:00080000:3.0:1788572335.620613:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5038c3100 x1875449639044096/t8589935826(8589935826) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.620622:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639043584:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788572335.620633:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572335.620650:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639044096:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.620679:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.620773:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639044096 00000100:00100000:0.0:1788572335.620779:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639044096 00000100:00100000:0.0:1788572335.620842:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:0.0:1788572335.620850:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+54:3649:x1875449639044096:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.620857:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935826, current: 8589935826, replaying 00000100:00100000:0.0:1788572335.620906:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+54:3649:x1875449639044096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57us (226us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.620912:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00010000:00080000:1.0:1788572335.620949:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935826, next_transno: 8589935826 00010000:00080000:1.0:1788572335.620953:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935826) 00010000:00080000:1.0:1788572335.620960:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639044096 t8589935826 from 0@lo req@ffff94e6412c2300 x1875449639044096/t0(8589935826) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.620996:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2513 count 1 00002000:00010000:1.0:1788572335.621218:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.621225:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334f2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.621238:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d1:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.621243:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.621248:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334f2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.621261:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334f2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.621277:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334f2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.621284:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334f2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.621346:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.621449:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.621461:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935827 00010000:00080000:1.0:1788572335.621465:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935827 00010000:00010000:3.0:1788572335.621657:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.621663:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334f2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.621672:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.621677:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334f2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.621686:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334f2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.621701:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334f2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.621708:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334f2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.621732:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.621734:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.621736:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572335.621767:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5038c3100 x1875449639044096/t8589935826(8589935826) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.621775:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.621778:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.621783:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.621790:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935826 00000100:00080000:3.0:1788572335.621801:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5058a5180 x1875449639045376/t8589935827(8589935827) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.621810:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639044096:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.621823:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045376:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.621851:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.623871:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639045376 00000100:00100000:1.0:1788572335.623886:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639045376 00000100:00100000:3.0:1788572335.629282:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:3.0:1788572335.629319:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+55:3649:x1875449639045376:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.629335:0:43964:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935827, current: 8589935827, replaying 00000100:00100000:3.0:1788572335.629344:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+55:3649:x1875449639045376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51us (7494us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.629351:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00010000:00080000:1.0:1788572335.629395:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935827, next_transno: 8589935827 00010000:00080000:1.0:1788572335.629400:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935827) 00010000:00080000:1.0:1788572335.629411:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639045376 t8589935827 from 0@lo req@ffff94e6412c0700 x1875449639045376/t0(8589935827) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.629467:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2518 count 1 00002000:00010000:1.0:1788572335.629605:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.629614:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.629632:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d6:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.629637:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.629645:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.629667:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.629678:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.629685:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.629711:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572335.629723:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.629729:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.629737:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.629741:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.629751:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.629781:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.629790:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.629806:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.629807:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.629809:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.629966:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.629995:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935828 00010000:00080000:1.0:1788572335.629999:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935828 00000100:00080000:3.0:1788572335.633227:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5058a5180 x1875449639045376/t8589935827(8589935827) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.633240:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.633244:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.633250:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.633258:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935827 00000100:00080000:3.0:1788572335.633274:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5058a6300 x1875449639045248/t8589935828(8589935828) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.633285:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045376:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.633306:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045248:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.633371:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.634722:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639045248 00000100:00100000:0.0:1788572335.634739:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639045248 00000100:00100000:0.0:1788572335.635865:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:0.0:1788572335.635885:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+56:3649:x1875449639045248:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.635903:0:43976:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935828, current: 8589935828, replaying 00000100:00100000:0.0:1788572335.635924:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+56:3649:x1875449639045248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (2553us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.635931:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00010000:00080000:3.0:1788572335.636913:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935828, next_transno: 8589935828 00010000:00080000:3.0:1788572335.636921:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935828) 00010000:00080000:3.0:1788572335.636932:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639045248 t8589935828 from 0@lo req@ffff94e6412c1500 x1875449639045248/t0(8589935828) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.636976:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2517 count 1 00002000:00010000:3.0:1788572335.637134:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.637142:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.637158:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d5:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.637163:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.637169:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.637184:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.637200:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.637207:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.637227:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572335.637240:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.637246:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.637254:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.637258:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.637267:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.637283:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.637290:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.637309:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.637311:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.637312:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572335.637482:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00000100:00080000:3.0:1788572335.637530:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5058a6300 x1875449639045248/t8589935828(8589935828) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.637539:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.637542:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.637549:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.637557:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935828 00000100:00080000:3.0:1788572335.637576:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5058a4380 x1875449639045760/t8589935829(8589935829) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.637587:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045248:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.637607:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045760:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.637642:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.642591:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639045760 00000100:00100000:1.0:1788572335.642608:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639045760 00000100:00100000:1.0:1788572335.642675:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:1.0:1788572335.642684:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3649:x1875449639045760:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.642698:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935829, current: 8589935829, replaying 00000100:00100000:1.0:1788572335.642704:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3649:x1875449639045760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23us (5064us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.642712:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00010000:00080000:3.0:1788572335.644032:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935829, next_transno: 8589935829 00010000:00080000:3.0:1788572335.644047:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935829) 00010000:00080000:3.0:1788572335.644061:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639045760 t8589935829 from 0@lo req@ffff94e6412c0380 x1875449639045760/t0(8589935829) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.644109:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2521 count 1 00002000:00010000:3.0:1788572335.644235:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.644244:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b8334f40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.644261:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d9:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.644266:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.644274:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b8334f40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.644289:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b8334f40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.645389:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b8334f40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.645405:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b8334f40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.645428:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.645680:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.645703:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935830 00010000:00080000:3.0:1788572335.645708:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935830 00010000:00010000:2.0:1788572335.646349:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.646359:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b8334f40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.646369:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.646377:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b8334f40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.646387:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b8334f40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.646409:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b8334f40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.646417:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b8334f40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.646439:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.646441:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.646443:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572335.646645:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5058a4380 x1875449639045760/t8589935829(8589935829) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.646655:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.646658:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.646664:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.646671:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935829 00000100:00080000:0.0:1788572335.646687:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5058a7b80 x1875449639045888/t8589935830(8589935830) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.646700:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045760:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.646725:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045888:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.647557:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.649572:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639045888 00000100:00100000:3.0:1788572335.649586:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639045888 00000100:00100000:3.0:1788572335.649658:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:3.0:1788572335.649670:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3649:x1875449639045888:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.649682:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935830, current: 8589935830, replaying 00000100:00100000:3.0:1788572335.649702:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3649:x1875449639045888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36us (2150us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.649709:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00010000:00080000:0.0:1788572335.650108:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935830, next_transno: 8589935830 00010000:00080000:0.0:1788572335.650113:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935830) 00010000:00080000:0.0:1788572335.650122:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639045888 t8589935830 from 0@lo req@ffff94e62d288e00 x1875449639045888/t0(8589935830) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.650162:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2522 count 1 00002000:00010000:0.0:1788572335.650277:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.650296:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.650313:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9da:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.650317:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.650323:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.650339:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.650349:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.650356:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.650381:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572335.650688:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.650696:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.650705:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.650710:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.650719:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.650736:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.650744:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b838c4b/0xdb7edb52b8334f47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.650776:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.650778:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.650780:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572335.650973:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.650991:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935831 00010000:00080000:0.0:1788572335.650994:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935831 00000100:00080000:2.0:1788572335.651137:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5058a7b80 x1875449639045888/t8589935830(8589935830) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.651148:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.651151:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.651156:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.651164:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935830 00000100:00080000:2.0:1788572335.651178:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5058a6a00 x1875449639046016/t8589935831(8589935831) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.651188:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045888:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.651206:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639046016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.651238:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.651523:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639046016 00000100:00100000:0.0:1788572335.651530:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639046016 00000100:00100000:0.0:1788572335.651577:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:0.0:1788572335.651585:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3649:x1875449639046016:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.651595:0:8464:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935831, current: 8589935831, replaying 00000100:00100000:0.0:1788572335.651606:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3649:x1875449639046016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23us (367us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.651615:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00010000:00080000:0.0:1788572335.651627:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935831, next_transno: 8589935831 00010000:00080000:0.0:1788572335.651629:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935831) 00010000:00080000:0.0:1788572335.651635:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639046016 t8589935831 from 0@lo req@ffff94e637799180 x1875449639046016/t0(8589935831) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.651661:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2523 count 1 00002000:00010000:0.0:1788572335.651743:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.651751:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.652550:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9db:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.652555:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.652562:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.652576:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.652586:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.652594:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.652614:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1788572335.652927:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5058a6a00 x1875449639046016/t8589935831(8589935831) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.652937:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.652939:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.652945:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.652957:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935831 00000100:00080000:2.0:1788572335.652971:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5058a4000 x1875449639045504/t8589935832(8589935832) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.652981:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639046016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.652997:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045504:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.653090:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572335.653207:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.653215:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.653230:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.653235:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.653245:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.653263:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.653272:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038a2e8cc/0xdb7edb52b8334f4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.653291:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.653293:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.653295:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572335.653863:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.653886:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935832 00010000:00080000:0.0:1788572335.653892:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935832 00000100:00100000:2.0:1788572335.654607:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639045504 00000100:00100000:2.0:1788572335.654621:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639045504 00000100:00100000:2.0:1788572335.654684:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:2.0:1788572335.654692:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3649:x1875449639045504:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.654705:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935832, current: 8589935832, replaying 00000100:00100000:2.0:1788572335.654719:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3649:x1875449639045504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29us (1629us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.654725:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00010000:00080000:0.0:1788572335.654973:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935832, next_transno: 8589935832 00010000:00080000:0.0:1788572335.654978:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935832) 00010000:00080000:0.0:1788572335.654987:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639045504 t8589935832 from 0@lo req@ffff94e63779bb80 x1875449639045504/t0(8589935832) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.655064:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2519 count 1 00002000:00010000:0.0:1788572335.655179:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.655187:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.655200:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d7:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.655205:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.655210:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.655222:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.655231:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.655239:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.655259:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.655397:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.655412:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935833 00010000:00080000:0.0:1788572335.655416:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935833 00010000:00010000:2.0:1788572335.655600:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.655607:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.655616:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.655620:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.655630:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.655651:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.655658:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000646423d7/0xdb7edb52b8334f55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.655676:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.655678:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.655680:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572335.657625:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5058a4000 x1875449639045504/t8589935832(8589935832) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.657641:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.657644:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.657650:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.657657:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935832 00000100:00080000:3.0:1788572335.657674:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5058a7100 x1875449639045632/t8589935833(8589935833) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.657691:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045504:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.657717:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045632:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.657852:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.658862:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639045632 00000100:00100000:0.0:1788572335.658873:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639045632 00000100:00100000:0.0:1788572335.658943:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:0.0:1788572335.658955:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+61:3649:x1875449639045632:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.658969:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935833, current: 8589935833, replaying 00000100:00100000:0.0:1788572335.658986:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+61:3649:x1875449639045632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34us (1134us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.658992:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00010000:00080000:3.0:1788572335.659273:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935833, next_transno: 8589935833 00010000:00080000:3.0:1788572335.659277:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935833) 00010000:00080000:3.0:1788572335.659286:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639045632 t8589935833 from 0@lo req@ffff94e6412c0000 x1875449639045632/t0(8589935833) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.659336:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2520 count 1 00002000:00010000:3.0:1788572335.659624:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.659632:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.659647:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d8:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.659652:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.659659:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.659675:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.659686:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.659693:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.659724:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.659962:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.659980:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935834 00010000:00080000:3.0:1788572335.659984:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935834 00010000:00010000:2.0:1788572335.660088:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.660096:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.660104:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.660109:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.660118:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.660136:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.660142:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8334f5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.660163:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.660165:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.660167:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572335.660579:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5058a7100 x1875449639045632/t8589935833(8589935833) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.660589:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.660592:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.660597:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.660604:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935833 00000100:00080000:0.0:1788572335.660621:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5058a5f80 x1875449639046144/t8589935834(8589935834) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.660634:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639045632:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.660652:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639046144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.660690:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.667874:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639046144 00000100:00100000:2.0:1788572335.667891:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639046144 00000100:00100000:2.0:1788572335.667992:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1788572335.668032:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+62:3649:x1875449639046144:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.668059:0:17011:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935834, current: 8589935834, replaying 00000100:00100000:2.0:1788572335.668078:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+62:3649:x1875449639046144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 77us (7388us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.668085:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00010000:00080000:0.0:1788572335.668142:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935834, next_transno: 8589935834 00010000:00080000:0.0:1788572335.668147:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935834) 00010000:00080000:0.0:1788572335.668159:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639046144 t8589935834 from 0@lo req@ffff94e62d289880 x1875449639046144/t0(8589935834) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.668200:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2524 count 1 00002000:00010000:0.0:1788572335.668341:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.668349:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.668366:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dc:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.668370:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.668377:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.668391:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.668401:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.668409:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.668430:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.668617:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00000100:00080000:0.0:1788572335.668660:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5058a5f80 x1875449639046144/t8589935834(8589935834) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.668670:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.668672:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.668678:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.668685:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935834 00000100:00080000:0.0:1788572335.668703:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5058a5c00 x1875449639047424/t8589935835(8589935835) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.668713:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639046144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.668732:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639047424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.668776:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.683163:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639047424 00000100:00100000:3.0:1788572335.683181:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639047424 00000100:00100000:3.0:1788572335.683289:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:3.0:1788572335.683299:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3649:x1875449639047424:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.683313:0:43966:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935835, current: 8589935835, replaying 00000100:00100000:3.0:1788572335.683320:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3649:x1875449639047424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25us (14545us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.683326:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00010000:00010000:2.0:1788572335.701168:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.701184:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.701199:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.701205:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.701217:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.701239:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.701253:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093d91469/0xdb7edb52b8334f63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.701281:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.701283:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.701285:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572335.705805:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935835, next_transno: 8589935835 00010000:00080000:0.0:1788572335.705816:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935835) 00010000:00080000:0.0:1788572335.705831:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639047424 t8589935835 from 0@lo req@ffff94e62d289500 x1875449639047424/t0(8589935835) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.705886:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2525 count 1 00002000:00010000:0.0:1788572335.706045:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.706054:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.706069:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dd:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.706074:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.706080:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.706096:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.706106:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.706114:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.706136:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.706295:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.706310:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935836 00010000:00080000:0.0:1788572335.706314:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935836 00000100:00080000:0.0:1788572335.706359:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5058a5c00 x1875449639047424/t8589935835(8589935835) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.706369:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.706372:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.706377:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.706384:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935835 00000100:00080000:0.0:1788572335.706398:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2df80 x1875449639047808/t8589935836(8589935836) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.706408:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639047424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.706426:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639047808:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572335.706600:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.706608:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.706617:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.706621:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.706631:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.706649:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.706657:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2edf29b/0xdb7edb52b8334f6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.706678:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.706680:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.706682:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572335.706746:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.706884:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639047808 00000100:00100000:2.0:1788572335.706891:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639047808 00000100:00100000:2.0:1788572335.706936:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:2.0:1788572335.706945:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+64:3649:x1875449639047808:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.706953:0:43975:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935836, current: 8589935836, replaying 00000100:00100000:2.0:1788572335.706962:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+64:3649:x1875449639047808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19us (218us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.706968:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00010000:00080000:0.0:1788572335.709112:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935836, next_transno: 8589935836 00010000:00080000:0.0:1788572335.709122:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935836) 00010000:00080000:0.0:1788572335.709135:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639047808 t8589935836 from 0@lo req@ffff94e62d288700 x1875449639047808/t0(8589935836) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.709192:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2528 count 1 00002000:00010000:0.0:1788572335.709299:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.709307:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334f71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.709321:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e0:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.709326:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.709332:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.709347:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.709357:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.709365:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.709393:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572335.709523:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.709530:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.709537:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.709542:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.709551:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334f71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.709568:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334f71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.709575:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b8334f71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.709594:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.709596:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.709597:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572335.709960:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.709981:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935837 00010000:00080000:0.0:1788572335.709986:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935837 00000100:00080000:0.0:1788572335.710080:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2df80 x1875449639047808/t8589935836(8589935836) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.710096:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.710098:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.710104:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.710111:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935836 00000100:00080000:0.0:1788572335.710127:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2d500 x1875449639047552/t8589935837(8589935837) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.710138:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639047808:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.710156:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639047552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.710187:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.710286:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639047552 00000100:00100000:2.0:1788572335.710293:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639047552 00000100:00100000:2.0:1788572335.710339:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:2.0:1788572335.710348:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3649:x1875449639047552:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.710358:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935837, current: 8589935837, replaying 00000100:00100000:2.0:1788572335.710366:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3649:x1875449639047552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21us (180us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.710373:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00010000:00080000:0.0:1788572335.710532:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935837, next_transno: 8589935837 00010000:00080000:0.0:1788572335.710536:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935837) 00010000:00080000:0.0:1788572335.710542:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639047552 t8589935837 from 0@lo req@ffff94e62d28a680 x1875449639047552/t0(8589935837) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.710573:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2526 count 1 00002000:00010000:0.0:1788572335.710667:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.710674:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334f78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.710687:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9de:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.710691:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.710697:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.710709:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.710718:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.710726:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.711859:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.712057:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.712077:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935838 00010000:00080000:0.0:1788572335.712082:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935838 00000100:00080000:0.0:1788572335.712134:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2d500 x1875449639047552/t8589935837(8589935837) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.712143:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.712146:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.712151:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.712157:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935837 00000100:00080000:0.0:1788572335.712175:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e633e2f480 x1875449639047680/t8589935838(8589935838) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.712186:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639047552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.712202:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639047680:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.712230:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.712258:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639047680 00000100:00100000:0.0:1788572335.712264:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639047680 00000100:00100000:0.0:1788572335.712305:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:0.0:1788572335.712315:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+66:3649:x1875449639047680:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.712324:0:43976:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935838, current: 8589935838, replaying 00000100:00100000:0.0:1788572335.712335:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+66:3649:x1875449639047680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22us (104us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.712341:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00010000:00080000:0.0:1788572335.712363:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935838, next_transno: 8589935838 00010000:00080000:0.0:1788572335.712366:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935838) 00010000:00080000:0.0:1788572335.712372:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639047680 t8589935838 from 0@lo req@ffff94e62d288000 x1875449639047680/t0(8589935838) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.712400:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2527 count 1 00002000:00010000:0.0:1788572335.712888:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.712897:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334f7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.712912:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9df:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.712917:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.712923:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.712937:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.712947:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.712960:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334f7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.719855:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572335.719870:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.719883:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.719888:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.719899:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334f78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.719922:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334f78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.719929:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b8334f78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.719976:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.719980:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334f7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.719986:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.719989:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334f7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.719996:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334f7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.720053:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334f7f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.720061:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.720063:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.720065:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.721230:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572335.721240:0:114791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8334f7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.721384:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572335.722096:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.722127:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935839 00010000:00080000:0.0:1788572335.722132:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935839 00000100:00080000:1.0:1788572335.722302:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e633e2f480 x1875449639047680/t8589935838(8589935838) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.722313:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.722315:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.722333:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.722340:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935838 00000100:00080000:1.0:1788572335.722356:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63767dc00 x1875449639048320/t8589935839(8589935839) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.722367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639047680:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.722391:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.722429:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.722635:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639048320 00000100:00100000:3.0:1788572335.722642:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639048320 00000100:00100000:3.0:1788572335.722689:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:3.0:1788572335.722698:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3649:x1875449639048320:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.722711:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935839, current: 8589935839, replaying 00000100:00100000:3.0:1788572335.722728:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3649:x1875449639048320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32us (298us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.722734:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00010000:00080000:0.0:1788572335.723563:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935839, next_transno: 8589935839 00010000:00080000:0.0:1788572335.723570:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935839) 00010000:00080000:0.0:1788572335.723580:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639048320 t8589935839 from 0@lo req@ffff94e60fe47100 x1875449639048320/t0(8589935839) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.723625:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2532 count 1 00002000:00010000:0.0:1788572335.723730:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.723738:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334f86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.723754:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e4:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.723769:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.723777:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.723792:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.723803:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.723811:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.723828:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572335.723839:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.723845:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.723852:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.723856:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.723865:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.723880:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334f86 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.723887:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8334f86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.723905:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.723907:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.723908:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572335.724078:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.724094:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935840 00010000:00080000:0.0:1788572335.724099:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935840 00000100:00080000:1.0:1788572335.726640:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63767dc00 x1875449639048320/t8589935839(8589935839) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.726654:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.726657:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.726663:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.726671:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935839 00000100:00080000:1.0:1788572335.726688:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63767d180 x1875449639047936/t8589935840(8589935840) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.726700:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.726721:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639047936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.726785:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.727786:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639047936 00000100:00100000:0.0:1788572335.727796:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639047936 00000100:00100000:0.0:1788572335.727857:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:0.0:1788572335.727866:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3649:x1875449639047936:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.727880:0:8464:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935840, current: 8589935840, replaying 00000100:00100000:0.0:1788572335.727895:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3649:x1875449639047936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32us (1111us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.727902:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00010000:00080000:1.0:1788572335.728128:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935840, next_transno: 8589935840 00010000:00080000:1.0:1788572335.728134:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935840) 00010000:00080000:1.0:1788572335.728144:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639047936 t8589935840 from 0@lo req@ffff94e60fe45880 x1875449639047936/t0(8589935840) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.728184:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2529 count 1 00002000:00010000:1.0:1788572335.728306:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.728315:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.728330:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e1:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.728335:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.728342:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.728356:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.728367:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.728373:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.728399:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.728551:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.728565:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935841 00010000:00080000:1.0:1788572335.728569:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935841 00010000:00010000:2.0:1788572335.728666:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.728673:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.728682:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.728687:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.728702:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.728720:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.728727:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334f8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.728745:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.728747:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.728749:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572335.729919:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63767d180 x1875449639047936/t8589935840(8589935840) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.729929:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.729932:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.729937:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.729945:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935840 00000100:00080000:0.0:1788572335.729961:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63767df80 x1875449639048448/t8589935841(8589935841) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.729972:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639047936:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.729990:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048448:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.730072:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.736052:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639048448 00000100:00100000:3.0:1788572335.736069:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639048448 00000100:00100000:3.0:1788572335.736137:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:3.0:1788572335.736147:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3649:x1875449639048448:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.736163:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935841, current: 8589935841, replaying 00000100:00100000:3.0:1788572335.736178:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3649:x1875449639048448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33us (6106us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.736185:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00010000:00080000:1.0:1788572335.736398:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935841, next_transno: 8589935841 00010000:00080000:1.0:1788572335.736403:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935841) 00010000:00080000:1.0:1788572335.736413:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639048448 t8589935841 from 0@lo req@ffff94e62d288380 x1875449639048448/t0(8589935841) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.736449:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2533 count 1 00002000:00010000:1.0:1788572335.736568:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.736577:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334f94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.736594:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e5:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.736599:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.736606:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.736621:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.736632:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.736640:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.736668:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.736846:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.736860:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935842 00010000:00080000:1.0:1788572335.736864:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935842 00000100:00080000:0.0:1788572335.737120:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63767df80 x1875449639048448/t8589935841(8589935841) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.737130:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.737133:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.737139:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.737146:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935841 00000100:00080000:0.0:1788572335.737162:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63767c380 x1875449639048832/t8589935842(8589935842) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.737173:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048448:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.737192:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.737226:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572335.737308:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.737315:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.737335:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.737340:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.737350:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334f94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.737367:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334f94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.737375:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334f94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.737393:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.737395:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.737397:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572335.738637:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639048832 00000100:00100000:1.0:1788572335.738651:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639048832 00000100:00100000:1.0:1788572335.738704:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:1.0:1788572335.738714:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+70:3649:x1875449639048832:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.738726:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935842, current: 8589935842, replaying 00000100:00100000:1.0:1788572335.738740:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+70:3649:x1875449639048832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29us (1514us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.738747:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00010000:00080000:1.0:1788572335.738775:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935842, next_transno: 8589935842 00010000:00080000:1.0:1788572335.738779:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935842) 00010000:00080000:1.0:1788572335.738789:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639048832 t8589935842 from 0@lo req@ffff94e62d28bb80 x1875449639048832/t0(8589935842) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.738829:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2536 count 1 00002000:00010000:1.0:1788572335.738931:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.738938:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334f9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.738954:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e8:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.738959:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.738965:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.738981:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.738992:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.739028:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.739058:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572335.739070:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.739075:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.739083:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.739087:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.739097:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334f9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.739112:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334f9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.739120:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334f9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.739138:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.739140:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.739141:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.739281:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.739298:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935843 00010000:00080000:1.0:1788572335.739302:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935843 00000100:00080000:1.0:1788572335.740277:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63767c380 x1875449639048832/t8589935842(8589935842) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.740288:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.740291:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.740297:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.740305:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935842 00000100:00080000:1.0:1788572335.740332:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63767c700 x1875449639048960/t8589935843(8589935843) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.740349:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048832:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.740368:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048960:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.740410:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.741477:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639048960 00000100:00100000:3.0:1788572335.741487:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639048960 00000100:00100000:3.0:1788572335.741543:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:3.0:1788572335.741554:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+71:3649:x1875449639048960:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.741567:0:43966:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935843, current: 8589935843, replaying 00000100:00100000:3.0:1788572335.741578:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+71:3649:x1875449639048960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27us (1169us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.741584:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00010000:00080000:1.0:1788572335.744806:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935843, next_transno: 8589935843 00010000:00080000:1.0:1788572335.744815:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935843) 00010000:00080000:1.0:1788572335.744829:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639048960 t8589935843 from 0@lo req@ffff94e5038c1180 x1875449639048960/t0(8589935843) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.744878:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2537 count 1 00002000:00010000:1.0:1788572335.744993:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.745023:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fa2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.745049:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e9:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.745054:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.745062:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.745078:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.745088:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.745095:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.745125:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.745286:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.745304:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935844 00010000:00080000:1.0:1788572335.745308:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935844 00000100:00080000:1.0:1788572335.745366:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63767c700 x1875449639048960/t8589935843(8589935843) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.745376:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.745378:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.745384:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.745391:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935843 00000100:00080000:1.0:1788572335.745407:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63767c000 x1875449639048064/t8589935844(8589935844) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.745417:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048960:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.745436:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.745470:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.753341:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639048064 00000100:00100000:1.0:1788572335.753359:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639048064 00000100:00100000:1.0:1788572335.755947:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:1.0:1788572335.755971:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+72:3649:x1875449639048064:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.755988:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935844, current: 8589935844, replaying 00000100:00100000:1.0:1788572335.756017:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+72:3649:x1875449639048064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43us (10533us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.756028:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00010000:00080000:1.0:1788572335.756071:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935844, next_transno: 8589935844 00010000:00080000:1.0:1788572335.756075:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935844) 00010000:00080000:1.0:1788572335.756085:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639048064 t8589935844 from 0@lo req@ffff94e63c5d1450 x1875449639048064/t0(8589935844) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.756128:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2530 count 1 00002000:00010000:1.0:1788572335.756259:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.756267:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fa9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.756283:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e2:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.756288:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.756294:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.756308:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.756318:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.756325:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.756345:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572335.757638:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572335.757651:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.757664:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.757668:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.757678:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.757697:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fa2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.757704:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.757729:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.757734:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.757740:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.757742:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.757749:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.757759:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fa9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.757778:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fa9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.757795:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.757797:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.757799:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.759141:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.759243:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935845 00010000:00080000:1.0:1788572335.759250:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935845 00000100:00080000:0.0:1788572335.759933:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63767c000 x1875449639048064/t8589935844(8589935844) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.759947:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.759949:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.759955:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.759962:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935844 00000100:00080000:0.0:1788572335.759981:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63767ed80 x1875449639048576/t8589935845(8589935845) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.759993:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.760051:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.760102:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.760266:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639048576 00000100:00100000:2.0:1788572335.760274:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639048576 00010000:00010000:3.0:1788572335.760520:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572335.760647:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:0.0:1788572335.760660:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+73:3649:x1875449639048576:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.760674:0:43964:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935845, current: 8589935845, replaying 00000100:00100000:0.0:1788572335.760695:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+73:3649:x1875449639048576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 39us (593us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.760702:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00010000:00080000:1.0:1788572335.762702:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935845, next_transno: 8589935845 00010000:00080000:1.0:1788572335.762712:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935845) 00010000:00080000:1.0:1788572335.762726:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639048576 t8589935845 from 0@lo req@ffff94e62d289f80 x1875449639048576/t0(8589935845) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.762790:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2534 count 1 00002000:00010000:1.0:1788572335.762906:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.762914:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.762929:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e6:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.762934:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.762939:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.762955:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.762964:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.762972:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.762998:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.763185:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.763206:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935846 00010000:00080000:1.0:1788572335.763209:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935846 00010000:00010000:3.0:1788572335.763922:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.763931:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.763943:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.763948:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.763959:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.763978:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.763987:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.764054:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.764056:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.764057:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572335.770954:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63767ed80 x1875449639048576/t8589935845(8589935845) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.770968:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.770972:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.770977:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.770985:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935845 00000100:00080000:1.0:1788572335.771019:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc12680 x1875449639049344/t8589935846(8589935846) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.771031:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048576:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.771064:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049344:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.771123:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.779465:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639049344 00000100:00100000:3.0:1788572335.779483:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639049344 00000100:00100000:3.0:1788572335.779545:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:3.0:1788572335.779557:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+74:3649:x1875449639049344:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.779572:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935846, current: 8589935846, replaying 00000100:00100000:3.0:1788572335.779583:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+74:3649:x1875449639049344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29us (8461us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.779590:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00010000:00080000:1.0:1788572335.787071:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935846, next_transno: 8589935846 00010000:00080000:1.0:1788572335.787081:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935846) 00010000:00080000:1.0:1788572335.787096:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639049344 t8589935846 from 0@lo req@ffff94e5038c1180 x1875449639049344/t0(8589935846) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.787147:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2540 count 1 00002000:00010000:1.0:1788572335.787265:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.787273:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334fb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.787289:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ec:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.787294:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.787300:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.787316:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.794396:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.794407:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.794436:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.794648:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.794674:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935847 00010000:00080000:1.0:1788572335.794679:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935847 00000100:00080000:1.0:1788572335.794734:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc12680 x1875449639049344/t8589935846(8589935846) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.794744:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.794747:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.794753:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.794761:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935846 00000100:00080000:1.0:1788572335.794779:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc10700 x1875449639049472/t8589935847(8589935847) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.794795:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049344:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.794813:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.794848:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572335.795148:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.795156:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.795166:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.795171:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.795181:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.795203:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334fb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.795212:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b8334fb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.795235:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.795237:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.795239:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572335.795252:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639049472 00000100:00100000:0.0:1788572335.795259:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639049472 00000100:00100000:0.0:1788572335.795306:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:0.0:1788572335.795316:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+75:3649:x1875449639049472:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.795341:0:43976:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935847, current: 8589935847, replaying 00000100:00100000:0.0:1788572335.795350:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+75:3649:x1875449639049472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36us (503us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.795356:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00010000:00080000:1.0:1788572335.795582:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935847, next_transno: 8589935847 00010000:00080000:1.0:1788572335.795586:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935847) 00010000:00080000:1.0:1788572335.795593:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639049472 t8589935847 from 0@lo req@ffff94e5038c3800 x1875449639049472/t0(8589935847) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.795632:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2541 count 1 00002000:00010000:1.0:1788572335.795735:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.795742:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334fbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.795754:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ed:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.795759:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.795766:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.795780:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.795789:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.795797:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.795828:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.795959:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.795972:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935848 00010000:00080000:1.0:1788572335.795977:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935848 00000100:00080000:1.0:1788572335.796038:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc10700 x1875449639049472/t8589935847(8589935847) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.796057:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.796060:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.796065:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.796071:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935847 00000100:00080000:1.0:1788572335.796087:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63767f100 x1875449639049088/t8589935848(8589935848) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.796097:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.796111:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.796138:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572335.796219:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.796225:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.796234:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.796237:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.796246:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334fbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.796265:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334fbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.796272:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8334fbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.796288:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.796290:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.796292:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572335.797721:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639049088 00000100:00100000:3.0:1788572335.797733:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639049088 00000100:00100000:3.0:1788572335.797837:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:3.0:1788572335.797848:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3649:x1875449639049088:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.797862:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935848, current: 8589935848, replaying 00000100:00100000:3.0:1788572335.797883:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3649:x1875449639049088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 38us (1745us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.797889:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00010000:00080000:2.0:1788572335.797929:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935848, next_transno: 8589935848 00010000:00080000:2.0:1788572335.797933:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935848) 00010000:00080000:2.0:1788572335.797944:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639049088 t8589935848 from 0@lo req@ffff94e5038c0a80 x1875449639049088/t0(8589935848) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.797981:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2538 count 1 00002000:00010000:2.0:1788572335.798128:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.798136:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334fc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.798150:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ea:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.798154:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.798161:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.798175:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.798185:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.798193:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.798214:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.800180:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.800213:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935849 00010000:00080000:2.0:1788572335.800219:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935849 00010000:00010000:0.0:1788572335.800382:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.800391:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.800413:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.800419:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.800431:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.800462:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334fc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.800480:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8334fc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.800518:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.800520:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.800522:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572335.803204:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63767f100 x1875449639049088/t8589935848(8589935848) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.803216:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.803219:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.803225:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.803232:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935848 00000100:00080000:1.0:1788572335.803251:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc11c00 x1875449639049600/t8589935849(8589935849) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.803263:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.803283:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.803354:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.803737:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639049600 00000100:00100000:3.0:1788572335.803746:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639049600 00000100:00100000:3.0:1788572335.803798:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:3.0:1788572335.803808:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3649:x1875449639049600:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.803819:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935849, current: 8589935849, replaying 00000100:00100000:3.0:1788572335.803841:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3649:x1875449639049600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36us (487us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.803848:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00010000:00080000:1.0:1788572335.806469:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935849, next_transno: 8589935849 00010000:00080000:1.0:1788572335.806478:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935849) 00010000:00080000:1.0:1788572335.806499:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639049600 t8589935849 from 0@lo req@ffff94e5038c3480 x1875449639049600/t0(8589935849) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.806561:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2542 count 1 00002000:00010000:1.0:1788572335.806701:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.806709:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334fcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.806732:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ee:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.806737:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.806751:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.806767:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.806792:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.806801:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.806822:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.806965:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.806982:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935850 00010000:00080000:1.0:1788572335.806986:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935850 00000100:00080000:1.0:1788572335.807062:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc11c00 x1875449639049600/t8589935849(8589935849) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.807070:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.807073:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.807079:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.807086:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935849 00000100:00080000:1.0:1788572335.807103:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc10e00 x1875449639049856/t8589935850(8589935850) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.807115:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.807132:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.807166:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572335.807946:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.807956:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.807971:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.807975:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.807986:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334fcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.808023:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334fcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.808030:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334fcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.808062:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.808064:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.808066:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572335.808082:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639049856 00000100:00100000:3.0:1788572335.808089:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639049856 00000100:00100000:3.0:1788572335.808138:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:3.0:1788572335.808148:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:3649:x1875449639049856:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.808160:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935850, current: 8589935850, replaying 00000100:00100000:3.0:1788572335.808177:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:3649:x1875449639049856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31us (1011us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.808183:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00010000:00080000:1.0:1788572335.808403:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935850, next_transno: 8589935850 00010000:00080000:1.0:1788572335.808407:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935850) 00010000:00080000:1.0:1788572335.808415:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639049856 t8589935850 from 0@lo req@ffff94e63ae3ce00 x1875449639049856/t0(8589935850) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.808450:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2544 count 1 00002000:00010000:1.0:1788572335.808552:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.808559:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.808572:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f0:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.808576:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.808583:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.808594:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.808603:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.808610:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.808634:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.808770:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.808785:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935851 00010000:00080000:1.0:1788572335.808789:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935851 00010000:00010000:3.0:1788572335.813322:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.813337:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.813352:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.813357:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.813370:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.813395:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.813402:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334fd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.813425:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.813426:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.813428:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572335.814545:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc10e00 x1875449639049856/t8589935850(8589935850) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.814559:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.814562:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.814568:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.814577:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935850 00000100:00080000:0.0:1788572335.814598:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc10380 x1875449639049984/t8589935851(8589935851) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.814609:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049856:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.814631:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.814687:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572335.814770:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572335.816709:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639049984 00000100:00100000:0.0:1788572335.816721:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639049984 00000100:00100000:0.0:1788572335.816783:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:0.0:1788572335.816792:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+79:3649:x1875449639049984:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.816805:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935851, current: 8589935851, replaying 00000100:00100000:0.0:1788572335.816817:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+79:3649:x1875449639049984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28us (2130us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.816823:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00010000:00080000:1.0:1788572335.816942:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935851, next_transno: 8589935851 00010000:00080000:1.0:1788572335.816946:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935851) 00010000:00080000:1.0:1788572335.816957:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639049984 t8589935851 from 0@lo req@ffff94e62d28b100 x1875449639049984/t0(8589935851) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.816993:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2545 count 1 00002000:00010000:1.0:1788572335.817581:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.817590:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334fda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.817606:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f1:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.817611:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.817617:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.817630:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.817640:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.817648:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.817669:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572335.817881:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.817888:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.817895:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.817900:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.817908:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334fda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.817924:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334fda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.817931:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b8334fda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.817948:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.817950:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.817952:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.820833:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.820865:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935852 00010000:00080000:1.0:1788572335.820870:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935852 00000100:00080000:2.0:1788572335.826665:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc10380 x1875449639049984/t8589935851(8589935851) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.826677:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.826680:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.826686:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.826693:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935851 00000100:00080000:2.0:1788572335.826711:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc11f80 x1875449639050112/t8589935852(8589935852) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.826722:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049984:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.826745:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050112:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.826800:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.826852:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639050112 00000100:00100000:2.0:1788572335.826858:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639050112 00000100:00100000:2.0:1788572335.826914:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:2.0:1788572335.826923:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+80:3649:x1875449639050112:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.826936:0:8465:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935852, current: 8589935852, replaying 00000100:00100000:2.0:1788572335.826946:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+80:3649:x1875449639050112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25us (147us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.826952:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00010000:00080000:1.0:1788572335.827593:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935852, next_transno: 8589935852 00010000:00080000:1.0:1788572335.827600:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935852) 00010000:00080000:1.0:1788572335.827610:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639050112 t8589935852 from 0@lo req@ffff94e637798380 x1875449639050112/t0(8589935852) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.827653:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2546 count 1 00002000:00010000:1.0:1788572335.827765:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.827773:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334fe1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.827788:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f2:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.827793:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.827799:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.827813:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.827822:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.827830:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.827856:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.827980:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.827998:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935853 00010000:00080000:1.0:1788572335.828025:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935853 00010000:00010000:2.0:1788572335.828106:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.828113:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.828121:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.828125:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.828134:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.828152:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334fe1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.828159:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8334fe1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.828177:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.828179:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.828181:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.828212:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc11f80 x1875449639050112/t8589935852(8589935852) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.828220:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.828223:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.828227:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.828234:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935852 00000100:00080000:2.0:1788572335.828250:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc13480 x1875449639050368/t8589935853(8589935853) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.828260:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050112:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.828273:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.828301:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.830387:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639050368 00000100:00100000:1.0:1788572335.830405:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639050368 00000100:00100000:1.0:1788572335.830481:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:1.0:1788572335.830492:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+81:3649:x1875449639050368:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.830506:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935853, current: 8589935853, replaying 00000100:00100000:1.0:1788572335.830521:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+81:3649:x1875449639050368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32us (2220us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.830531:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00010000:00080000:1.0:1788572335.830563:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935853, next_transno: 8589935853 00010000:00080000:1.0:1788572335.830567:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935853) 00010000:00080000:1.0:1788572335.830576:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639050368 t8589935853 from 0@lo req@ffff94e637798700 x1875449639050368/t0(8589935853) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.830615:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2548 count 1 00002000:00010000:1.0:1788572335.830722:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.830730:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fe8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.830746:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f4:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.830750:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.830756:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.830782:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.830792:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.830800:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.830825:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.830969:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.830994:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935854 00010000:00080000:1.0:1788572335.830998:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935854 00000100:00080000:2.0:1788572335.832540:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc13480 x1875449639050368/t8589935853(8589935853) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.832553:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.832557:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.832563:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.832570:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935853 00000100:00080000:2.0:1788572335.832594:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e641194e00 x1875449639050496/t8589935854(8589935854) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.832606:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.832632:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.832689:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.832737:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639050496 00000100:00100000:2.0:1788572335.832743:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639050496 00000100:00100000:2.0:1788572335.832785:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:2.0:1788572335.832792:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+82:3649:x1875449639050496:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.832803:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935854, current: 8589935854, replaying 00000100:00100000:2.0:1788572335.832813:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+82:3649:x1875449639050496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22us (125us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.832819:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00010000:00080000:1.0:1788572335.833054:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935854, next_transno: 8589935854 00010000:00080000:1.0:1788572335.833058:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935854) 00010000:00080000:1.0:1788572335.833066:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639050496 t8589935854 from 0@lo req@ffff94e63779b800 x1875449639050496/t0(8589935854) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.833099:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2549 count 1 00002000:00010000:1.0:1788572335.833203:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.833211:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.833226:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f5:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.833230:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.833237:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.833251:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.833260:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.833267:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.833287:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788572335.833430:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572335.833449:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.833456:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.833461:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.833469:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.833486:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fe8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.833493:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b8334fe8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.833510:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.833514:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.833520:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.833522:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.833528:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.833536:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.833543:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8334fef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.833554:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.833556:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.833558:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.833787:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.833806:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935855 00010000:00080000:1.0:1788572335.833810:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935855 00010000:00010000:3.0:1788572335.834076:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.836485:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e641194e00 x1875449639050496/t8589935854(8589935854) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.836499:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.836502:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.836508:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.836517:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935854 00000100:00080000:2.0:1788572335.836534:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63767f800 x1875449639048192/t8589935855(8589935855) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.836545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.836566:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.836620:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.837448:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639048192 00000100:00100000:1.0:1788572335.837459:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639048192 00000100:00100000:1.0:1788572335.837515:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:1.0:1788572335.837524:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:3649:x1875449639048192:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.837539:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935855, current: 8589935855, replaying 00000100:00100000:1.0:1788572335.837552:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+83:3649:x1875449639048192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30us (932us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.837559:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00010000:00080000:1.0:1788572335.837579:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935855, next_transno: 8589935855 00010000:00080000:1.0:1788572335.837582:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935855) 00010000:00080000:1.0:1788572335.837590:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639048192 t8589935855 from 0@lo req@ffff94e63779aa00 x1875449639048192/t0(8589935855) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.837623:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2531 count 1 00002000:00010000:1.0:1788572335.837734:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.837742:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334ff6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.837758:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e3:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.837762:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.837769:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.837784:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.837800:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.837808:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.837826:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.837960:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.837975:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935856 00010000:00080000:1.0:1788572335.837979:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935856 00010000:00010000:1.0:1788572335.837991:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.837997:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838023:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.838028:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838037:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838064:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334ff6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838071:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8334ff6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838091:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.838093:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.838094:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.838253:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63767f800 x1875449639048192/t8589935855(8589935855) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.838262:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.838265:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.838270:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.838277:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935855 00000100:00080000:2.0:1788572335.838294:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63767d500 x1875449639048704/t8589935856(8589935856) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.838304:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.838330:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.838365:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.838536:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639048704 00000100:00100000:1.0:1788572335.838542:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639048704 00000100:00100000:1.0:1788572335.838580:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:1.0:1788572335.838589:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+84:3649:x1875449639048704:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.838599:0:43976:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935856, current: 8589935856, replaying 00000100:00100000:1.0:1788572335.838609:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+84:3649:x1875449639048704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23us (245us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.838616:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00010000:00080000:1.0:1788572335.838627:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935856, next_transno: 8589935856 00010000:00080000:1.0:1788572335.838630:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935856) 00010000:00080000:1.0:1788572335.838635:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639048704 t8589935856 from 0@lo req@ffff94e63779a680 x1875449639048704/t0(8589935856) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.838662:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2535 count 1 00002000:00010000:1.0:1788572335.838727:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.838733:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334ffd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838743:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e7:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.838746:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.838751:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838765:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838774:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838781:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838796:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.838878:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.838889:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935857 00010000:00080000:1.0:1788572335.838892:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935857 00010000:00010000:1.0:1788572335.838903:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.838907:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838914:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.838917:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838925:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334ffd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838937:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334ffd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838944:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8334ffd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.838957:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.838959:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.838960:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.839054:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63767d500 x1875449639048704/t8589935856(8589935856) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.839061:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.839063:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.839066:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.839072:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935856 00000100:00080000:2.0:1788572335.839082:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63767e680 x1875449639049216/t8589935857(8589935857) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.839091:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639048704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.839101:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049216:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.839127:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.839613:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639049216 00000100:00100000:1.0:1788572335.839620:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639049216 00000100:00100000:1.0:1788572335.839701:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:1.0:1788572335.839711:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3649:x1875449639049216:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.839722:0:43967:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935857, current: 8589935857, replaying 00000100:00100000:1.0:1788572335.839733:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3649:x1875449639049216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26us (606us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.839740:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00010000:00080000:0.0:1788572335.847640:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935857, next_transno: 8589935857 00010000:00080000:0.0:1788572335.847650:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935857) 00010000:00080000:0.0:1788572335.847664:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639049216 t8589935857 from 0@lo req@ffff94e637798000 x1875449639049216/t0(8589935857) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.847721:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2539 count 1 00002000:00010000:0.0:1788572335.847845:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.847853:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335004 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.847870:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9eb:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.847875:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.847881:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.847896:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.847907:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.847914:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.847944:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.848139:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.848157:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935858 00010000:00080000:0.0:1788572335.848161:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935858 00010000:00010000:2.0:1788572335.848686:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.848697:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.848706:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.848711:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.848720:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335004 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.848738:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335004 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.848745:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335004 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.848767:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.848769:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.848771:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.848814:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63767e680 x1875449639049216/t8589935857(8589935857) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.848828:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.848831:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.848836:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.848844:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935857 00000100:00080000:2.0:1788572335.848864:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc11500 x1875449639049728/t8589935858(8589935858) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.848875:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049216:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.848895:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049728:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.848937:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.850458:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639049728 00000100:00100000:0.0:1788572335.850473:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639049728 00000100:00100000:0.0:1788572335.850534:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:0.0:1788572335.850544:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+86:3649:x1875449639049728:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.850560:0:8464:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935858, current: 8589935858, replaying 00000100:00100000:0.0:1788572335.850574:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+86:3649:x1875449639049728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32us (1637us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.850583:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00010000:00080000:0.0:1788572335.850610:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935858, next_transno: 8589935858 00010000:00080000:0.0:1788572335.850613:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935858) 00010000:00080000:0.0:1788572335.850623:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639049728 t8589935858 from 0@lo req@ffff94e637798a80 x1875449639049728/t0(8589935858) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.850660:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2543 count 1 00002000:00010000:0.0:1788572335.850779:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.850786:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b833500b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.850801:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ef:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.850805:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.850811:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b833500b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.850825:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b833500b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.850836:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b833500b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.850844:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b833500b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.850864:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.851027:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.851053:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935859 00010000:00080000:0.0:1788572335.851057:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935859 00010000:00010000:2.0:1788572335.853538:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.853555:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b833500b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.853573:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.853579:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b833500b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.853592:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b833500b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.853617:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b833500b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.853625:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b833500b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.853653:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.853655:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.853657:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.853717:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc11500 x1875449639049728/t8589935858(8589935858) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.853727:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.853730:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.853736:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.853744:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935858 00000100:00080000:2.0:1788572335.853766:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc13800 x1875449639050240/t8589935859(8589935859) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.853778:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639049728:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.853803:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.853860:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.858230:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639050240 00000100:00100000:0.0:1788572335.858250:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639050240 00000100:00100000:0.0:1788572335.858311:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:0.0:1788572335.858322:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+87:3649:x1875449639050240:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.858337:0:43970:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935859, current: 8589935859, replaying 00000100:00100000:0.0:1788572335.858349:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+87:3649:x1875449639050240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29us (4490us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.858356:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00010000:00080000:0.0:1788572335.858379:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935859, next_transno: 8589935859 00010000:00080000:0.0:1788572335.858382:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935859) 00010000:00080000:0.0:1788572335.858391:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639050240 t8589935859 from 0@lo req@ffff94e637799f80 x1875449639050240/t0(8589935859) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.858426:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2547 count 1 00002000:00010000:0.0:1788572335.862899:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.862912:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335012 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.862930:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f3:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.862935:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.862942:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.862956:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.862971:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.862978:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.863022:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.863199:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.863225:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935860 00010000:00080000:0.0:1788572335.863230:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935860 00010000:00010000:2.0:1788572335.866393:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.866409:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.866424:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.866429:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.866452:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335012 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.866480:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335012 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.866487:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335012 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.866512:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.866514:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.866516:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.866591:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc13800 x1875449639050240/t8589935859(8589935859) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.866602:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.866606:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.866612:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.866619:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935859 00000100:00080000:2.0:1788572335.866641:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e641195500 x1875449639050624/t8589935860(8589935860) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.866653:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.866677:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.866750:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.867625:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639050624 00000100:00100000:1.0:1788572335.867636:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639050624 00000100:00100000:1.0:1788572335.867681:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:1.0:1788572335.867689:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+88:3649:x1875449639050624:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.867704:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935860, current: 8589935860, replaying 00000100:00100000:1.0:1788572335.867714:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+88:3649:x1875449639050624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27us (965us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.867722:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00010000:00080000:0.0:1788572335.868597:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935860, next_transno: 8589935860 00010000:00080000:0.0:1788572335.868604:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935860) 00010000:00080000:0.0:1788572335.868616:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639050624 t8589935860 from 0@lo req@ffff94e637798e00 x1875449639050624/t0(8589935860) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.868660:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2550 count 1 00002000:00010000:0.0:1788572335.868767:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.868776:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335019 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.868793:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f6:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.868798:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.868804:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.868819:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.868831:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.868839:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.868855:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.868990:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.869026:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935861 00010000:00080000:0.0:1788572335.869031:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935861 00000100:00080000:2.0:1788572335.869448:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e641195500 x1875449639050624/t8589935860(8589935860) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.869459:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.869463:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.869469:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.869478:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935860 00000100:00080000:2.0:1788572335.869498:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6412c2680 x1875449639051136/t8589935861(8589935861) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.869510:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.869529:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.869563:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572335.871161:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.871175:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.871195:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.871201:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.871213:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335019 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.871236:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335019 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.871244:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335019 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.871269:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.871270:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.871272:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572335.871359:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639051136 00000100:00100000:0.0:1788572335.871369:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639051136 00000100:00100000:0.0:1788572335.871429:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:0.0:1788572335.871450:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+89:3649:x1875449639051136:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.871464:0:8465:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935861, current: 8589935861, replaying 00000100:00100000:0.0:1788572335.871477:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+89:3649:x1875449639051136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 41us (1914us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.871484:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00010000:00080000:0.0:1788572335.871498:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935861, next_transno: 8589935861 00010000:00080000:0.0:1788572335.871502:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935861) 00010000:00080000:0.0:1788572335.871511:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639051136 t8589935861 from 0@lo req@ffff94e637799180 x1875449639051136/t0(8589935861) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.871546:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2552 count 1 00002000:00010000:0.0:1788572335.871661:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.871669:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8335020 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.871683:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f8:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.871687:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.871694:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8335020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.871706:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8335020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.871715:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8335020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.871723:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8335020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.871739:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.871892:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.871908:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935862 00010000:00080000:0.0:1788572335.871912:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935862 00010000:00010000:1.0:1788572335.873588:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.873600:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8335020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.873613:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.873617:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8335020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.873629:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8335020 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.873651:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8335020 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.873659:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b8335020 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.873684:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.873686:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.873688:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.874607:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6412c2680 x1875449639051136/t8589935861(8589935861) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.874618:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.874621:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.874627:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.874635:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935861 00000100:00080000:2.0:1788572335.874655:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6412c3100 x1875449639051648/t8589935862(8589935862) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.874666:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.874687:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051648:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.874743:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.876196:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639051648 00000100:00100000:2.0:1788572335.876209:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639051648 00000100:00100000:2.0:1788572335.876271:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:2.0:1788572335.876282:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+90:3649:x1875449639051648:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.876298:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935862, current: 8589935862, replaying 00000100:00100000:2.0:1788572335.876311:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+90:3649:x1875449639051648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32us (1568us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.876317:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00010000:00080000:2.0:1788572335.881288:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935862, next_transno: 8589935862 00010000:00080000:2.0:1788572335.881298:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935862) 00010000:00080000:2.0:1788572335.881313:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639051648 t8589935862 from 0@lo req@ffff94e63779bb80 x1875449639051648/t0(8589935862) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.881367:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2556 count 1 00002000:00010000:2.0:1788572335.881523:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.881532:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8335027 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.881549:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fc:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.881554:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.881561:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8335027 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.881577:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8335027 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.881589:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8335027 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.881597:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8335027 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.881628:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.881805:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.881825:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935863 00010000:00080000:2.0:1788572335.881829:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935863 00010000:00010000:2.0:1788572335.881845:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.881850:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8335027 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.881858:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.881862:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8335027 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.881872:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8335027 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.881889:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8335027 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.881897:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac34f86e/0xdb7edb52b8335027 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.881915:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.881917:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.881918:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.881958:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6412c3100 x1875449639051648/t8589935862(8589935862) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.881968:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.881971:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.881977:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.881984:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935862 00000100:00080000:2.0:1788572335.882026:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6412c3480 x1875449639050752/t8589935863(8589935863) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.882036:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051648:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.882066:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.882100:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.882145:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639050752 00000100:00100000:2.0:1788572335.882152:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639050752 00000100:00100000:2.0:1788572335.882191:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:2.0:1788572335.882200:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+91:3649:x1875449639050752:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.882207:0:43975:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935863, current: 8589935863, replaying 00000100:00100000:2.0:1788572335.882216:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+91:3649:x1875449639050752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18us (116us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.882223:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00010000:00080000:2.0:1788572335.882236:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935863, next_transno: 8589935863 00010000:00080000:2.0:1788572335.882239:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935863) 00010000:00080000:2.0:1788572335.882244:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639050752 t8589935863 from 0@lo req@ffff94e61e762a00 x1875449639050752/t0(8589935863) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.882266:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2551 count 1 00002000:00010000:2.0:1788572335.882323:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.882330:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b833502e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.882340:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f7:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.882343:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.882348:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b833502e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.882359:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b833502e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.882367:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b833502e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.882375:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b833502e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.882389:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.882463:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.882472:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935864 00010000:00080000:2.0:1788572335.882477:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935864 00010000:00010000:2.0:1788572335.882486:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.882490:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b833502e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.882498:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.882502:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b833502e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.882511:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b833502e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.882522:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b833502e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.882530:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015d81636/0xdb7edb52b833502e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.882543:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.882545:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.882546:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.882564:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6412c3480 x1875449639050752/t8589935863(8589935863) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.882572:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.882574:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.882578:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.882585:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935863 00000100:00080000:2.0:1788572335.882595:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6412c0a80 x1875449639051264/t8589935864(8589935864) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.882604:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639050752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.882612:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.882632:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.882872:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639051264 00000100:00100000:1.0:1788572335.882877:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639051264 00000100:00100000:1.0:1788572335.882981:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:1.0:1788572335.882989:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+92:3649:x1875449639051264:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.882996:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935864, current: 8589935864, replaying 00000100:00100000:1.0:1788572335.883021:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+92:3649:x1875449639051264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16us (370us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.883028:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00010000:00080000:2.0:1788572335.884609:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935864, next_transno: 8589935864 00010000:00080000:2.0:1788572335.884619:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935864) 00010000:00080000:2.0:1788572335.884632:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639051264 t8589935864 from 0@lo req@ffff94e63ae6b480 x1875449639051264/t0(8589935864) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.884681:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2553 count 1 00002000:00010000:2.0:1788572335.884780:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.884788:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8335035 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.884803:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f9:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.884807:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.884814:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8335035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.884828:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8335035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.884838:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8335035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.884845:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8335035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.884866:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.885027:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.885057:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935865 00010000:00080000:2.0:1788572335.885061:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935865 00010000:00010000:2.0:1788572335.885074:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.885080:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8335035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.885088:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.885093:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8335035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.885102:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8335035 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.885121:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8335035 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.885128:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000824cdf94/0xdb7edb52b8335035 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.885144:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.885146:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.885148:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.885190:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6412c0a80 x1875449639051264/t8589935864(8589935864) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.885199:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.885202:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.885207:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.885214:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935864 00000100:00080000:2.0:1788572335.885236:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6412c0e00 x1875449639051776/t8589935865(8589935865) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.885248:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.885268:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.885300:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.885585:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639051776 00000100:00100000:0.0:1788572335.885593:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639051776 00000100:00100000:0.0:1788572335.885648:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:0.0:1788572335.885658:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+93:3649:x1875449639051776:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.885668:0:43974:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935865, current: 8589935865, replaying 00000100:00100000:0.0:1788572335.885678:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+93:3649:x1875449639051776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23us (378us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.885685:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00010000:00080000:2.0:1788572335.886705:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935865, next_transno: 8589935865 00010000:00080000:2.0:1788572335.886712:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935865) 00010000:00080000:2.0:1788572335.886722:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639051776 t8589935865 from 0@lo req@ffff94e62d2f1c00 x1875449639051776/t0(8589935865) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.886761:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2557 count 1 00002000:00010000:2.0:1788572335.886862:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.886870:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b833503c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.886884:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fd:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.886888:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.886893:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b833503c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.886905:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b833503c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.886916:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b833503c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.886923:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b833503c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.886951:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572335.887711:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.887719:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b833503c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.887729:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.887734:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b833503c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.887744:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b833503c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.887760:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b833503c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.887767:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074deb35d/0xdb7edb52b833503c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.887786:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.887787:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.887789:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788572335.888053:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.888076:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935866 00010000:00080000:2.0:1788572335.888080:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935866 00000100:00080000:3.0:1788572335.894187:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6412c0e00 x1875449639051776/t8589935865(8589935865) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.894202:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.894205:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.894212:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.894220:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935865 00000100:00080000:3.0:1788572335.894244:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6184d4000 x1875449639052160/t8589935866(8589935866) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.894255:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.894357:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639052160:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.894419:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.894530:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639052160 00000100:00100000:3.0:1788572335.894538:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639052160 00000100:00100000:3.0:1788572335.894594:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:3.0:1788572335.894603:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+94:3649:x1875449639052160:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.894617:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935866, current: 8589935866, replaying 00000100:00100000:3.0:1788572335.894629:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+94:3649:x1875449639052160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28us (212us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.894635:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00010000:00080000:2.0:1788572335.894694:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935866, next_transno: 8589935866 00010000:00080000:2.0:1788572335.894698:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935866) 00010000:00080000:2.0:1788572335.894706:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639052160 t8589935866 from 0@lo req@ffff94e62d2f3480 x1875449639052160/t0(8589935866) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.894744:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2560 count 1 00002000:00010000:2.0:1788572335.894857:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.894865:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8335043 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.894881:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.894885:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.894891:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8335043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.894905:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8335043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.894914:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8335043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.894922:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8335043 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.894951:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.895107:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.895124:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935867 00010000:00080000:2.0:1788572335.895127:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935867 00000100:00080000:2.0:1788572335.895155:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6184d4000 x1875449639052160/t8589935866(8589935866) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.895162:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.895164:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.895168:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.895175:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935866 00000100:00080000:2.0:1788572335.895189:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6184d7480 x1875449639052288/t8589935867(8589935867) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.895197:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639052160:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.895207:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639052288:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.895231:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572335.895704:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.895712:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8335043 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.895722:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.895727:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8335043 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.895737:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8335043 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.895756:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8335043 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.895764:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc42b4c/0xdb7edb52b8335043 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.895789:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.895791:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.895792:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572335.897673:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639052288 00000100:00100000:2.0:1788572335.897691:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639052288 00000100:00100000:2.0:1788572335.897780:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:2.0:1788572335.897791:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+95:3649:x1875449639052288:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.897806:0:43970:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935867, current: 8589935867, replaying 00000100:00100000:2.0:1788572335.897823:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+95:3649:x1875449639052288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36us (2592us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.897829:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00010000:00080000:2.0:1788572335.897848:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935867, next_transno: 8589935867 00010000:00080000:2.0:1788572335.897851:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935867) 00010000:00080000:2.0:1788572335.897859:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639052288 t8589935867 from 0@lo req@ffff94e62d2f0e00 x1875449639052288/t0(8589935867) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.897894:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2561 count 1 00002000:00010000:2.0:1788572335.898040:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.898058:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b833504a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898072:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa01:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.898077:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.898083:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b833504a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898097:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b833504a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898108:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b833504a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898116:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b833504a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898133:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.898279:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.898295:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935868 00010000:00080000:2.0:1788572335.898299:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935868 00010000:00010000:2.0:1788572335.898310:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.898316:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b833504a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898324:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637701200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.898328:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b833504a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898336:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b833504a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898351:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b833504a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898359:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb8049cd/0xdb7edb52b833504a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898377:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.898379:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.898381:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.898420:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6184d7480 x1875449639052288/t8589935867(8589935867) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.898429:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.898432:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.898438:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.898445:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935867 00000100:00080000:2.0:1788572335.898466:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6412c1880 x1875449639051520/t8589935868(8589935868) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.898476:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639052288:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.898493:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.898527:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.898554:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639051520 00000100:00100000:2.0:1788572335.898558:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639051520 00000100:00100000:2.0:1788572335.898587:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:2.0:1788572335.898594:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+96:3649:x1875449639051520:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.898601:0:12091:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935868, current: 8589935868, replaying 00000100:00100000:2.0:1788572335.898609:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+96:3649:x1875449639051520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17us (83us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.898614:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00010000:00080000:2.0:1788572335.898628:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935868, next_transno: 8589935868 00010000:00080000:2.0:1788572335.898630:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935868) 00010000:00080000:2.0:1788572335.898635:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639051520 t8589935868 from 0@lo req@ffff94e501ff1500 x1875449639051520/t0(8589935868) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.898654:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2555 count 1 00002000:00010000:2.0:1788572335.898710:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.898715:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335051 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898723:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fb:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.898728:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.898732:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898741:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898750:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898757:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898772:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.898834:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.898846:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935869 00010000:00080000:2.0:1788572335.898849:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935869 00010000:00010000:2.0:1788572335.898859:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.898863:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898870:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1cc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.898873:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898880:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335051 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898896:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335051 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898903:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335051 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.898917:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.898919:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.898920:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.898942:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6412c1880 x1875449639051520/t8589935868(8589935868) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.898950:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.898952:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.898956:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.898962:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935868 00000100:00080000:2.0:1788572335.898972:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6184d5f80 x1875449639052032/t8589935869(8589935869) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.898980:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.898990:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639052032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.899034:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.902159:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639052032 00000100:00100000:3.0:1788572335.902180:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639052032 00000100:00100000:3.0:1788572335.902252:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:3.0:1788572335.902263:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+97:3649:x1875449639052032:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.902278:0:43967:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935869, current: 8589935869, replaying 00000100:00100000:3.0:1788572335.902289:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+97:3649:x1875449639052032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30us (3256us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.902297:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00010000:00080000:2.0:1788572335.903913:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935869, next_transno: 8589935869 00010000:00080000:2.0:1788572335.903923:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935869) 00010000:00080000:2.0:1788572335.903938:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639052032 t8589935869 from 0@lo req@ffff94e6184d5180 x1875449639052032/t0(8589935869) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.903983:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2559 count 1 00002000:00010000:2.0:1788572335.904169:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.904178:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b8335058 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.904194:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ff:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.904199:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.904205:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b8335058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.904221:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b8335058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.904233:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b8335058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.904241:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b8335058 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.904271:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.904454:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.904474:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935870 00010000:00080000:2.0:1788572335.904479:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935870 00000100:00080000:2.0:1788572335.904528:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6184d5f80 x1875449639052032/t8589935869(8589935869) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.904543:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.904546:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.904552:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.904560:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935869 00000100:00080000:2.0:1788572335.904586:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e501ff4700 x1875449639052544/t8589935870(8589935870) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.904599:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639052032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.904621:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639052544:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.904655:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.904848:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639052544 00000100:00100000:1.0:1788572335.904856:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639052544 00000100:00100000:1.0:1788572335.904906:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:1.0:1788572335.904915:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+98:3649:x1875449639052544:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.904924:0:8465:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935870, current: 8589935870, replaying 00000100:00100000:1.0:1788572335.904932:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+98:3649:x1875449639052544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20us (278us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.904939:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00010000:00010000:3.0:1788572335.904985:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.904993:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b8335058 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.905026:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1d200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.905032:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b8335058 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.905076:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b8335058 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.905097:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b8335058 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.905112:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b8335058 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.905134:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.905136:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.905138:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788572335.906526:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935870, next_transno: 8589935870 00010000:00080000:2.0:1788572335.906533:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935870) 00010000:00080000:2.0:1788572335.906546:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639052544 t8589935870 from 0@lo req@ffff94e6184d5c00 x1875449639052544/t0(8589935870) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.906588:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2563 count 1 00002000:00010000:2.0:1788572335.906704:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.906712:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b833505f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa03:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.906725:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa03:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.906729:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa03:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.906735:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b833505f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.906749:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b833505f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.906760:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b833505f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.906768:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b833505f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.906792:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572335.908029:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.908039:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b833505f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.908062:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1d800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.908067:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b833505f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.908076:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b833505f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.908094:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b833505f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.908103:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b833505f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.908123:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.908125:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.908127:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788572335.908205:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.908226:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935871 00010000:00080000:2.0:1788572335.908230:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935871 00000100:00080000:3.0:1788572335.911128:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e501ff4700 x1875449639052544/t8589935870(8589935870) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.911141:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.911145:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.911151:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.911159:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935870 00000100:00080000:3.0:1788572335.911181:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6412c3800 x1875449639051392/t8589935871(8589935871) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.911190:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639052544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.911275:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.911334:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.912484:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639051392 00000100:00100000:2.0:1788572335.912500:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639051392 00000100:00100000:2.0:1788572335.912559:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:2.0:1788572335.912569:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+99:3649:x1875449639051392:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.912582:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935871, current: 8589935871, replaying 00000100:00100000:2.0:1788572335.912606:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+99:3649:x1875449639051392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40us (1272us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.912613:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00010000:00080000:0.0:1788572335.912666:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935871, next_transno: 8589935871 00010000:00080000:0.0:1788572335.912671:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935871) 00010000:00080000:0.0:1788572335.912680:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639051392 t8589935871 from 0@lo req@ffff94e6412c1180 x1875449639051392/t0(8589935871) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.912719:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2554 count 1 00002000:00010000:0.0:1788572335.912842:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.912851:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335066 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.912866:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fa:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:0.0:1788572335.912871:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.912878:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.912893:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.912903:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.912911:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.912940:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.913129:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.913143:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935872 00010000:00080000:0.0:1788572335.913147:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935872 00010000:00010000:1.0:1788572335.913205:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.913212:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.913220:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.913225:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.913236:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335066 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.913255:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335066 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.913262:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335066 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.913281:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.913282:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.913284:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.913374:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6412c3800 x1875449639051392/t8589935871(8589935871) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.913384:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.913386:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.913392:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.913403:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935871 00000100:00080000:2.0:1788572335.913423:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc45c00 x1875449639051904/t8589935872(8589935872) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.913434:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.913450:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.913483:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.913699:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639051904 00000100:00100000:3.0:1788572335.913705:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639051904 00000100:00100000:3.0:1788572335.913756:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:3.0:1788572335.913764:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+100:3649:x1875449639051904:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.913773:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935872, current: 8589935872, replaying 00000100:00100000:3.0:1788572335.913791:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+100:3649:x1875449639051904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29us (308us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.913798:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00010000:00080000:1.0:1788572335.913844:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935872, next_transno: 8589935872 00010000:00080000:1.0:1788572335.913848:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935872) 00010000:00080000:1.0:1788572335.913855:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639051904 t8589935872 from 0@lo req@ffff94e641196d80 x1875449639051904/t0(8589935872) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.913881:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2558 count 1 00002000:00010000:1.0:1788572335.913955:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.913962:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b833506d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.913972:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fe:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.913976:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.913981:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b833506d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.913993:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b833506d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.914001:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b833506d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.914034:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b833506d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.914062:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.914152:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.914163:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935873 00010000:00080000:1.0:1788572335.914166:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935873 00010000:00010000:3.0:1788572335.914228:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.914233:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b833506d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.914241:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.914245:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b833506d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.914252:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b833506d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.914264:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b833506d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.914271:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b833506d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.914286:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.914301:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.914303:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572335.914432:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc45c00 x1875449639051904/t8589935872(8589935872) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.914441:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.914443:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.914448:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.914455:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935872 00000100:00080000:2.0:1788572335.914470:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6184d5880 x1875449639052416/t8589935873(8589935873) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.914479:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639051904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.914491:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639052416:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.914522:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.914607:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639052416 00000100:00100000:0.0:1788572335.914612:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639052416 00000100:00100000:0.0:1788572335.914647:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:0.0:1788572335.914654:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+101:3649:x1875449639052416:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.914661:0:43975:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935873, current: 8589935873, replaying 00000100:00100000:0.0:1788572335.914667:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+101:3649:x1875449639052416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15us (146us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.914674:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00010000:00080000:1.0:1788572335.914865:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935873, next_transno: 8589935873 00010000:00080000:1.0:1788572335.914869:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935873) 00010000:00080000:1.0:1788572335.914875:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639052416 t8589935873 from 0@lo req@ffff94e63c5d1c50 x1875449639052416/t0(8589935873) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.914900:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2562 count 1 00002000:00010000:1.0:1788572335.914966:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.914972:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335074 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.914983:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa02:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.914986:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa02:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.914991:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.915027:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.915036:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.915053:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335074 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.915069:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.915159:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.915236:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935874 00010000:00080000:1.0:1788572335.915241:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935874 00000100:00080000:0.0:1788572335.915583:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6184d5880 x1875449639052416/t8589935873(8589935873) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.915593:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.915596:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.915599:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.915606:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935873 00000100:00080000:0.0:1788572335.915620:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6412b2680 x1875449639054080/t8589935874(8589935874) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.915628:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639052416:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.915640:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054080:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.915672:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572335.915790:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.915797:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335074 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.915805:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.915809:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335074 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.915819:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335074 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.915834:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335074 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.915841:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335074 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.915856:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.915858:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.915860:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572335.915900:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639054080 00000100:00100000:1.0:1788572335.915905:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639054080 00000100:00100000:1.0:1788572335.915975:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:1.0:1788572335.915984:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+102:3649:x1875449639054080:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.915993:0:43976:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935874, current: 8589935874, replaying 00000100:00100000:1.0:1788572335.916329:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+102:3649:x1875449639054080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 338us (648us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.916340:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00010000:00080000:3.0:1788572335.916393:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935874, next_transno: 8589935874 00010000:00080000:3.0:1788572335.916396:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935874) 00010000:00080000:3.0:1788572335.916403:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639054080 t8589935874 from 0@lo req@ffff94e62d289180 x1875449639054080/t0(8589935874) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.916433:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2566 count 1 00002000:00010000:3.0:1788572335.916532:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.916539:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833507b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa06:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.916551:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa06:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.916554:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa06:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.916560:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833507b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.916574:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833507b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.916583:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833507b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.916590:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833507b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.916604:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.916727:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.916748:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935875 00010000:00080000:3.0:1788572335.916752:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935875 00010000:00010000:0.0:1788572335.916811:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.916816:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833507b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.916824:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.916828:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833507b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.916836:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833507b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.916851:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833507b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.916859:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833507b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.916881:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.916883:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.916885:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572335.916914:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6412b2680 x1875449639054080/t8589935874(8589935874) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.916923:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.916925:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.916930:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.916936:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935874 00000100:00080000:0.0:1788572335.916952:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63778dc00 x1875449639054592/t8589935875(8589935875) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.916961:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054080:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.916973:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054592:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.917000:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.922703:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639054592 00000100:00100000:2.0:1788572335.922716:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639054592 00000100:00100000:2.0:1788572335.922776:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:2.0:1788572335.922786:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+103:3649:x1875449639054592:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.922799:0:43968:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935875, current: 8589935875, replaying 00000100:00100000:2.0:1788572335.922812:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+103:3649:x1875449639054592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29us (5811us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.922818:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00010000:00080000:2.0:1788572335.923224:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935875, next_transno: 8589935875 00010000:00080000:2.0:1788572335.923229:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935875) 00010000:00080000:2.0:1788572335.923238:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639054592 t8589935875 from 0@lo req@ffff94e62d289c00 x1875449639054592/t0(8589935875) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.923276:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2570 count 1 00002000:00010000:2.0:1788572335.923795:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.923805:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335082 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa0a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.923821:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0a:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.923826:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.923833:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.923851:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.923861:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.923869:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.923897:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572335.924266:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.924273:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.924281:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1cc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.924285:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.924308:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335082 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.924780:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335082 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.924790:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335082 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.924810:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.924812:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.924814:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788572335.928535:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.928574:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935876 00010000:00080000:2.0:1788572335.928581:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935876 00000100:00080000:0.0:1788572335.928707:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63778dc00 x1875449639054592/t8589935875(8589935875) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.928721:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.928724:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.928731:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.928739:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935875 00000100:00080000:0.0:1788572335.928767:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63778ed80 x1875449639054464/t8589935876(8589935876) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.928786:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054592:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.928808:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.928867:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.933113:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639054464 00000100:00100000:2.0:1788572335.933126:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639054464 00000100:00100000:2.0:1788572335.933173:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:2.0:1788572335.933183:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+104:3649:x1875449639054464:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.933196:0:43970:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935876, current: 8589935876, replaying 00000100:00100000:2.0:1788572335.933207:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+104:3649:x1875449639054464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27us (4340us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.933214:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00010000:00080000:2.0:1788572335.933233:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935876, next_transno: 8589935876 00010000:00080000:2.0:1788572335.933236:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935876) 00010000:00080000:2.0:1788572335.933245:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639054464 t8589935876 from 0@lo req@ffff94e62d28a300 x1875449639054464/t0(8589935876) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.933280:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2569 count 1 00002000:00010000:2.0:1788572335.933508:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.933517:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b8335089 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa09:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.933534:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa09:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.933539:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa09:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.933545:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b8335089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.933559:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b8335089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.933570:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b8335089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.933579:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b8335089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.933602:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.933750:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.933764:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935877 00010000:00080000:2.0:1788572335.933768:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935877 00010000:00010000:1.0:1788572335.933810:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.933818:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b8335089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.933825:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1d400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.933831:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b8335089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.933840:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b8335089 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.933860:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b8335089 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.933868:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b8335089 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.933888:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.933890:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.933891:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572335.940441:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63778ed80 x1875449639054464/t8589935876(8589935876) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.940456:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.940459:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.940466:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.940474:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935876 00000100:00080000:0.0:1788572335.940498:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc8ea00 x1875449639055616/t8589935877(8589935877) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.940510:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.940532:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639055616:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.940600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.940873:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639055616 00000100:00100000:2.0:1788572335.940881:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639055616 00000100:00100000:2.0:1788572335.940943:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:2.0:1788572335.940952:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+105:3649:x1875449639055616:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.940965:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935877, current: 8589935877, replaying 00000100:00100000:2.0:1788572335.940976:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+105:3649:x1875449639055616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26us (378us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.940982:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00010000:00080000:2.0:1788572335.940998:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935877, next_transno: 8589935877 00010000:00080000:2.0:1788572335.941022:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935877) 00010000:00080000:2.0:1788572335.941030:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639055616 t8589935877 from 0@lo req@ffff94e62d289f80 x1875449639055616/t0(8589935877) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.941079:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2574 count 1 00002000:00010000:2.0:1788572335.941203:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.941213:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335090 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa0e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.941231:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0e:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.941236:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.941242:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.941259:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.941275:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.941283:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.941743:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572335.941906:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.941924:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935878 00010000:00080000:2.0:1788572335.941929:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935878 00010000:00010000:3.0:1788572335.942512:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.942522:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.942531:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1da00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.942536:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.942546:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335090 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.942564:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335090 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.942572:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335090 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.942592:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.942594:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.942595:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572335.943117:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc8ea00 x1875449639055616/t8589935877(8589935877) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.943127:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.943130:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.943134:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.943142:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935877 00000100:00080000:0.0:1788572335.943163:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6412b3800 x1875449639053824/t8589935878(8589935878) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.943174:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639055616:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.943191:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639053824:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.943234:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.944609:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639053824 00000100:00100000:2.0:1788572335.944622:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639053824 00000100:00100000:2.0:1788572335.944682:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:2.0:1788572335.944691:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+106:3649:x1875449639053824:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.944705:0:43966:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935878, current: 8589935878, replaying 00000100:00100000:2.0:1788572335.944720:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+106:3649:x1875449639053824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30us (1485us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.944728:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00010000:00080000:2.0:1788572335.944744:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935878, next_transno: 8589935878 00010000:00080000:2.0:1788572335.944748:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935878) 00010000:00080000:2.0:1788572335.944755:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639053824 t8589935878 from 0@lo req@ffff94e62d28b100 x1875449639053824/t0(8589935878) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572335.944789:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2565 count 1 00002000:00010000:2.0:1788572335.944913:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572335.944922:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335097 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa05:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.944937:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa05:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:2.0:1788572335.944942:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa05:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572335.944949:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.944962:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.944972:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.944979:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.944996:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572335.945025:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.945031:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.945039:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1c000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.945054:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.945063:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335097 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.945079:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335097 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.945086:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335097 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.945105:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.945107:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.945108:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788572335.945254:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572335.945269:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935879 00010000:00080000:2.0:1788572335.945273:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935879 00000100:00080000:0.0:1788572335.946156:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6412b3800 x1875449639053824/t8589935878(8589935878) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.946167:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.946169:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.946175:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.946183:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935878 00000100:00080000:0.0:1788572335.946205:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63778c000 x1875449639054336/t8589935879(8589935879) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.946215:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639053824:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.946235:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054336:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.946274:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.950189:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639054336 00000100:00100000:0.0:1788572335.950208:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639054336 00000100:00100000:0.0:1788572335.950282:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:0.0:1788572335.950294:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+107:3649:x1875449639054336:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.950307:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935879, current: 8589935879, replaying 00000100:00100000:0.0:1788572335.950328:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+107:3649:x1875449639054336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37us (4053us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.950334:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00010000:00080000:3.0:1788572335.951556:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935879, next_transno: 8589935879 00010000:00080000:3.0:1788572335.951564:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935879) 00010000:00080000:3.0:1788572335.951577:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639054336 t8589935879 from 0@lo req@ffff94e62d288a80 x1875449639054336/t0(8589935879) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.951628:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2568 count 1 00002000:00010000:3.0:1788572335.951755:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.951764:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b833509e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa08:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.951781:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa08:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.951785:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa08:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.951791:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b833509e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.951806:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b833509e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.951816:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b833509e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.951824:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b833509e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.951846:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.952027:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.952057:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935880 00010000:00080000:3.0:1788572335.952062:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935880 00010000:00010000:0.0:1788572335.952782:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.952792:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b833509e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.952803:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.952808:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b833509e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.952817:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b833509e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.952835:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b833509e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.952843:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b833509e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.952863:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.952865:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.952867:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572335.952916:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63778c000 x1875449639054336/t8589935879(8589935879) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.952926:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.952929:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.952936:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.952943:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935879 00000100:00080000:0.0:1788572335.952968:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc8ca80 x1875449639055360/t8589935880(8589935880) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.952981:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054336:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.953033:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639055360:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.953089:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.954181:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639055360 00000100:00100000:1.0:1788572335.954192:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639055360 00000100:00100000:1.0:1788572335.954248:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:1.0:1788572335.954259:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+108:3649:x1875449639055360:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.954271:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935880, current: 8589935880, replaying 00000100:00100000:1.0:1788572335.954282:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+108:3649:x1875449639055360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26us (1194us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.954289:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00010000:00080000:3.0:1788572335.954489:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935880, next_transno: 8589935880 00010000:00080000:3.0:1788572335.954494:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935880) 00010000:00080000:3.0:1788572335.954504:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639055360 t8589935880 from 0@lo req@ffff94e62d28b800 x1875449639055360/t0(8589935880) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 2 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.954542:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2572 count 1 00002000:00010000:3.0:1788572335.954659:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.954667:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83350a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa0c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.954680:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0c:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.954685:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.954692:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83350a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.954706:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83350a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.954717:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83350a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.954724:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83350a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.954743:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.954887:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.954896:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935881 00010000:00080000:3.0:1788572335.954900:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935881 00010000:00010000:1.0:1788572335.954962:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.954968:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83350a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.954981:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.954986:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83350a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.954995:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83350a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.955040:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83350a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.955059:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83350a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.955077:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.955079:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.955081:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572335.956572:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc8ca80 x1875449639055360/t8589935880(8589935880) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.956584:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572335.956588:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572335.956594:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572335.956601:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935880 00000100:00080000:0.0:1788572335.956624:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6412b0000 x1875449639053696/t8589935881(8589935881) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572335.956635:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639055360:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.956657:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639053696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572335.956710:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.957067:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639053696 00000100:00100000:1.0:1788572335.957075:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639053696 00000100:00100000:1.0:1788572335.957121:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:1.0:1788572335.957130:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+109:3649:x1875449639053696:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.957143:0:43964:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935881, current: 8589935881, replaying 00000100:00100000:1.0:1788572335.957156:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+109:3649:x1875449639053696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28us (447us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.957163:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00010000:00080000:3.0:1788572335.957216:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935881, next_transno: 8589935881 00010000:00080000:3.0:1788572335.957220:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935881) 00010000:00080000:3.0:1788572335.957229:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639053696 t8589935881 from 0@lo req@ffff94e62d288e00 x1875449639053696/t0(8589935881) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.957266:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2564 count 1 00002000:00010000:3.0:1788572335.957405:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.957412:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83350ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa04:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.957426:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa04:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.957430:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa04:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.957436:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83350ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.957448:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83350ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.957457:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83350ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.957465:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83350ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.957487:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.957617:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.957638:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935882 00010000:00080000:3.0:1788572335.957642:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935882 00010000:00010000:1.0:1788572335.959160:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.959177:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83350ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.959191:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.959197:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83350ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.959208:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83350ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.959228:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83350ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.959236:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83350ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.959263:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.959265:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.959267:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572335.960109:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6412b0000 x1875449639053696/t8589935881(8589935881) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.960119:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.960122:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.960126:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.960133:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935881 00000100:00080000:1.0:1788572335.960156:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63aeb2a00 x1875449639056512/t8589935882(8589935882) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.960167:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639053696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.960188:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639056512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.960252:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.961950:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639056512 00000100:00100000:3.0:1788572335.961962:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639056512 00000100:00100000:3.0:1788572335.962040:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:3.0:1788572335.962060:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+110:3649:x1875449639056512:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.962073:0:43974:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935882, current: 8589935882, replaying 00000100:00100000:3.0:1788572335.962086:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+110:3649:x1875449639056512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30us (1835us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.962092:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00010000:00080000:3.0:1788572335.962108:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935882, next_transno: 8589935882 00010000:00080000:3.0:1788572335.962111:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935882) 00010000:00080000:3.0:1788572335.962120:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639056512 t8589935882 from 0@lo req@ffff94e63ae3ce00 x1875449639056512/t0(8589935882) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.962155:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2576 count 1 00002000:00010000:3.0:1788572335.962275:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.962283:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.962300:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa10:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.962305:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.962311:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.962343:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.962354:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.962362:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.962380:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.962541:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.962557:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935883 00010000:00080000:3.0:1788572335.962561:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935883 00010000:00010000:3.0:1788572335.962574:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.962580:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.962588:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.962593:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.962602:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.962620:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.962628:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.962648:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.962650:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.962651:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572335.962959:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63aeb2a00 x1875449639056512/t8589935882(8589935882) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.962969:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.962971:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.962976:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.962982:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935882 00000100:00080000:1.0:1788572335.963028:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6412b2d80 x1875449639054208/t8589935883(8589935883) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.963039:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639056512:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.963066:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054208:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.963101:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.964311:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639054208 00000100:00100000:3.0:1788572335.964336:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639054208 00000100:00100000:3.0:1788572335.964396:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:3.0:1788572335.964406:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+111:3649:x1875449639054208:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.964417:0:43968:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935883, current: 8589935883, replaying 00000100:00100000:3.0:1788572335.964428:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+111:3649:x1875449639054208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25us (1327us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.964434:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00010000:00080000:3.0:1788572335.964455:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935883, next_transno: 8589935883 00010000:00080000:3.0:1788572335.964460:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935883) 00010000:00080000:3.0:1788572335.964467:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639054208 t8589935883 from 0@lo req@ffff94e63ae3ea00 x1875449639054208/t0(8589935883) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.964498:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2567 count 1 00002000:00010000:3.0:1788572335.964604:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.964612:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa07:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.964625:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa07:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.964630:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa07:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.964636:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.964648:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.964658:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.964665:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.964687:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.964815:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.964830:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935884 00010000:00080000:3.0:1788572335.964834:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935884 00010000:00010000:3.0:1788572335.965132:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.965138:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.965147:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.965151:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.965160:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.965177:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.965184:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.965204:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.965205:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.965206:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572335.965318:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6412b2d80 x1875449639054208/t8589935883(8589935883) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.965336:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.965339:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.965344:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.965351:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935883 00000100:00080000:1.0:1788572335.965373:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63778f100 x1875449639054720/t8589935884(8589935884) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.965383:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054208:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.965399:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63778f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.965432:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.965646:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639054720 00000100:00100000:3.0:1788572335.965651:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639054720 00000100:00100000:3.0:1788572335.965691:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:3.0:1788572335.965700:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+112:3649:x1875449639054720:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.965710:0:43976:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935884, current: 8589935884, replaying 00000100:00100000:3.0:1788572335.965720:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+112:3649:x1875449639054720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22us (288us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.965726:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00010000:00080000:3.0:1788572335.965741:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935884, next_transno: 8589935884 00010000:00080000:3.0:1788572335.965743:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935884) 00010000:00080000:3.0:1788572335.965749:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639054720 t8589935884 from 0@lo req@ffff94e5038c1180 x1875449639054720/t0(8589935884) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.965772:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2571 count 1 00002000:00010000:3.0:1788572335.965845:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.965852:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83350c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa0b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.965862:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0b:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.965865:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.965871:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83350c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.965882:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83350c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.965890:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83350c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.965897:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83350c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.965920:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.966029:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.966042:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935885 00010000:00080000:3.0:1788572335.966056:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935885 00000100:00080000:1.0:1788572335.967173:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63778f100 x1875449639054720/t8589935884(8589935884) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.967183:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.967186:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.967191:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.967198:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935884 00000100:00080000:1.0:1788572335.967217:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e618490380 x1875449639056256/t8589935885(8589935885) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.967226:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63778f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639054720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.967244:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639056256:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.967286:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.967713:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639056256 00000100:00100000:3.0:1788572335.967721:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639056256 00000100:00100000:3.0:1788572335.967769:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:3.0:1788572335.967777:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+113:3649:x1875449639056256:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.967788:0:43970:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935885, current: 8589935885, replaying 00000100:00100000:3.0:1788572335.967799:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+113:3649:x1875449639056256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24us (513us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.967805:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00010000:00080000:3.0:1788572335.967822:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935885, next_transno: 8589935885 00010000:00080000:3.0:1788572335.967826:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935885) 00010000:00080000:3.0:1788572335.967833:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639056256 t8589935885 from 0@lo req@ffff94e5038c3800 x1875449639056256/t0(8589935885) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.967866:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2575 count 1 00002000:00010000:3.0:1788572335.967966:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.967974:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83350c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa0f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.967988:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0f:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:3.0:1788572335.967992:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.967998:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83350c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.968040:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83350c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.968061:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83350c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.968070:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83350c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.968088:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00080000:3.0:1788572335.968201:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.968215:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935886 00010000:00080000:3.0:1788572335.968218:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935886 00010000:00010000:1.0:1788572335.968966:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572335.968975:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83350c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.968985:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.968990:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83350c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.969000:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83350c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.969039:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83350c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.969059:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83350c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.969082:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.969085:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83350c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.969092:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.969095:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83350c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.969103:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83350c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.969113:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83350c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.969120:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83350c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.969133:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.969135:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.969137:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572335.969241:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e618490380 x1875449639056256/t8589935885(8589935885) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.969250:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.969253:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.969257:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.969264:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935885 00000100:00080000:1.0:1788572335.969287:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e618432a00 x1875449639057024/t8589935886(8589935886) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.969309:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639056256:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.970410:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639057024:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.970475:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.970598:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639057024 00000100:00100000:2.0:1788572335.970607:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639057024 00000100:00100000:2.0:1788572335.970663:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:2.0:1788572335.970673:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+114:3649:x1875449639057024:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.970685:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935886, current: 8589935886, replaying 00000100:00100000:2.0:1788572335.970703:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+114:3649:x1875449639057024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32us (228us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.970711:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00010000:00010000:0.0:1788572335.970828:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.971528:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935886, next_transno: 8589935886 00010000:00080000:1.0:1788572335.971534:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935886) 00010000:00080000:1.0:1788572335.971545:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639057024 t8589935886 from 0@lo req@ffff94e5038c0a80 x1875449639057024/t0(8589935886) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.971594:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2578 count 1 00002000:00010000:1.0:1788572335.971707:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.971715:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83350cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.971731:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa12:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.971736:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.971742:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83350cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.971760:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83350cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.971771:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83350cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.971779:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83350cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.971795:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.971925:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.971941:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935887 00010000:00080000:1.0:1788572335.971945:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935887 00010000:00010000:1.0:1788572335.971956:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.971962:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83350cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.971971:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.971975:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83350cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.971984:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83350cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.972000:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83350cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.972026:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83350cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.972055:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.972057:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.972059:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572335.972096:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e618432a00 x1875449639057024/t8589935886(8589935886) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.972106:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.972109:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.972114:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.972120:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935886 00000100:00080000:1.0:1788572335.972144:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63aeb3480 x1875449639056896/t8589935887(8589935887) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.972154:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639057024:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.972169:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639056896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.972198:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572335.972298:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639056896 00000100:00100000:2.0:1788572335.972306:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639056896 00000100:00100000:2.0:1788572335.978221:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:2.0:1788572335.978242:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+115:3649:x1875449639056896:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572335.978255:0:43966:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935887, current: 8589935887, replaying 00000100:00100000:2.0:1788572335.978267:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+115:3649:x1875449639056896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35us (6069us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572335.978273:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00010000:00080000:1.0:1788572335.978795:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935887, next_transno: 8589935887 00010000:00080000:1.0:1788572335.978801:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935887) 00010000:00080000:1.0:1788572335.978813:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639056896 t8589935887 from 0@lo req@ffff94e5038c3480 x1875449639056896/t0(8589935887) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.978858:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2577 count 1 00002000:00010000:1.0:1788572335.978982:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.978992:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83350d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.979035:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa11:0x0].0x0 since=4252s v=(0 0) 00010000:00010000:1.0:1788572335.979041:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.979057:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83350d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.979073:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83350d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.979084:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83350d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.979092:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83350d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.979113:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572335.979276:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.979292:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935888 00010000:00080000:1.0:1788572335.979296:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935888 00000100:00080000:1.0:1788572335.979339:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63aeb3480 x1875449639056896/t8589935887(8589935887) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.979348:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.979350:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.979355:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.979367:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935887 00000100:00080000:1.0:1788572335.979390:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6184ed880 x1875449639059200/t8589935888(8589935888) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.979400:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639056896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.979416:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639059200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.979448:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.980140:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639059200 00000100:00100000:0.0:1788572335.980148:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639059200 00000100:00100000:0.0:1788572335.980187:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:0.0:1788572335.980195:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+116:3649:x1875449639059200:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.980205:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935888, current: 8589935888, replaying 00000100:00100000:0.0:1788572335.980213:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+116:3649:x1875449639059200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20us (766us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.980220:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00010000:00080000:1.0:1788572335.981907:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935888, next_transno: 8589935888 00010000:00080000:1.0:1788572335.981917:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935888) 00010000:00080000:1.0:1788572335.981929:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639059200 t8589935888 from 0@lo req@ffff94e637798380 x1875449639059200/t0(8589935888) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572335.981978:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2583 count 1 00002000:00010000:1.0:1788572335.982135:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572335.982143:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83350dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.982158:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa17:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572335.982163:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572335.982169:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83350dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.982184:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83350dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.982195:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83350dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.982208:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83350dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.982225:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788572335.982455:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572335.982464:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83350d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.982472:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.982477:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83350d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.982488:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83350d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.982505:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83350d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.982512:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83350d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.982534:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572335.982537:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83350dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.982543:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572335.982546:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83350dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.982553:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83350dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.982561:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83350dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.982568:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83350dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.982579:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.982581:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.982583:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572335.982590:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572335.982728:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572335.982749:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935889 00010000:00080000:1.0:1788572335.982754:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935889 00000100:00080000:1.0:1788572335.982804:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6184ed880 x1875449639059200/t8589935888(8589935888) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.982814:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572335.982817:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572335.982824:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572335.982832:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935888 00000100:00080000:1.0:1788572335.982861:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6184efb80 x1875449639059072/t8589935889(8589935889) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572335.982873:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639059200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.982892:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639059072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572335.982925:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.987442:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639059072 00000100:00100000:3.0:1788572335.987460:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639059072 00000100:00100000:3.0:1788572335.987545:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:3.0:1788572335.987557:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+117:3649:x1875449639059072:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.987572:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935889, current: 8589935889, replaying 00000100:00100000:3.0:1788572335.987597:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+117:3649:x1875449639059072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43us (4672us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.987608:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00010000:00080000:0.0:1788572335.987709:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935889, next_transno: 8589935889 00010000:00080000:0.0:1788572335.987714:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935889) 00010000:00080000:0.0:1788572335.987725:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639059072 t8589935889 from 0@lo req@ffff94e637798700 x1875449639059072/t0(8589935889) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.987767:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2582 count 1 00002000:00010000:0.0:1788572335.987893:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.987902:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b83350e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.987921:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa16:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572335.987926:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.987933:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b83350e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.987952:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b83350e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.987965:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b83350e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.987973:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b83350e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.987995:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.988217:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.988235:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935890 00010000:00080000:0.0:1788572335.988239:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935890 00010000:00010000:0.0:1788572335.988254:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572335.988261:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b83350e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.988270:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572335.988275:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b83350e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.988285:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b83350e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.988318:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b83350e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.988326:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b83350e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.988345:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.988346:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572335.988348:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572335.988560:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6184efb80 x1875449639059072/t8589935889(8589935889) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.988571:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.988574:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.988580:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.988588:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935889 00000100:00080000:3.0:1788572335.988619:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e60fc8c700 x1875449639055488/t8589935890(8589935890) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.988631:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639059072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.988652:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639055488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.988688:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572335.988764:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639055488 00000100:00100000:1.0:1788572335.988769:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639055488 00000100:00100000:1.0:1788572335.988807:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:1.0:1788572335.988815:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+118:3649:x1875449639055488:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572335.988823:0:43964:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935890, current: 8589935890, replaying 00000100:00100000:1.0:1788572335.988841:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+118:3649:x1875449639055488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27us (152us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572335.988847:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00010000:00080000:3.0:1788572335.990509:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935890, next_transno: 8589935890 00010000:00080000:3.0:1788572335.990517:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935890) 00010000:00080000:3.0:1788572335.990530:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639055488 t8589935890 from 0@lo req@ffff94e6412c2a00 x1875449639055488/t0(8589935890) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.990576:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2573 count 1 00002000:00010000:3.0:1788572335.990680:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.990687:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa0d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.990701:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0d:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572335.990705:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa0d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.990712:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.990726:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.990736:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.990745:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.990772:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572335.990926:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.990945:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935891 00010000:00080000:3.0:1788572335.990950:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935891 00000100:00080000:3.0:1788572335.990994:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e60fc8c700 x1875449639055488/t8589935890(8589935890) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.991030:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.991034:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.991040:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.991058:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935890 00000100:00080000:3.0:1788572335.991086:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e618433b80 x1875449639057152/t8589935891(8589935891) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.991097:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639055488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.991116:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639057152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.991149:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572335.991178:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639057152 00000100:00100000:3.0:1788572335.991184:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639057152 00000100:00100000:3.0:1788572335.991226:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:3.0:1788572335.991235:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+119:3649:x1875449639057152:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572335.991244:0:43974:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935891, current: 8589935891, replaying 00000100:00100000:3.0:1788572335.991254:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+119:3649:x1875449639057152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21us (105us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572335.991261:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00010000:00080000:3.0:1788572335.991273:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935891, next_transno: 8589935891 00010000:00080000:3.0:1788572335.991276:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935891) 00010000:00080000:3.0:1788572335.991281:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639057152 t8589935891 from 0@lo req@ffff94e6412c1c00 x1875449639057152/t0(8589935891) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572335.992450:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2579 count 1 00002000:00010000:3.0:1788572335.992559:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572335.992567:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.992582:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa13:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572335.992587:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572335.992593:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.992605:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.992614:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.992622:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572335.992646:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00080000:3.0:1788572335.992771:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572335.992791:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935892 00010000:00080000:3.0:1788572335.992795:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935892 00000100:00080000:3.0:1788572335.992844:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e618433b80 x1875449639057152/t8589935891(8589935891) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.992853:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572335.992856:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572335.992861:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572335.992869:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935891 00000100:00080000:3.0:1788572335.992893:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e634beaa00 x1875449639061120/t8589935892(8589935892) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572335.992903:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639057152:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.992917:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639061120:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572335.992946:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572335.993611:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572335.993620:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.993630:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.993635:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.993646:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.993666:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.993674:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83350eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.993697:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572335.993701:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.993707:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572335.993710:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.993721:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.993730:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.993737:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83350f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572335.993751:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.993753:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572335.993754:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572335.993836:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639061120 00000100:00100000:0.0:1788572335.993843:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639061120 00000100:00100000:0.0:1788572335.993887:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:0.0:1788572335.993896:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+120:3649:x1875449639061120:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.993907:0:43968:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935892, current: 8589935892, replaying 00000100:00100000:0.0:1788572335.993925:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+120:3649:x1875449639061120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30us (979us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.993933:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00010000:00010000:1.0:1788572335.994093:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572335.994273:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935892, next_transno: 8589935892 00010000:00080000:0.0:1788572335.994278:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935892) 00010000:00080000:0.0:1788572335.994286:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639061120 t8589935892 from 0@lo req@ffff94e6412c1f80 x1875449639061120/t0(8589935892) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.994493:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2588 count 1 00002000:00010000:0.0:1788572335.994598:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.994604:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b83350f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.994616:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1c:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572335.994619:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.994625:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b83350f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.994637:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b83350f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.994646:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b83350f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.994653:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b83350f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.994785:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572335.994933:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572335.994948:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935893 00010000:00080000:0.0:1788572335.994951:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935893 00000100:00080000:2.0:1788572335.996207:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e634beaa00 x1875449639061120/t8589935892(8589935892) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.996218:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572335.996221:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572335.996227:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572335.996235:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935892 00000100:00080000:2.0:1788572335.996263:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62dac4a80 x1875449639061248/t8589935893(8589935893) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572335.996274:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639061120:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.996305:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639061248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572335.996351:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572335.996494:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639061248 00000100:00100000:0.0:1788572335.996501:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639061248 00000100:00100000:0.0:1788572335.996553:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:0.0:1788572335.996561:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+121:3649:x1875449639061248:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572335.996573:0:43976:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935893, current: 8589935893, replaying 00000100:00100000:0.0:1788572335.996586:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+121:3649:x1875449639061248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27us (236us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572335.996592:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00010000:00080000:0.0:1788572335.996606:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935893, next_transno: 8589935893 00010000:00080000:0.0:1788572335.996610:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935893) 00010000:00080000:0.0:1788572335.996616:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639061248 t8589935893 from 0@lo req@ffff94e641196d80 x1875449639061248/t0(8589935893) o6->lustre-MDT0000-mdtlov_UUID@0@lo:751/0 lens 544/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572335.996708:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2589 count 1 00002000:00010000:0.0:1788572335.996808:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572335.996814:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335100 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.996829:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1d:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572335.996833:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572335.996838:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.996850:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.996865:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572335.996872:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335100 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.999852:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572335.999867:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b83350f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.999882:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.999887:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b83350f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.999898:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b83350f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.999919:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b83350f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.999926:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000378de9d7/0xdb7edb52b83350f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.999951:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572335.999955:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335100 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.999961:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572335.999964:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335100 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.999972:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.999980:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335100 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572335.999986:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.999988:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572335.999990:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.001251:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788572336.001264:0:114791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335100 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788572336.001506:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.001529:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935894 00010000:00080000:0.0:1788572336.001534:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935894 00010000:00010000:1.0:1788572336.001878:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572336.011274:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62dac4a80 x1875449639061248/t8589935893(8589935893) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.011289:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.011301:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.011307:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.011315:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935893 00000100:00080000:1.0:1788572336.011343:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62dac4380 x1875449639061760/t8589935894(8589935894) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.011354:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639061248:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.011377:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639061760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.011435:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.011661:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639061760 00000100:00100000:3.0:1788572336.011669:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639061760 00000100:00100000:3.0:1788572336.011775:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:3.0:1788572336.011787:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+122:3649:x1875449639061760:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.011800:0:43970:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935894, current: 8589935894, replaying 00000100:00100000:3.0:1788572336.011821:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+122:3649:x1875449639061760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36us (385us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.011828:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00010000:00080000:1.0:1788572336.013273:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935894, next_transno: 8589935894 00010000:00080000:1.0:1788572336.013283:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935894) 00010000:00080000:1.0:1788572336.013308:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639061760 t8589935894 from 0@lo req@ffff94e63779b800 x1875449639061760/t0(8589935894) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572336.013357:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2590 count 1 00002000:00010000:1.0:1788572336.013460:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.013469:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335107 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.013486:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1e:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.013491:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.013498:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.013514:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.013526:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.013533:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335107 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.013558:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572336.013693:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572336.013711:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935895 00010000:00080000:1.0:1788572336.013715:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935895 00000100:00080000:1.0:1788572336.013756:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62dac4380 x1875449639061760/t8589935894(8589935894) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572336.013896:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.013903:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335107 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.013911:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.013915:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335107 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.013924:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335107 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.013940:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335107 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.013947:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335107 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.013965:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.013966:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.013967:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572336.014241:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.014244:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.014250:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.014258:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935894 00000100:00080000:1.0:1788572336.014286:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6184eed80 x1875449639059328/t8589935895(8589935895) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.014308:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639061760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.014507:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639059328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.014555:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.028716:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639059328 00000100:00100000:2.0:1788572336.028743:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639059328 00000100:00100000:2.0:1788572336.028827:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:2.0:1788572336.028839:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+123:3649:x1875449639059328:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572336.028855:0:12091:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935895, current: 8589935895, replaying 00000100:00100000:2.0:1788572336.028867:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+123:3649:x1875449639059328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31us (14312us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572336.028874:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00010000:00080000:1.0:1788572336.029306:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935895, next_transno: 8589935895 00010000:00080000:1.0:1788572336.029311:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935895) 00010000:00080000:1.0:1788572336.029330:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639059328 t8589935895 from 0@lo req@ffff94e63779aa00 x1875449639059328/t0(8589935895) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572336.029368:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2584 count 1 00002000:00010000:1.0:1788572336.029701:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.029710:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b833510e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.029725:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa18:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.029729:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.029736:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b833510e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.029751:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b833510e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.029761:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b833510e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.029780:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b833510e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.029797:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572336.029963:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572336.029979:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935896 00010000:00080000:1.0:1788572336.029983:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935896 00000100:00080000:1.0:1788572336.030104:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6184eed80 x1875449639059328/t8589935895(8589935895) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.030113:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.030116:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.030121:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.030129:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935895 00000100:00080000:1.0:1788572336.030417:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e61e637b80 x1875449639060352/t8589935896(8589935896) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.030431:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639059328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.030512:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639060352:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.030550:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572336.030808:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572336.030817:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b833510e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.030827:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572336.030831:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b833510e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.030840:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b833510e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.030859:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b833510e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.030866:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b833510e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.030886:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.030888:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.030890:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572336.031375:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639060352 00000100:00100000:2.0:1788572336.031384:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639060352 00000100:00100000:2.0:1788572336.031432:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:2.0:1788572336.031441:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+124:3649:x1875449639060352:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572336.031880:0:43967:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935896, current: 8589935896, replaying 00000100:00100000:2.0:1788572336.031894:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+124:3649:x1875449639060352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 454us (1344us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572336.031901:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00010000:00080000:1.0:1788572336.033999:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935896, next_transno: 8589935896 00010000:00080000:1.0:1788572336.034034:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935896) 00010000:00080000:1.0:1788572336.034060:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639060352 t8589935896 from 0@lo req@ffff94e63779a680 x1875449639060352/t0(8589935896) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572336.034107:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2586 count 1 00002000:00010000:1.0:1788572336.034524:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.034533:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8335115 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.034548:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1a:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.034552:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.034559:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8335115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.034574:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8335115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.034585:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8335115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.034593:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8335115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.034621:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572336.034916:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.034923:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8335115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.034933:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.034938:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8335115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.034948:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8335115 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.034965:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8335115 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.034974:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b8335115 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.034996:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.034998:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.035000:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572336.035093:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572336.035111:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935897 00010000:00080000:1.0:1788572336.035115:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935897 00000100:00080000:1.0:1788572336.035290:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e61e637b80 x1875449639060352/t8589935896(8589935896) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.035311:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.035314:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.035386:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.035394:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935896 00000100:00080000:1.0:1788572336.035424:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6184ee300 x1875449639058944/t8589935897(8589935897) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.035437:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639060352:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.035522:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639058944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.035566:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.037895:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639058944 00000100:00100000:0.0:1788572336.037909:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639058944 00000100:00100000:0.0:1788572336.037961:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:0.0:1788572336.037972:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+125:3649:x1875449639058944:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.037997:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935897, current: 8589935897, replaying 00000100:00100000:0.0:1788572336.038021:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+125:3649:x1875449639058944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52us (2456us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.038027:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00010000:00080000:1.0:1788572336.038188:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935897, next_transno: 8589935897 00010000:00080000:1.0:1788572336.038192:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935897) 00010000:00080000:1.0:1788572336.038203:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639058944 t8589935897 from 0@lo req@ffff94e637798000 x1875449639058944/t0(8589935897) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572336.038241:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2581 count 1 00002000:00010000:1.0:1788572336.038596:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.038608:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b833511c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.038626:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa15:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.038631:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.038638:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b833511c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.038653:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b833511c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.038665:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b833511c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.038673:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b833511c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.038701:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572336.038890:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572336.038907:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935898 00010000:00080000:1.0:1788572336.038911:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935898 00000100:00080000:1.0:1788572336.038962:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6184ee300 x1875449639058944/t8589935897(8589935897) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.038971:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.038974:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.038979:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.038986:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935897 00000100:00080000:1.0:1788572336.039044:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62dac7b80 x1875449639062272/t8589935898(8589935898) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.039068:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639058944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.039086:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062272:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.039124:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.039567:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639062272 00000100:00100000:3.0:1788572336.039574:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639062272 00000100:00100000:3.0:1788572336.039606:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:3.0:1788572336.039614:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+126:3649:x1875449639062272:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.039624:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935898, current: 8589935898, replaying 00000100:00100000:3.0:1788572336.039634:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+126:3649:x1875449639062272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22us (510us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.039640:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00010000:00010000:0.0:1788572336.040174:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.040184:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b833511c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.040195:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.040200:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b833511c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.040210:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b833511c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.040230:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b833511c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.040238:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b833511c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.040260:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.040263:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.040265:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572336.040875:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935898, next_transno: 8589935898 00010000:00080000:1.0:1788572336.040883:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935898) 00010000:00080000:1.0:1788572336.040893:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639062272 t8589935898 from 0@lo req@ffff94e637798a80 x1875449639062272/t0(8589935898) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572336.040936:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2592 count 1 00002000:00010000:1.0:1788572336.041261:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.041269:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8335123 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.041285:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa20:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.041290:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.041378:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8335123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.041397:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8335123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.041408:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8335123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.041417:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8335123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.041526:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572336.041731:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572336.041751:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935899 00010000:00080000:1.0:1788572336.041755:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935899 00000100:00080000:1.0:1788572336.042270:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62dac7b80 x1875449639062272/t8589935898(8589935898) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.042281:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.042284:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.042289:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.042521:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935898 00000100:00080000:1.0:1788572336.042549:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e62dac4e00 x1875449639062144/t8589935899(8589935899) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.042560:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062272:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.042579:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062144:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.042622:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.042671:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639062144 00000100:00100000:1.0:1788572336.042678:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639062144 00000100:00100000:1.0:1788572336.042729:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:1.0:1788572336.042740:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+127:3649:x1875449639062144:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.042752:0:43964:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935899, current: 8589935899, replaying 00000100:00100000:1.0:1788572336.042763:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+127:3649:x1875449639062144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26us (142us total) trans 0 rc 0/-999 00010000:00010000:0.0:1788572336.043180:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.043189:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8335123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.043199:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.043203:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8335123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.043212:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8335123 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.043230:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8335123 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.043238:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b8335123 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.043260:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.043262:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.043263:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572336.043546:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00010000:00080000:1.0:1788572336.043568:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935899, next_transno: 8589935899 00010000:00080000:1.0:1788572336.043572:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935899) 00010000:00080000:1.0:1788572336.043580:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639062144 t8589935899 from 0@lo req@ffff94e637799f80 x1875449639062144/t0(8589935899) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572336.043620:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2591 count 1 00002000:00010000:1.0:1788572336.043730:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.043739:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b833512a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.043751:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1f:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.043756:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.043762:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b833512a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.044892:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b833512a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.044904:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b833512a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.044912:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b833512a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.045234:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572336.045434:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.045441:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b833512a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.045570:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.045575:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b833512a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.045584:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b833512a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.045608:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b833512a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.045616:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b833512a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.045638:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.045639:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.045641:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572336.047559:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.047586:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935900 00010000:00080000:0.0:1788572336.047590:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935900 00000100:00080000:1.0:1788572336.048082:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e62dac4e00 x1875449639062144/t8589935899(8589935899) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.048093:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.048096:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.048102:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.048109:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935899 00000100:00080000:1.0:1788572336.048145:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e618430e00 x1875449639058816/t8589935900(8589935900) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.048156:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062144:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.048175:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639058816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.048214:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.048463:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639058816 00000100:00100000:0.0:1788572336.048471:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639058816 00000100:00100000:0.0:1788572336.048518:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:0.0:1788572336.048527:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+128:3649:x1875449639058816:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.048539:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935900, current: 8589935900, replaying 00000100:00100000:0.0:1788572336.048556:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+128:3649:x1875449639058816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30us (342us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.048563:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00010000:00080000:1.0:1788572336.048660:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935900, next_transno: 8589935900 00010000:00080000:1.0:1788572336.048664:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935900) 00010000:00080000:1.0:1788572336.048670:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639058816 t8589935900 from 0@lo req@ffff94e637798e00 x1875449639058816/t0(8589935900) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572336.048707:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2580 count 1 00002000:00010000:1.0:1788572336.048832:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.048839:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335131 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.048855:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa14:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.048858:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.048864:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.048878:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.048889:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.048898:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.048921:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572336.049078:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572336.049090:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935901 00010000:00080000:1.0:1788572336.049094:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935901 00000100:00080000:1.0:1788572336.049122:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e618430e00 x1875449639058816/t8589935900(8589935900) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.049147:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.049150:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.049156:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.049162:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935900 00000100:00080000:1.0:1788572336.049182:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e6377c0380 x1875449639059456/t8589935901(8589935901) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.049192:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639058816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.049204:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639059456:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.049230:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.049589:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639059456 00000100:00100000:0.0:1788572336.049594:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639059456 00000100:00100000:0.0:1788572336.049635:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:0.0:1788572336.049643:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+129:3649:x1875449639059456:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.049651:0:43968:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935901, current: 8589935901, replaying 00000100:00100000:0.0:1788572336.049659:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+129:3649:x1875449639059456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19us (430us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.049666:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00010000:00010000:0.0:1788572336.049680:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.049686:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.049695:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.049698:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.049707:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335131 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.049725:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335131 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.049738:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b8335131 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.049760:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.049762:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.049828:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572336.049946:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935901, next_transno: 8589935901 00010000:00080000:1.0:1788572336.049950:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935901) 00010000:00080000:1.0:1788572336.049956:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639059456 t8589935901 from 0@lo req@ffff94e637799180 x1875449639059456/t0(8589935901) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572336.049994:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2585 count 1 00002000:00010000:1.0:1788572336.050259:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.050265:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8335138 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.050275:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa19:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.050279:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.050283:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8335138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.050366:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8335138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.050378:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8335138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.050386:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8335138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.050406:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572336.050606:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572336.050622:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935902 00010000:00080000:1.0:1788572336.050626:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935902 00000100:00080000:1.0:1788572336.050666:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e6377c0380 x1875449639059456/t8589935901(8589935901) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.050674:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.050677:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.050681:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.050688:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935901 00000100:00080000:1.0:1788572336.050709:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e61e636a00 x1875449639060480/t8589935902(8589935902) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.050718:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639059456:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.050731:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639060480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.050757:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.050874:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639060480 00000100:00100000:0.0:1788572336.050879:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639060480 00000100:00100000:0.0:1788572336.050909:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:0.0:1788572336.050916:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+130:3649:x1875449639060480:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.050923:0:43976:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935902, current: 8589935902, replaying 00000100:00100000:0.0:1788572336.050932:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+130:3649:x1875449639060480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17us (175us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.050938:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00010000:00010000:0.0:1788572336.050948:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.050954:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8335138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.050962:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.050966:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8335138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.050976:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8335138 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.051020:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8335138 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.051027:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b8335138 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.051044:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.051121:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.051123:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788572336.051382:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935902, next_transno: 8589935902 00010000:00080000:1.0:1788572336.051386:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935902) 00010000:00080000:1.0:1788572336.051392:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639060480 t8589935902 from 0@lo req@ffff94e63c5d3850 x1875449639060480/t0(8589935902) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572336.051419:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2587 count 1 00002000:00010000:1.0:1788572336.051501:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.051506:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b833513f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.051516:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1b:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.051520:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.051525:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b833513f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.051535:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b833513f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.051543:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b833513f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.051549:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b833513f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.051574:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572336.051656:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572336.051735:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935903 00010000:00080000:1.0:1788572336.051739:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935903 00000100:00080000:1.0:1788572336.051781:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e61e636a00 x1875449639060480/t8589935902(8589935902) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.051788:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.051791:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.051796:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.051802:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935902 00000100:00080000:1.0:1788572336.051821:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5032b7800 x1875449639062400/t8589935903(8589935903) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.051831:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639060480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.051842:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.051871:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.052313:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639062400 00000100:00100000:2.0:1788572336.052319:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639062400 00000100:00100000:2.0:1788572336.052375:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:2.0:1788572336.052383:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+131:3649:x1875449639062400:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572336.052392:0:43975:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935903, current: 8589935903, replaying 00000100:00100000:2.0:1788572336.052409:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+131:3649:x1875449639062400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28us (538us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572336.052415:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00010000:00080000:1.0:1788572336.052634:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935903, next_transno: 8589935903 00010000:00080000:1.0:1788572336.052638:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935903) 00010000:00080000:1.0:1788572336.052645:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639062400 t8589935903 from 0@lo req@ffff94e637798380 x1875449639062400/t0(8589935903) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572336.052674:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2593 count 1 00002000:00010000:1.0:1788572336.052751:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.052758:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335146 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.052782:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa21:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.052785:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.052790:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.052802:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.052811:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.052818:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335146 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.052831:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00080000:1.0:1788572336.052930:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572336.052943:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935904 00010000:00080000:1.0:1788572336.052946:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935904 00000100:00080000:1.0:1788572336.052978:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5032b7800 x1875449639062400/t8589935903(8589935903) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.052986:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.052989:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.052993:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.052999:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935903 00000100:00080000:1.0:1788572336.053038:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e64173f100 x1875449639062912/t8589935904(8589935904) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.053238:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.053255:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.053283:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572336.053591:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572336.053599:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b833513f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.053608:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.053612:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b833513f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.053622:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b833513f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.053638:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b833513f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.053645:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b833513f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.053668:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.053671:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335146 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.053677:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.053680:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335146 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.053688:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335146 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.053697:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335146 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.053704:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b8335146 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.053716:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.053717:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.053719:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.053726:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572336.053993:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639062912 00000100:00100000:3.0:1788572336.054000:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639062912 00000100:00100000:3.0:1788572336.054286:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:3.0:1788572336.054399:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+132:3649:x1875449639062912:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.054412:0:12091:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935904, current: 8589935904, replaying 00000100:00100000:3.0:1788572336.054430:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+132:3649:x1875449639062912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 137us (1147us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.054439:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00010000:00080000:0.0:1788572336.054525:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935904, next_transno: 8589935904 00010000:00080000:0.0:1788572336.054530:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935904) 00010000:00080000:0.0:1788572336.054538:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639062912 t8589935904 from 0@lo req@ffff94e637798700 x1875449639062912/t0(8589935904) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572336.054576:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2597 count 1 00002000:00010000:0.0:1788572336.054671:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.054677:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b833514d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.054689:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa25:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.054693:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.054699:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b833514d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.054711:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b833514d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.054719:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b833514d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.054727:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b833514d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.054746:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572336.054898:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.054911:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935905 00010000:00080000:0.0:1788572336.054915:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935905 00010000:00010000:0.0:1788572336.054926:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.054931:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b833514d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.054944:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.054948:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b833514d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.054956:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b833514d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.054969:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b833514d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.054977:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b833514d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.055023:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.055025:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.055027:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572336.055074:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e64173f100 x1875449639062912/t8589935904(8589935904) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572336.055083:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572336.055086:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572336.055091:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572336.055098:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935904 00000100:00080000:0.0:1788572336.055125:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5df80 x1875449639063424/t8589935905(8589935905) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572336.055454:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572336.055474:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572336.055514:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.055565:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639063424 00000100:00100000:0.0:1788572336.055571:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639063424 00000100:00100000:0.0:1788572336.055605:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:0.0:1788572336.055614:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+133:3649:x1875449639063424:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.055623:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935905, current: 8589935905, replaying 00000100:00100000:0.0:1788572336.055633:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+133:3649:x1875449639063424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21us (120us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.055638:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00010000:00080000:0.0:1788572336.055654:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935905, next_transno: 8589935905 00010000:00080000:0.0:1788572336.055657:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935905) 00010000:00080000:0.0:1788572336.055662:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639063424 t8589935905 from 0@lo req@ffff94e62d289880 x1875449639063424/t0(8589935905) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572336.055685:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2601 count 1 00002000:00010000:0.0:1788572336.055750:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.055756:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335154 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.055778:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa29:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.055781:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.055787:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.055803:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.055812:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.055820:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.055835:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572336.055915:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.055926:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935906 00010000:00080000:0.0:1788572336.055930:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935906 00010000:00010000:0.0:1788572336.055940:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.055944:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.055953:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.055956:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.055965:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335154 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.055979:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335154 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.056001:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b8335154 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.056042:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.056044:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.056059:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572336.056084:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5df80 x1875449639063424/t8589935905(8589935905) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572336.056091:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572336.056094:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572336.056098:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572336.056104:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935905 00000100:00080000:0.0:1788572336.056124:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5032b6300 x1875449639062528/t8589935906(8589935906) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572336.056132:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572336.056559:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572336.056593:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.056630:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639062528 00000100:00100000:0.0:1788572336.056635:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639062528 00000100:00100000:0.0:1788572336.056667:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:0.0:1788572336.056675:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+134:3649:x1875449639062528:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.056683:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935906, current: 8589935906, replaying 00000100:00100000:0.0:1788572336.056693:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+134:3649:x1875449639062528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20us (99us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.056700:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00010000:00080000:0.0:1788572336.056716:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935906, next_transno: 8589935906 00010000:00080000:0.0:1788572336.056719:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935906) 00010000:00080000:0.0:1788572336.056724:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639062528 t8589935906 from 0@lo req@ffff94e62d289500 x1875449639062528/t0(8589935906) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572336.056751:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2594 count 1 00002000:00010000:0.0:1788572336.057633:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.057645:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b833515b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.057658:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa22:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.057663:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.057669:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b833515b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.057683:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b833515b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.057694:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b833515b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.057703:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b833515b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.057724:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572336.059291:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.059870:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935907 00010000:00080000:0.0:1788572336.059877:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935907 00010000:00010000:0.0:1788572336.059898:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.059908:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b833515b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.059921:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.059926:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b833515b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.059938:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b833515b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.059960:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b833515b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.059967:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b833515b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788572336.060184:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5032b6300 x1875449639062528/t8589935906(8589935906) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.060195:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.060198:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.060204:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.060211:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935906 00000100:00080000:2.0:1788572336.060240:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e64173c700 x1875449639063040/t8589935907(8589935907) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.060251:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062528:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.060272:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063040:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.060562:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572336.060661:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.060664:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.060666:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572336.060729:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639063040 00000100:00100000:3.0:1788572336.060737:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639063040 00000100:00100000:3.0:1788572336.060898:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:3.0:1788572336.060909:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+135:3649:x1875449639063040:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.060921:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935907, current: 8589935907, replaying 00000100:00100000:3.0:1788572336.060937:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+135:3649:x1875449639063040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32us (376us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.060943:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00010000:00080000:0.0:1788572336.061576:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935907, next_transno: 8589935907 00010000:00080000:0.0:1788572336.061583:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935907) 00010000:00080000:0.0:1788572336.061590:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639063040 t8589935907 from 0@lo req@ffff94e641196d80 x1875449639063040/t0(8589935907) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572336.061630:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2598 count 1 00002000:00010000:0.0:1788572336.061735:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.061742:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8335162 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.061756:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa26:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.061759:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.061765:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8335162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.061791:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8335162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.061800:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8335162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.061807:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8335162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.061823:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572336.061951:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.061967:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935908 00010000:00080000:0.0:1788572336.061971:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935908 00010000:00010000:1.0:1788572336.062481:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.062489:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8335162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.062498:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.062502:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8335162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.062512:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8335162 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.062530:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8335162 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.062538:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8e030b0/0xdb7edb52b8335162 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.062562:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.062564:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.062565:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572336.062737:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e64173c700 x1875449639063040/t8589935907(8589935907) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.062747:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.062750:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.062756:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.062764:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935907 00000100:00080000:2.0:1788572336.062802:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5fb80 x1875449639063552/t8589935908(8589935908) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.062813:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063040:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.062831:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063552:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.062874:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.063253:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639063552 00000100:00100000:0.0:1788572336.063260:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639063552 00000100:00100000:0.0:1788572336.063468:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:0.0:1788572336.063478:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+136:3649:x1875449639063552:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.063490:0:43974:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935908, current: 8589935908, replaying 00000100:00100000:0.0:1788572336.063505:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+136:3649:x1875449639063552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30us (631us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.063511:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00010000:00080000:2.0:1788572336.063629:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935908, next_transno: 8589935908 00010000:00080000:2.0:1788572336.063634:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935908) 00010000:00080000:2.0:1788572336.063641:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639063552 t8589935908 from 0@lo req@ffff94e5032b5880 x1875449639063552/t0(8589935908) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.063675:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2602 count 1 00002000:00010000:2.0:1788572336.063782:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.063789:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335169 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.063802:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2a:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.063806:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.063813:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.063826:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.063835:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.063842:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.063864:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572336.064026:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572336.064042:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935909 00010000:00080000:2.0:1788572336.064060:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935909 00000100:00080000:2.0:1788572336.064093:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5fb80 x1875449639063552/t8589935908(8589935908) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.064102:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.064104:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.064110:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.064116:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935908 00000100:00080000:2.0:1788572336.064278:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5f480 x1875449639063936/t8589935909(8589935909) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.064289:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063552:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.064317:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063936:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.064349:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.066535:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639063936 00000100:00100000:0.0:1788572336.066551:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639063936 00000100:00100000:0.0:1788572336.066613:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:0.0:1788572336.066623:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+137:3649:x1875449639063936:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.066635:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935909, current: 8589935909, replaying 00000100:00100000:0.0:1788572336.066645:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+137:3649:x1875449639063936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25us (2296us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.066651:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00010000:00010000:0.0:1788572336.066666:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.066674:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.066686:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1c000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.066691:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.066702:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335169 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.066721:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335169 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.066728:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335169 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.066758:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.066760:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.066761:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788572336.066925:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935909, next_transno: 8589935909 00010000:00080000:2.0:1788572336.066929:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935909) 00010000:00080000:2.0:1788572336.066939:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639063936 t8589935909 from 0@lo req@ffff94e5032b4000 x1875449639063936/t0(8589935909) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.066975:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2605 count 1 00002000:00010000:2.0:1788572336.067119:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.067126:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b8335170 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.067147:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2d:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.067151:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.067158:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b8335170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.067170:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b8335170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.067180:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b8335170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.067188:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b8335170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.067205:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572336.067366:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572336.067380:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935910 00010000:00080000:2.0:1788572336.067384:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935910 00000100:00080000:2.0:1788572336.067427:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5f480 x1875449639063936/t8589935909(8589935909) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.067436:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.067439:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.067835:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.067845:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935909 00000100:00080000:2.0:1788572336.067880:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5f100 x1875449639064064/t8589935910(8589935910) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.067892:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063936:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.067911:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639064064:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.067945:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.068274:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639064064 00000100:00100000:3.0:1788572336.068280:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639064064 00000100:00100000:3.0:1788572336.068334:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:3.0:1788572336.068343:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+138:3649:x1875449639064064:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.068354:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935910, current: 8589935910, replaying 00000100:00100000:3.0:1788572336.068362:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+138:3649:x1875449639064064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22us (418us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.068368:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00010000:00010000:0.0:1788572336.069409:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.069421:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b8335170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.069434:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1c400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.069438:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b8335170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.069459:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b8335170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.069480:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b8335170 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.069488:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b8335170 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.069510:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.069512:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.069514:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788572336.070113:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935910, next_transno: 8589935910 00010000:00080000:2.0:1788572336.070118:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935910) 00010000:00080000:2.0:1788572336.070130:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639064064 t8589935910 from 0@lo req@ffff94e5032b6a00 x1875449639064064/t0(8589935910) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.070185:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2606 count 1 00002000:00010000:2.0:1788572336.070288:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.071081:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b8335177 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.071100:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2e:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.071106:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.071113:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b8335177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.071128:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b8335177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.071153:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b8335177 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.071163:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b8335177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.071185:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572336.071545:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572336.071567:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935911 00010000:00080000:2.0:1788572336.071572:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935911 00000100:00080000:2.0:1788572336.071625:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5f100 x1875449639064064/t8589935910(8589935910) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.071635:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.071638:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.071644:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.071652:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935910 00000100:00080000:2.0:1788572336.071681:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e64173fb80 x1875449639062784/t8589935911(8589935911) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.071698:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639064064:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.071718:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062784:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.071750:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572336.072161:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.072169:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b8335177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.072184:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1ce00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.072188:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b8335177 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.072198:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b8335177 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.072216:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b8335177 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.072224:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b8335177 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.072245:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.072247:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.072249:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572336.072263:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639062784 00000100:00100000:0.0:1788572336.072269:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639062784 00000100:00100000:0.0:1788572336.072324:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:0.0:1788572336.072334:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+139:3649:x1875449639062784:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.072346:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935911, current: 8589935911, replaying 00000100:00100000:0.0:1788572336.072359:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+139:3649:x1875449639062784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27us (609us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.072365:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00010000:00080000:2.0:1788572336.073270:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935911, next_transno: 8589935911 00010000:00080000:2.0:1788572336.073277:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935911) 00010000:00080000:2.0:1788572336.073289:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639062784 t8589935911 from 0@lo req@ffff94e5032b6680 x1875449639062784/t0(8589935911) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.073664:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2596 count 1 00002000:00010000:0.0:1788572336.078599:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.078621:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833517e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.078641:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa24:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.078647:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.078655:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833517e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.078676:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833517e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.078691:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833517e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.078700:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833517e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.078728:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572336.078967:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.079020:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935912 00010000:00080000:0.0:1788572336.079026:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935912 00010000:00010000:0.0:1788572336.079043:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1788572336.079343:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e64173fb80 x1875449639062784/t8589935911(8589935911) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.079354:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.079357:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.079363:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.079370:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935911 00000100:00080000:2.0:1788572336.079399:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5c380 x1875449639063296/t8589935912(8589935912) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.079411:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062784:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.079433:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063296:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.079486:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572336.079828:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833517e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.079841:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1d400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.079845:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833517e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.079856:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833517e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.079875:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833517e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.079883:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833517e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.079906:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.079908:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.079910:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572336.079927:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639063296 00000100:00100000:0.0:1788572336.079934:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639063296 00000100:00100000:0.0:1788572336.079975:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:0.0:1788572336.080246:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+140:3649:x1875449639063296:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.080263:0:43970:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935912, current: 8589935912, replaying 00000100:00100000:0.0:1788572336.080377:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+140:3649:x1875449639063296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 393us (890us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.080385:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00010000:00080000:2.0:1788572336.083917:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935912, next_transno: 8589935912 00010000:00080000:2.0:1788572336.083924:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935912) 00010000:00080000:2.0:1788572336.083937:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639063296 t8589935912 from 0@lo req@ffff94e6131cd880 x1875449639063296/t0(8589935912) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572336.084236:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2600 count 1 00002000:00010000:0.0:1788572336.084413:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.084422:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335185 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.084438:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa28:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.084444:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.084450:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.084465:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.084475:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335185 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.084483:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.084506:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572336.084660:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.084677:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935913 00010000:00080000:0.0:1788572336.084681:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935913 00010000:00010000:2.0:1788572336.084724:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572336.084730:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.084738:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572336.084743:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335185 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.084753:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335185 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.084779:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335185 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.084787:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede9f8b7/0xdb7edb52b8335185 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.084805:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.084807:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.084808:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572336.084849:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5c380 x1875449639063296/t8589935912(8589935912) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.084858:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.084861:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.084866:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.084880:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935912 00000100:00080000:2.0:1788572336.084908:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5d500 x1875449639063808/t8589935913(8589935913) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.084919:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063296:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.084936:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063808:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.084965:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.085236:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639063808 00000100:00100000:0.0:1788572336.085243:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639063808 00000100:00100000:0.0:1788572336.085279:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:0.0:1788572336.085286:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+141:3649:x1875449639063808:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.085360:0:8465:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935913, current: 8589935913, replaying 00000100:00100000:0.0:1788572336.085372:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+141:3649:x1875449639063808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 87us (407us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.085380:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00010000:00080000:0.0:1788572336.085395:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935913, next_transno: 8589935913 00010000:00080000:0.0:1788572336.085398:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935913) 00010000:00080000:0.0:1788572336.085405:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639063808 t8589935913 from 0@lo req@ffff94e6131cdc00 x1875449639063808/t0(8589935913) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572336.085428:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2604 count 1 00002000:00010000:0.0:1788572336.085486:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.085492:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833518c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.085502:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2c:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.085506:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.085510:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833518c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.085522:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833518c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.085530:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833518c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.085538:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833518c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.085551:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572336.085558:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.085562:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833518c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.085568:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.085572:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833518c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.085581:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833518c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.085591:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833518c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.085598:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833518c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.085612:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.085614:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.085615:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572336.085697:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.085707:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935914 00010000:00080000:0.0:1788572336.085711:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935914 00000100:00080000:2.0:1788572336.086404:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5d500 x1875449639063808/t8589935913(8589935913) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.086413:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.086415:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.086419:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.086425:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935913 00000100:00080000:2.0:1788572336.086451:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5032b7b80 x1875449639062656/t8589935914(8589935914) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.086461:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063808:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.086478:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.086512:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.086584:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639062656 00000100:00100000:0.0:1788572336.086591:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639062656 00000100:00100000:0.0:1788572336.086659:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:0.0:1788572336.086667:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+142:3649:x1875449639062656:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.086676:0:17011:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935914, current: 8589935914, replaying 00000100:00100000:0.0:1788572336.086695:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+142:3649:x1875449639062656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30us (182us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.086700:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00010000:00080000:2.0:1788572336.086733:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935914, next_transno: 8589935914 00010000:00080000:2.0:1788572336.086736:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935914) 00010000:00080000:2.0:1788572336.086742:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639062656 t8589935914 from 0@lo req@ffff94e6131cc380 x1875449639062656/t0(8589935914) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.086780:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2595 count 1 00002000:00010000:2.0:1788572336.086862:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.086869:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335193 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.086881:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa23:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.086885:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.086890:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.086901:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.086909:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335193 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.086916:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.086936:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572336.087064:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00000100:00080000:2.0:1788572336.087087:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5032b7b80 x1875449639062656/t8589935914(8589935914) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.087095:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.087097:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.087101:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.087108:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935914 00000100:00080000:2.0:1788572336.087124:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e64173e300 x1875449639063168/t8589935915(8589935915) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.087133:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639062656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.087569:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063168:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.087600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.087780:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639063168 00000100:00100000:3.0:1788572336.087786:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639063168 00000100:00100000:3.0:1788572336.087829:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:3.0:1788572336.087837:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+144:3649:x1875449639063168:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.087846:0:12091:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935914, current: 8589935915, replaying 00000100:00100000:3.0:1788572336.087851:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+144:3649:x1875449639063168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17us (251us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.087857:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00010000:00010000:1.0:1788572336.088100:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.088109:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.088120:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1da00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.088125:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335193 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.088152:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335193 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.088170:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335193 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.088178:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335193 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.088198:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.088200:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.088202:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572336.090925:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935915, next_transno: 8589935915 00010000:00080000:3.0:1788572336.090936:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935915) 00010000:00080000:3.0:1788572336.090949:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639063168 t8589935915 from 0@lo req@ffff94e6131cd180 x1875449639063168/t0(8589935915) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.091021:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2599 count 1 00002000:00010000:3.0:1788572336.091407:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.091416:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833519a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.091433:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa27:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.091437:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.091444:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833519a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.091460:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833519a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.091470:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833519a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.091478:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833519a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.091504:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.091665:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.091680:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935916 00010000:00080000:3.0:1788572336.091685:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935916 00010000:00010000:1.0:1788572336.091764:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.091850:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833519a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.091858:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.091862:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833519a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.091872:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833519a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.091889:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833519a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.091901:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833519a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.091920:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.091922:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.091923:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572336.092952:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e64173e300 x1875449639063168/t8589935915(8589935915) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.092964:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.092967:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.092972:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.092979:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935915 00000100:00080000:2.0:1788572336.093475:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5f800 x1875449639063680/t8589935916(8589935916) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.093490:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063168:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.093513:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063680:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.093579:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.096342:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639063680 00000100:00100000:1.0:1788572336.096357:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639063680 00000100:00100000:1.0:1788572336.096426:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:1.0:1788572336.096437:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+144:3649:x1875449639063680:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.096451:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935916, current: 8589935916, replaying 00000100:00100000:1.0:1788572336.096469:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+144:3649:x1875449639063680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35us (2890us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.096475:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00010000:00080000:3.0:1788572336.101934:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935916, next_transno: 8589935916 00010000:00080000:3.0:1788572336.101945:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935916) 00010000:00080000:3.0:1788572336.101960:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639063680 t8589935916 from 0@lo req@ffff94e62dac5f80 x1875449639063680/t0(8589935916) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.102594:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2603 count 1 00002000:00010000:2.0:1788572336.102720:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.102729:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b83351a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.102747:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2b:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.102752:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.102757:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b83351a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.102783:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b83351a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.102794:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b83351a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.102801:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b83351a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.102819:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572336.102985:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00000100:00080000:2.0:1788572336.103095:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5f800 x1875449639063680/t8589935916(8589935916) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.103104:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.103107:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.103113:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.103121:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935916 00000100:00080000:2.0:1788572336.103325:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5ea00 x1875449639064192/t8589935917(8589935917) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.103338:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639063680:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.103356:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639064192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.103392:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788572336.103451:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935917 00010000:00080000:2.0:1788572336.103456:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935917 00010000:00010000:0.0:1788572336.107475:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.107490:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b83351a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.107504:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1cc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.107510:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b83351a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.107523:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b83351a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.107546:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b83351a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.107553:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b83351a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.107575:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.107578:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.107579:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572336.107598:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639064192 00000100:00100000:0.0:1788572336.107607:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639064192 00000100:00100000:0.0:1788572336.108100:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:0.0:1788572336.108111:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+145:3649:x1875449639064192:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.108124:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935917, current: 8589935917, replaying 00000100:00100000:0.0:1788572336.108258:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+145:3649:x1875449639064192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 148us (4865us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.108266:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00010000:00080000:3.0:1788572336.109886:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935917, next_transno: 8589935917 00010000:00080000:3.0:1788572336.109895:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935917) 00010000:00080000:3.0:1788572336.109908:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639064192 t8589935917 from 0@lo req@ffff94e62dac4000 x1875449639064192/t0(8589935917) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.109955:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2607 count 1 00002000:00010000:3.0:1788572336.110111:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.110119:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83351a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.110263:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2f:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.110269:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.110276:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83351a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.110290:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83351a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.110311:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83351a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.110319:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83351a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.110344:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.110517:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.110537:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935918 00010000:00080000:3.0:1788572336.110540:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935918 00010000:00010000:1.0:1788572336.110696:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.110703:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83351a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.110711:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.110715:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83351a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.110724:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83351a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.110746:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83351a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.110753:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83351a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.110786:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.110788:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.110790:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572336.111216:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5ea00 x1875449639064192/t8589935917(8589935917) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.111225:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.111228:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.111233:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.111240:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935917 00000100:00080000:2.0:1788572336.111271:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5ca80 x1875449639066368/t8589935918(8589935918) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.111282:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639064192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.111313:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.111354:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.112101:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639066368 00000100:00100000:3.0:1788572336.112110:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639066368 00000100:00100000:3.0:1788572336.112391:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:3.0:1788572336.112404:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+146:3649:x1875449639066368:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.112418:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935918, current: 8589935918, replaying 00000100:00100000:3.0:1788572336.112440:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+146:3649:x1875449639066368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40us (1086us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.112448:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00010000:00080000:1.0:1788572336.112499:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935918, next_transno: 8589935918 00010000:00080000:1.0:1788572336.112504:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935918) 00010000:00080000:1.0:1788572336.112512:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639066368 t8589935918 from 0@lo req@ffff94e62dac5c00 x1875449639066368/t0(8589935918) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:1.0:1788572336.112550:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2609 count 1 00002000:00010000:1.0:1788572336.112661:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.112669:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83351af lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.112683:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa31:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.112688:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.112694:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83351af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.112707:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83351af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.112722:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83351af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.112731:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83351af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.112755:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1788572336.112912:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1788572336.112928:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935919 00010000:00080000:1.0:1788572336.112931:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935919 00000100:00080000:3.0:1788572336.113329:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5ca80 x1875449639066368/t8589935918(8589935918) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.113338:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572336.113341:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572336.113346:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.113353:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935918 00000100:00080000:3.0:1788572336.113381:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5d880 x1875449639066240/t8589935919(8589935919) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572336.113392:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066368:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.113408:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.113441:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.113591:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639066240 00000100:00100000:1.0:1788572336.113597:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639066240 00000100:00100000:1.0:1788572336.113627:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:1.0:1788572336.113634:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+147:3649:x1875449639066240:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.113641:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935919, current: 8589935919, replaying 00000100:00100000:1.0:1788572336.113657:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+147:3649:x1875449639066240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24us (216us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.113663:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00010000:00010000:0.0:1788572336.113750:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.113757:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83351af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.113827:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.113833:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83351af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.113844:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83351af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.113861:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83351af lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.113869:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83351af lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.113889:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.113890:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.113892:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572336.114350:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935919, next_transno: 8589935919 00010000:00080000:3.0:1788572336.114355:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935919) 00010000:00080000:3.0:1788572336.114363:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639066240 t8589935919 from 0@lo req@ffff94e6412c2a00 x1875449639066240/t0(8589935919) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.114393:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2608 count 1 00002000:00010000:3.0:1788572336.114479:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.114485:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83351b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.114497:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa30:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.114502:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.114508:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83351b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.114520:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83351b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.114530:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83351b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.114536:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83351b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.114560:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.114697:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.114727:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935920 00010000:00080000:3.0:1788572336.114731:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935920 00000100:00080000:2.0:1788572336.115260:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5d880 x1875449639066240/t8589935919(8589935919) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.115270:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.115273:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.115277:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.115285:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935919 00000100:00080000:2.0:1788572336.115391:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5e300 x1875449639066496/t8589935920(8589935920) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.115402:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.115420:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.115459:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572336.115548:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.115556:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83351b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.115566:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.115571:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83351b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.115584:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83351b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.115601:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83351b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.115608:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b83351b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.115634:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.115636:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.115637:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572336.115698:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639066496 00000100:00100000:3.0:1788572336.115706:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639066496 00000100:00100000:3.0:1788572336.115757:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:3.0:1788572336.115766:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+148:3649:x1875449639066496:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.116850:0:43964:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935920, current: 8589935920, replaying 00000100:00100000:3.0:1788572336.116876:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+148:3649:x1875449639066496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1110us (1415us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.116884:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00010000:00080000:2.0:1788572336.117889:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935920, next_transno: 8589935920 00010000:00080000:2.0:1788572336.117897:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935920) 00010000:00080000:2.0:1788572336.117909:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639066496 t8589935920 from 0@lo req@ffff94e62dac6d80 x1875449639066496/t0(8589935920) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.117961:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2610 count 1 00002000:00010000:2.0:1788572336.118425:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.118435:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.118451:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa32:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.118456:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.118463:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.118479:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.118491:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.118499:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.118522:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572336.118694:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572336.118715:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935921 00010000:00080000:2.0:1788572336.118720:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935921 00010000:00010000:1.0:1788572336.119237:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.119245:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.119255:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1dc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.119260:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.119271:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.119289:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.119378:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.119396:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.119398:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.119400:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572336.119501:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5e300 x1875449639066496/t8589935920(8589935920) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.119511:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572336.119514:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572336.119520:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.119528:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935920 00000100:00080000:3.0:1788572336.119556:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5d180 x1875449639067008/t8589935921(8589935921) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572336.119567:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066496:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.119588:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.119633:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.119869:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639067008 00000100:00100000:1.0:1788572336.119877:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639067008 00000100:00100000:1.0:1788572336.119924:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:1.0:1788572336.119934:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+149:3649:x1875449639067008:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.119946:0:43970:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935921, current: 8589935921, replaying 00000100:00100000:1.0:1788572336.119967:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+149:3649:x1875449639067008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35us (335us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.119974:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00010000:00080000:3.0:1788572336.120224:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935921, next_transno: 8589935921 00010000:00080000:3.0:1788572336.120228:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935921) 00010000:00080000:3.0:1788572336.120236:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639067008 t8589935921 from 0@lo req@ffff94e6412c1c00 x1875449639067008/t0(8589935921) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.120271:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2614 count 1 00002000:00010000:3.0:1788572336.120453:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.120460:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83351c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.120471:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa36:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.120475:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.120481:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83351c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.120492:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83351c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.120506:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83351c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.120512:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83351c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.120532:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.120656:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.120684:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935922 00010000:00080000:3.0:1788572336.120688:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935922 00000100:00080000:3.0:1788572336.120721:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5d180 x1875449639067008/t8589935921(8589935921) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.120729:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572336.120731:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572336.120735:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.120742:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935921 00000100:00080000:3.0:1788572336.120763:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5dc00 x1875449639066752/t8589935922(8589935922) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572336.122345:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.122359:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83351c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.122372:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.122377:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83351c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.122388:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83351c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.122415:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83351c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.122424:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b83351c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.122449:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.122451:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.122452:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572336.122878:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.122901:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066752:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.122954:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.123884:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639066752 00000100:00100000:1.0:1788572336.123898:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639066752 00000100:00100000:1.0:1788572336.127482:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:1.0:1788572336.127512:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+150:3649:x1875449639066752:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.127528:0:8465:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935922, current: 8589935922, replaying 00000100:00100000:1.0:1788572336.127542:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+150:3649:x1875449639066752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 47us (4588us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.127550:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00010000:00080000:3.0:1788572336.127631:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935922, next_transno: 8589935922 00010000:00080000:3.0:1788572336.127636:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935922) 00010000:00080000:3.0:1788572336.127647:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639066752 t8589935922 from 0@lo req@ffff94e6412c1f80 x1875449639066752/t0(8589935922) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.127688:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2612 count 1 00002000:00010000:3.0:1788572336.127816:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.127825:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83351cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.127842:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa34:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.127846:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.127853:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83351cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.127868:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83351cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.127880:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83351cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.127889:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83351cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.127910:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.128125:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.128162:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935923 00010000:00080000:3.0:1788572336.128166:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935923 00000100:00080000:3.0:1788572336.128210:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5dc00 x1875449639066752/t8589935922(8589935922) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.128219:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572336.128222:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572336.128227:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.128234:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935922 00000100:00080000:3.0:1788572336.128265:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5ed80 x1875449639067264/t8589935923(8589935923) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572336.128274:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066752:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.128291:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067264:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.128331:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572336.130921:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.130936:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83351cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.130951:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.130956:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83351cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.130974:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83351cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.130999:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83351cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.131038:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b83351cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.131211:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.131214:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.131216:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572336.134128:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639067264 00000100:00100000:2.0:1788572336.134442:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639067264 00000100:00100000:2.0:1788572336.134596:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:2.0:1788572336.134608:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+151:3649:x1875449639067264:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:2.0:1788572336.134623:0:43972:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935923, current: 8589935923, replaying 00000100:00100000:2.0:1788572336.134642:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+151:3649:x1875449639067264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 38us (6311us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788572336.134649:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00010000:00080000:2.0:1788572336.138191:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935923, next_transno: 8589935923 00010000:00080000:2.0:1788572336.138199:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935923) 00010000:00080000:2.0:1788572336.138214:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639067264 t8589935923 from 0@lo req@ffff94e6412c1180 x1875449639067264/t0(8589935923) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.138269:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2616 count 1 00002000:00010000:2.0:1788572336.138379:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.138387:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.138403:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa38:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.138407:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.138413:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.138428:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.138438:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.138448:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.138474:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572336.138634:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572336.138653:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935924 00010000:00080000:2.0:1788572336.138657:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935924 00010000:00010000:1.0:1788572336.140166:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.140179:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.140191:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1d800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.140197:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.140213:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.140240:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.140249:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.140268:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.140270:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.140272:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572336.141356:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5ed80 x1875449639067264/t8589935923(8589935923) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.141368:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572336.141371:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572336.141377:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.141385:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935923 00000100:00080000:3.0:1788572336.141419:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e637717800 x1875449639067392/t8589935924(8589935924) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572336.141430:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067264:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.141451:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.141511:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.143180:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639067392 00000100:00100000:0.0:1788572336.143195:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639067392 00000100:00100000:0.0:1788572336.143254:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:0.0:1788572336.143265:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+152:3649:x1875449639067392:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.143278:0:17011:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935924, current: 8589935924, replaying 00000100:00100000:0.0:1788572336.143290:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+152:3649:x1875449639067392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29us (1780us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.143296:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00010000:00080000:3.0:1788572336.143968:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935924, next_transno: 8589935924 00010000:00080000:3.0:1788572336.143975:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935924) 00010000:00080000:3.0:1788572336.143986:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639067392 t8589935924 from 0@lo req@ffff94e6412c2300 x1875449639067392/t0(8589935924) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.144219:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2617 count 1 00002000:00010000:3.0:1788572336.144344:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.144352:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83351d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.144369:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa39:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.144374:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.144379:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83351d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.144394:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83351d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.144406:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83351d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.144414:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83351d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.146231:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.146482:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.146514:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935925 00010000:00080000:3.0:1788572336.146519:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935925 00000100:00080000:3.0:1788572336.146585:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e637717800 x1875449639067392/t8589935924(8589935924) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.146596:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572336.146599:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572336.146604:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.146612:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935924 00000100:00080000:3.0:1788572336.146651:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5c700 x1875449639066880/t8589935925(8589935925) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572336.146662:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067392:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.146685:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.146720:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.147350:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639066880 00000100:00100000:1.0:1788572336.147359:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639066880 00000100:00100000:1.0:1788572336.147407:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:1.0:1788572336.147417:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+153:3649:x1875449639066880:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.147428:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935925, current: 8589935925, replaying 00000100:00100000:1.0:1788572336.147446:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+153:3649:x1875449639066880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32us (726us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.147453:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00010000:00080000:3.0:1788572336.147568:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935925, next_transno: 8589935925 00010000:00080000:3.0:1788572336.147572:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935925) 00010000:00080000:3.0:1788572336.147580:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639066880 t8589935925 from 0@lo req@ffff94e6412c0700 x1875449639066880/t0(8589935925) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.147614:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2613 count 1 00002000:00010000:3.0:1788572336.147715:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.147723:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b83351e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.147739:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa35:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.147743:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.147749:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b83351e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.147763:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b83351e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.147883:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b83351e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.147891:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b83351e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.148975:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572336.148989:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83351d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.149000:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.149144:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572336.149358:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.149365:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b83351e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.149374:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.149379:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b83351e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.149389:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b83351e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.149411:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b83351e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.149418:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b83351e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.149444:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.149446:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.149448:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572336.149969:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.153282:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935926 00010000:00080000:3.0:1788572336.153296:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935926 00000100:00080000:3.0:1788572336.153373:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5c700 x1875449639066880/t8589935925(8589935925) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.153385:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572336.153388:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572336.153394:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.153403:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935925 00000100:00080000:3.0:1788572336.153435:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ae6b800 x1875449639067520/t8589935926(8589935926) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572336.153445:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.153466:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067520:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.153529:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572336.153878:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83351d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.153894:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83351d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.153916:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83351d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.153924:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b83351d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.153951:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.153954:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.153956:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572336.154226:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639067520 00000100:00100000:1.0:1788572336.154234:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639067520 00000100:00100000:1.0:1788572336.154290:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:1.0:1788572336.154300:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+154:3649:x1875449639067520:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.154314:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935926, current: 8589935926, replaying 00000100:00100000:1.0:1788572336.154331:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+154:3649:x1875449639067520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33us (802us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.154338:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00010000:00080000:3.0:1788572336.156900:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935926, next_transno: 8589935926 00010000:00080000:3.0:1788572336.156910:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935926) 00010000:00080000:3.0:1788572336.156923:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639067520 t8589935926 from 0@lo req@ffff94e6412c1500 x1875449639067520/t0(8589935926) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.156970:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2618 count 1 00002000:00010000:3.0:1788572336.157223:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.157232:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83351e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.157249:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3a:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.157254:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.157260:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83351e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.157276:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83351e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.157287:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83351e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.157295:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83351e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.157320:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.157478:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.157511:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935927 00010000:00080000:3.0:1788572336.157516:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935927 00000100:00080000:2.0:1788572336.158203:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ae6b800 x1875449639067520/t8589935926(8589935926) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.158213:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.158217:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.158222:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.158230:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935926 00000100:00080000:2.0:1788572336.158261:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ae69180 x1875449639067776/t8589935927(8589935927) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.158271:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.158294:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.158339:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572336.159171:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.159184:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83351e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.159202:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.159208:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83351e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.159219:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83351e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.159254:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83351e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.159262:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b83351e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.159288:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.159290:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.159292:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572336.159895:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639067776 00000100:00100000:3.0:1788572336.159907:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639067776 00000100:00100000:3.0:1788572336.159966:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:3.0:1788572336.159975:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+155:3649:x1875449639067776:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.159988:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935927, current: 8589935927, replaying 00000100:00100000:3.0:1788572336.160025:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+155:3649:x1875449639067776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51us (1686us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.160031:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00010000:00080000:2.0:1788572336.160499:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935927, next_transno: 8589935927 00010000:00080000:2.0:1788572336.160504:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935927) 00010000:00080000:2.0:1788572336.160517:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639067776 t8589935927 from 0@lo req@ffff94e62dac7800 x1875449639067776/t0(8589935927) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.160558:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2620 count 1 00002000:00010000:2.0:1788572336.160681:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.160688:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b83351ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.160703:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3c:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.160707:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.160713:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b83351ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.160727:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b83351ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.160737:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b83351ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.160745:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b83351ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.160956:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572336.161130:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.161137:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b83351ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.161146:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1d200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.161150:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b83351ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.161158:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b83351ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.161173:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b83351ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.161182:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ad8991/0xdb7edb52b83351ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.161200:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.161201:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.161203:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788572336.161417:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572336.161436:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935928 00010000:00080000:2.0:1788572336.161440:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935928 00000100:00080000:2.0:1788572336.161484:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ae69180 x1875449639067776/t8589935927(8589935927) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.161493:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.161497:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.161502:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.161509:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935927 00000100:00080000:2.0:1788572336.161541:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ae69f80 x1875449639067904/t8589935928(8589935928) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.161551:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.161568:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.161600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.162531:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639067904 00000100:00100000:1.0:1788572336.162541:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639067904 00000100:00100000:1.0:1788572336.162592:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:1.0:1788572336.162602:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+156:3649:x1875449639067904:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.162614:0:43975:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935928, current: 8589935928, replaying 00000100:00100000:1.0:1788572336.162624:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+156:3649:x1875449639067904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26us (1025us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.162630:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00010000:00080000:2.0:1788572336.163175:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935928, next_transno: 8589935928 00010000:00080000:2.0:1788572336.163182:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935928) 00010000:00080000:2.0:1788572336.163191:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639067904 t8589935928 from 0@lo req@ffff94e62dac7100 x1875449639067904/t0(8589935928) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.163237:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2621 count 1 00002000:00010000:2.0:1788572336.163353:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.163362:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.163377:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3d:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.163382:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.163388:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.163403:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.163413:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.163421:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.163444:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572336.163597:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572336.163625:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935929 00010000:00080000:2.0:1788572336.163630:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935929 00000100:00080000:2.0:1788572336.163670:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ae69f80 x1875449639067904/t8589935928(8589935928) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.163679:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.163682:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.163687:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.163694:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935928 00000100:00080000:2.0:1788572336.163724:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ae6bb80 x1875449639068800/t8589935929(8589935929) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.163734:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.163752:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639068800:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572336.164905:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.164919:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.164933:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1d800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.164938:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.164956:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.164979:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.164988:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba845880/0xdb7edb52b83351f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.165034:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.165036:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.165038:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572336.165418:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.166655:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639068800 00000100:00100000:0.0:1788572336.166669:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639068800 00000100:00100000:0.0:1788572336.166779:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:0.0:1788572336.166791:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+157:3649:x1875449639068800:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.166804:0:8464:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935929, current: 8589935929, replaying 00000100:00100000:0.0:1788572336.166817:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+157:3649:x1875449639068800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31us (1403us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.166824:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00010000:00080000:2.0:1788572336.169114:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935929, next_transno: 8589935929 00010000:00080000:2.0:1788572336.169123:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935929) 00010000:00080000:2.0:1788572336.169138:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639068800 t8589935929 from 0@lo req@ffff94e61e57e300 x1875449639068800/t0(8589935929) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.169188:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2622 count 1 00002000:00010000:2.0:1788572336.169300:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.169309:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.169325:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3e:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.169330:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.169336:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.169353:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.169365:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.169373:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.169404:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572336.169564:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572336.169582:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935930 00010000:00080000:2.0:1788572336.169586:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935930 00000100:00080000:2.0:1788572336.169631:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ae6bb80 x1875449639068800/t8589935929(8589935929) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.169641:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.169644:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.169650:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.169658:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935929 00000100:00080000:2.0:1788572336.169687:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ae68000 x1875449639069312/t8589935930(8589935930) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.169698:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639068800:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.169715:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639069312:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.169747:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572336.169929:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.169937:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.169946:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1dc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.169950:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.169960:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.169978:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.169991:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa8a9832/0xdb7edb52b83351fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.170031:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.170033:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.170035:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572336.170064:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069312 00000100:00100000:1.0:1788572336.170070:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069312 00000100:00100000:1.0:1788572336.170112:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:1.0:1788572336.170122:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+158:3649:x1875449639069312:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.170131:0:43970:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935930, current: 8589935930, replaying 00000100:00100000:1.0:1788572336.170142:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+158:3649:x1875449639069312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22us (395us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.170148:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00010000:00080000:2.0:1788572336.170329:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935930, next_transno: 8589935930 00010000:00080000:2.0:1788572336.170334:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935930) 00010000:00080000:2.0:1788572336.170340:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639069312 t8589935930 from 0@lo req@ffff94e61e57d500 x1875449639069312/t0(8589935930) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.170369:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2626 count 1 00002000:00010000:2.0:1788572336.170441:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.170447:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335203 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.170458:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa42:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.170462:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.170468:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335203 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.170479:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335203 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.170488:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335203 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.170497:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335203 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.170512:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572336.170610:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572336.170637:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935931 00010000:00080000:2.0:1788572336.170642:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935931 00010000:00010000:2.0:1788572336.170651:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572336.170655:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335203 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.170663:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1cc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572336.170666:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335203 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.170674:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335203 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.170685:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335203 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.170692:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c507953b/0xdb7edb52b8335203 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.170706:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.170708:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.170709:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572336.170736:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ae68000 x1875449639069312/t8589935930(8589935930) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.170744:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.170747:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.170751:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.170764:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935930 00000100:00080000:2.0:1788572336.170803:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ae69500 x1875449639068928/t8589935931(8589935931) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.170812:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639069312:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.170823:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639068928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.170862:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.174387:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639068928 00000100:00100000:0.0:1788572336.174405:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639068928 00000100:00100000:0.0:1788572336.174490:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:0.0:1788572336.174501:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+159:3649:x1875449639068928:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.174518:0:8464:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935931, current: 8589935931, replaying 00000100:00100000:0.0:1788572336.174541:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+159:3649:x1875449639068928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 42us (3678us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.174548:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00010000:00080000:0.0:1788572336.176238:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935931, next_transno: 8589935931 00010000:00080000:0.0:1788572336.176247:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935931) 00010000:00080000:0.0:1788572336.176260:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639068928 t8589935931 from 0@lo req@ffff94e63c5d1850 x1875449639068928/t0(8589935931) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572336.176314:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2623 count 1 00002000:00010000:0.0:1788572336.176444:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.176452:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833520a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.176468:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3f:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.176473:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.176479:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833520a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.176494:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833520a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.176511:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833520a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.176519:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833520a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.176540:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572336.176699:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.176782:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935932 00010000:00080000:0.0:1788572336.176787:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935932 00010000:00010000:0.0:1788572336.176802:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.176808:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833520a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.176816:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.176820:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833520a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.176831:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833520a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.176849:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833520a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.176858:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a181095e/0xdb7edb52b833520a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.176876:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.176878:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.176880:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572336.176921:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ae69500 x1875449639068928/t8589935931(8589935931) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572336.176930:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572336.176933:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572336.176937:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572336.176944:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935931 00000100:00080000:0.0:1788572336.176974:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63779a300 x1875449639069824/t8589935932(8589935932) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572318 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572336.176987:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639068928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572336.177032:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639069824:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572336.178217:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.184211:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069824 00000100:00100000:1.0:1788572336.184226:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069824 00000100:00100000:1.0:1788572336.184290:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:1.0:1788572336.184302:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+160:3649:x1875449639069824:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.184316:0:8465:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935932, current: 8589935932, replaying 00000100:00100000:1.0:1788572336.184328:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+160:3649:x1875449639069824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30us (6118us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.184334:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00010000:00080000:0.0:1788572336.184842:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935932, next_transno: 8589935932 00010000:00080000:0.0:1788572336.184848:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935932) 00010000:00080000:0.0:1788572336.184858:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639069824 t8589935932 from 0@lo req@ffff94e62d289880 x1875449639069824/t0(8589935932) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572336.184895:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2628 count 1 00002000:00010000:0.0:1788572336.185045:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.185184:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335211 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.185204:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa44:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.185209:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.185215:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335211 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.185229:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335211 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.185240:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335211 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.185247:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335211 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.187161:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572336.187366:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.187404:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935933 00010000:00080000:0.0:1788572336.187409:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935933 00000100:00080000:2.0:1788572336.193405:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63779a300 x1875449639069824/t8589935932(8589935932) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.193420:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.193423:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.193429:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.193437:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935932 00000100:00080000:2.0:1788572336.193471:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5e680 x1875449639066624/t8589935933(8589935933) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.193483:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639069824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.193504:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.193577:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572336.200211:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.200228:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335211 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.200252:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.200257:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335211 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.200268:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335211 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.200291:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335211 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.200299:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000554a00bf/0xdb7edb52b8335211 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.200331:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.200334:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.200335:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572336.200622:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639066624 00000100:00100000:0.0:1788572336.200638:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639066624 00000100:00100000:0.0:1788572336.200705:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:0.0:1788572336.200718:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+161:3649:x1875449639066624:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.200733:0:17011:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935933, current: 8589935933, replaying 00000100:00100000:0.0:1788572336.200748:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+161:3649:x1875449639066624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34us (7172us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.200758:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00010000:00080000:0.0:1788572336.200776:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935933, next_transno: 8589935933 00010000:00080000:0.0:1788572336.200780:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935933) 00010000:00080000:0.0:1788572336.200791:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639066624 t8589935933 from 0@lo req@ffff94e61e57c700 x1875449639066624/t0(8589935933) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572336.200831:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2611 count 1 00002000:00010000:0.0:1788572336.200956:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.200963:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335218 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.200976:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa33:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.200980:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.200987:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335218 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.201000:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335218 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.201036:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335218 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.201044:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335218 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.201141:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788572336.201321:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.201340:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935934 00010000:00080000:0.0:1788572336.201345:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935934 00000100:00080000:2.0:1788572336.201490:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5e680 x1875449639066624/t8589935933(8589935933) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.201500:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.201503:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.201509:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.201518:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935933 00000100:00080000:2.0:1788572336.201557:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ad5c000 x1875449639067136/t8589935934(8589935934) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.201568:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639066624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.201590:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.201628:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572336.201821:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.201828:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335218 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.201837:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.201841:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335218 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.201850:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335218 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.201867:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335218 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.201874:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086bb7cdb/0xdb7edb52b8335218 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.201894:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.201896:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.201897:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572336.201956:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639067136 00000100:00100000:0.0:1788572336.201962:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639067136 00000100:00100000:0.0:1788572336.202000:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:0.0:1788572336.202220:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+162:3649:x1875449639067136:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.202230:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935934, current: 8589935934, replaying 00000100:00100000:0.0:1788572336.202245:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+162:3649:x1875449639067136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29us (617us total) trans 0 rc 0/-999 00010000:00080000:2.0:1788572336.202294:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935934, next_transno: 8589935934 00010000:00080000:2.0:1788572336.202299:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935934) 00010000:00080000:2.0:1788572336.202306:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639067136 t8589935934 from 0@lo req@ffff94e61e57ce00 x1875449639067136/t0(8589935934) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 2 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:2.0:1788572336.202338:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2615 count 1 00002000:00010000:2.0:1788572336.202425:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.202432:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b833521f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.202442:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa37:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.202445:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.202451:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b833521f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.202463:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b833521f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.202472:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b833521f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.202486:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b833521f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.202503:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788572336.202611:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1788572336.202618:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935935 00010000:00080000:2.0:1788572336.202622:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935935 00000100:00080000:2.0:1788572336.202655:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ad5c000 x1875449639067136/t8589935934(8589935934) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.202663:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.202666:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.202671:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.202679:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935934 00000100:00080000:2.0:1788572336.202703:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ae6ad80 x1875449639067648/t8589935935(8589935935) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.202713:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.202727:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067648:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.202755:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.212179:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639067648 00000100:00100000:3.0:1788572336.212195:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639067648 00000100:00100000:0.0:1788572336.212364:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00100000:3.0:1788572336.220677:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:3.0:1788572336.220702:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+163:3649:x1875449639067648:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.220720:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935935, current: 8589935935, replaying 00000100:00100000:3.0:1788572336.220742:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+163:3649:x1875449639067648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (17987us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.220749:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00010000:00010000:3.0:1788572336.220773:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572336.220782:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b833521f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.220795:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1da00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.220800:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b833521f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.220811:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b833521f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.220834:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b833521f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.220842:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b833521f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.220865:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.220867:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.220869:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572336.221091:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935935, next_transno: 8589935935 00010000:00080000:3.0:1788572336.221096:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935935) 00010000:00080000:3.0:1788572336.221106:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639067648 t8589935935 from 0@lo req@ffff94e61e57f100 x1875449639067648/t0(8589935935) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.221148:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2619 count 1 00002000:00010000:3.0:1788572336.221278:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.221285:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335226 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.221297:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3b:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.221302:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.221308:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335226 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.221321:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335226 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.221331:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335226 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.221344:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335226 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.221362:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.221527:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.221543:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935936 00010000:00080000:3.0:1788572336.221547:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935936 00010000:00010000:3.0:1788572336.221557:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572336.221562:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335226 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.221570:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.221574:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335226 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.221582:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335226 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.221594:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335226 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.221602:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335226 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.221619:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.221621:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.221622:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788572336.221662:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ae6ad80 x1875449639067648/t8589935935(8589935935) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.221671:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572336.221674:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572336.221679:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.221686:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935935 00000100:00080000:3.0:1788572336.221718:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e641696a00 x1875449639070080/t8589935936(8589935936) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572336.221729:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639067648:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.221748:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639070080:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.221780:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.221813:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070080 00000100:00100000:3.0:1788572336.221821:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070080 00000100:00100000:3.0:1788572336.226170:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:3.0:1788572336.226200:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+164:3649:x1875449639070080:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.226220:0:43973:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935936, current: 8589935936, replaying 00000100:00100000:3.0:1788572336.226237:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+164:3649:x1875449639070080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54us (4458us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.226243:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00010000:00080000:3.0:1788572336.227233:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935936, next_transno: 8589935936 00010000:00080000:3.0:1788572336.227238:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935936) 00010000:00080000:3.0:1788572336.227248:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639070080 t8589935936 from 0@lo req@ffff94e6412c0380 x1875449639070080/t0(8589935936) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.227290:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2629 count 1 00002000:00010000:3.0:1788572336.227415:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.227424:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b833522d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.227440:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa45:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.227444:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.227450:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b833522d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.227462:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b833522d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.227470:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b833522d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.227475:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b833522d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.227556:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.227701:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.227715:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935937 00010000:00080000:3.0:1788572336.227718:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935937 00000100:00080000:0.0:1788572336.227786:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e641696a00 x1875449639070080/t8589935936(8589935936) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572336.227795:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572336.227798:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572336.227803:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572336.227810:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935936 00000100:00080000:0.0:1788572336.227844:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ae6a680 x1875449639069056/t8589935937(8589935937) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572336.227853:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639070080:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572336.227869:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639069056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572336.227896:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.229570:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069056 00000100:00100000:0.0:1788572336.229588:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069056 00000100:00100000:0.0:1788572336.229652:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:0.0:1788572336.229663:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+165:3649:x1875449639069056:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.229680:0:43975:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935937, current: 8589935937, replaying 00000100:00100000:0.0:1788572336.229697:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+165:3649:x1875449639069056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37us (1799us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.229704:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00010000:00080000:3.0:1788572336.231572:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935937, next_transno: 8589935937 00010000:00080000:3.0:1788572336.231581:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935937) 00010000:00080000:3.0:1788572336.231595:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639069056 t8589935937 from 0@lo req@ffff94e62d289500 x1875449639069056/t0(8589935937) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.231700:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2624 count 1 00002000:00010000:3.0:1788572336.231820:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.231829:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8335234 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.231846:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa40:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.231851:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.231858:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8335234 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.231874:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8335234 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.231885:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8335234 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.231894:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8335234 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.236323:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572336.236339:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b833522d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.236353:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.236358:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b833522d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.236370:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b833522d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.236393:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b833522d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.236400:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061dfc6d2/0xdb7edb52b833522d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.239123:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.239136:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8335234 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.239149:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.239154:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8335234 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.239166:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8335234 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.239185:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8335234 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.239196:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.239197:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.239199:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.239205:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.239207:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.239208:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.239467:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788572336.239475:0:114791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b8335234 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788572336.239768:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.239790:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935938 00000100:00080000:1.0:1788572336.240710:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ae6a680 x1875449639069056/t8589935937(8589935937) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.240723:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.240725:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.240730:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.240744:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935937 00000100:00080000:1.0:1788572336.240778:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e506552680 x1875449639070976/t8589935938(8589935938) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.240789:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639069056:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.241391:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639070976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.241449:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788572336.241974:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935938 00000100:00100000:3.0:1788572336.243155:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070976 00000100:00100000:3.0:1788572336.243169:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070976 00000100:00100000:3.0:1788572336.243221:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:3.0:1788572336.243249:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+166:3649:x1875449639070976:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.243264:0:43964:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935938, current: 8589935938, replaying 00000100:00100000:3.0:1788572336.243277:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+166:3649:x1875449639070976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31us (1829us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.243285:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00010000:00080000:3.0:1788572336.243301:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935938, next_transno: 8589935938 00010000:00080000:3.0:1788572336.243304:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935938) 00010000:00080000:3.0:1788572336.243315:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639070976 t8589935938 from 0@lo req@ffff94e63779b800 x1875449639070976/t0(8589935938) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.243355:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2632 count 1 00002000:00010000:3.0:1788572336.243468:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.243476:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833523b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.243492:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa48:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.243497:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.243503:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833523b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.243518:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833523b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.243529:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833523b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.243538:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833523b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.243555:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.243709:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.243723:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935939 00010000:00080000:3.0:1788572336.243728:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935939 00010000:00010000:1.0:1788572336.247851:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.247865:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833523b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.247878:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.247883:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833523b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.247896:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833523b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.247920:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833523b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.247928:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1ac5c77/0xdb7edb52b833523b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.247948:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.247950:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.247953:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572336.248031:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e506552680 x1875449639070976/t8589935938(8589935938) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.248041:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.248045:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.248062:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.248071:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935938 00000100:00080000:1.0:1788572336.248110:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e63ae68700 x1875449639069184/t8589935939(8589935939) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.248123:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639070976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.248147:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639069184:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.248205:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.248743:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069184 00000100:00100000:1.0:1788572336.248751:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069184 00000100:00100000:1.0:1788572336.248795:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:1.0:1788572336.248804:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+167:3649:x1875449639069184:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.248817:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935939, current: 8589935939, replaying 00000100:00100000:1.0:1788572336.248830:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+167:3649:x1875449639069184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27us (625us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.248836:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00010000:00080000:3.0:1788572336.250566:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935939, next_transno: 8589935939 00010000:00080000:3.0:1788572336.250581:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935939) 00010000:00080000:3.0:1788572336.250595:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639069184 t8589935939 from 0@lo req@ffff94e63779aa00 x1875449639069184/t0(8589935939) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.250646:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2625 count 1 00002000:00010000:3.0:1788572336.250764:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.250772:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335242 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.250788:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa41:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.250794:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.250801:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335242 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.250815:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335242 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.250826:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335242 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.250835:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335242 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.250855:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572336.250866:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572336.250872:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335242 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.250879:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.250884:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335242 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.250894:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335242 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.250909:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335242 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.250917:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335242 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.250934:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.250936:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.250938:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572336.251828:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.251865:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935940 00010000:00080000:3.0:1788572336.251869:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935940 00000100:00080000:1.0:1788572336.252642:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e63ae68700 x1875449639069184/t8589935939(8589935939) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.252655:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.252658:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.252664:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.252673:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935939 00000100:00080000:1.0:1788572336.252708:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e634b28380 x1875449639071488/t8589935940(8589935940) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.252720:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639069184:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.252743:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639071488:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.252785:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.253852:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639071488 00000100:00100000:0.0:1788572336.253864:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639071488 00000100:00100000:0.0:1788572336.253922:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:0.0:1788572336.253932:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+168:3649:x1875449639071488:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.253945:0:8464:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935940, current: 8589935940, replaying 00000100:00100000:0.0:1788572336.253956:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+168:3649:x1875449639071488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26us (1172us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.253962:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00010000:00080000:3.0:1788572336.256375:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935940, next_transno: 8589935940 00010000:00080000:3.0:1788572336.256389:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935940) 00010000:00080000:3.0:1788572336.256405:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639071488 t8589935940 from 0@lo req@ffff94e63779a680 x1875449639071488/t0(8589935940) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.256462:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2634 count 1 00002000:00010000:3.0:1788572336.256591:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.256600:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335249 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.256619:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4a:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.256624:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.256631:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335249 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.256648:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335249 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.256660:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335249 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.256668:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335249 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.256687:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572336.256701:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572336.256706:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335249 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.256714:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.256718:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335249 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.256728:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335249 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.256745:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335249 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.256753:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335249 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.256772:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.256774:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.256776:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572336.257033:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.257066:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935941 00010000:00080000:3.0:1788572336.257071:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935941 00000100:00080000:1.0:1788572336.263567:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e634b28380 x1875449639071488/t8589935940(8589935940) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.263582:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.263586:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.263591:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.263600:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935940 00000100:00080000:1.0:1788572336.263636:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e637799880 x1875449639069696/t8589935941(8589935941) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.263648:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639071488:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.263673:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639069696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.263729:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.263976:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639069696 00000100:00100000:0.0:1788572336.263984:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639069696 00000100:00100000:0.0:1788572336.264169:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00100000:0.0:1788572336.264180:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+169:3649:x1875449639069696:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.264195:0:8465:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935941, current: 8589935941, replaying 00000100:00100000:0.0:1788572336.264207:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+169:3649:x1875449639069696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30us (478us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.264215:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00010000:00080000:3.0:1788572336.264744:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935941, next_transno: 8589935941 00010000:00080000:3.0:1788572336.264750:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935941) 00010000:00080000:3.0:1788572336.264759:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639069696 t8589935941 from 0@lo req@ffff94e637798000 x1875449639069696/t0(8589935941) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.265321:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2627 count 1 00002000:00010000:3.0:1788572336.265431:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.265440:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335250 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.265456:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa43:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.265461:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.265468:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335250 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.265485:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335250 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.265496:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335250 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.265506:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335250 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.265621:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.265800:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.265820:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935942 00010000:00080000:3.0:1788572336.265825:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935942 00000100:00080000:1.0:1788572336.265964:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e637799880 x1875449639069696/t8589935941(8589935941) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.265974:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.265977:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.265982:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.267955:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935941 00000100:00080000:1.0:1788572336.268036:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e641104700 x1875449639071360/t8589935942(8589935942) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.268061:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639069696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.268085:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639071360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.268145:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572336.268350:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.268361:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335250 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.268374:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.268380:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335250 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.268392:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335250 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.268414:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335250 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.268422:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f4472e1/0xdb7edb52b8335250 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.268443:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.268445:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.268448:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572336.268463:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639071360 00000100:00100000:0.0:1788572336.268471:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639071360 00000100:00100000:0.0:1788572336.268568:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00100000:0.0:1788572336.268578:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+170:3649:x1875449639071360:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.268591:0:17011:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935942, current: 8589935942, replaying 00000100:00100000:0.0:1788572336.268603:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+170:3649:x1875449639071360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28us (459us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.268611:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00010000:00080000:3.0:1788572336.268650:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935942, next_transno: 8589935942 00010000:00080000:3.0:1788572336.268655:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935942) 00010000:00080000:3.0:1788572336.268664:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639071360 t8589935942 from 0@lo req@ffff94e637798a80 x1875449639071360/t0(8589935942) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.268702:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2633 count 1 00002000:00010000:3.0:1788572336.268877:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.268884:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335257 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.268897:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa49:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.268902:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.268909:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335257 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.268924:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335257 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.268936:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335257 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.268944:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335257 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.268972:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.269139:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.269154:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935943 00010000:00080000:3.0:1788572336.269158:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935943 00000100:00080000:1.0:1788572336.269305:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e641104700 x1875449639071360/t8589935942(8589935942) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.269315:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.269318:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.269323:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.269330:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935942 00000100:00080000:1.0:1788572336.269355:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e501ff2680 x1875449639072384/t8589935943(8589935943) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.269366:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639071360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.269380:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639072384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.269406:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572336.269437:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.269442:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335257 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.269451:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.269454:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335257 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.269464:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335257 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.269478:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335257 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.269486:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb405f5/0xdb7edb52b8335257 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.269503:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.269505:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.269507:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572336.269519:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639072384 00000100:00100000:1.0:1788572336.269523:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639072384 00000100:00100000:1.0:1788572336.269560:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00100000:1.0:1788572336.269569:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+171:3649:x1875449639072384:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.269577:0:43969:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935943, current: 8589935943, replaying 00000100:00100000:1.0:1788572336.269596:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+171:3649:x1875449639072384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29us (189us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.269603:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00010000:00080000:3.0:1788572336.269862:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935943, next_transno: 8589935943 00010000:00080000:3.0:1788572336.269866:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935943) 00010000:00080000:3.0:1788572336.269872:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639072384 t8589935943 from 0@lo req@ffff94e637799f80 x1875449639072384/t0(8589935943) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.269899:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2637 count 1 00002000:00010000:3.0:1788572336.269966:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.269972:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b833525e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.269981:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4d:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.269984:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.270487:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b833525e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.270500:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b833525e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.270509:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b833525e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.270516:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b833525e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.270533:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.270661:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.270689:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935944 00010000:00080000:3.0:1788572336.270693:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935944 00010000:00010000:1.0:1788572336.271090:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.271097:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b833525e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.271106:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.271110:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b833525e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.271119:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b833525e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.271133:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b833525e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.271141:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2dd571d/0xdb7edb52b833525e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.271158:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.271160:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.271161:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572336.271203:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e501ff2680 x1875449639072384/t8589935943(8589935943) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.271212:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.271215:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.271220:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.271228:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935943 00000100:00080000:1.0:1788572336.271262:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e501ff2d80 x1875449639073024/t8589935944(8589935944) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.271273:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639072384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.271293:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639073024:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.271330:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.271489:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073024 00000100:00100000:3.0:1788572336.271495:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073024 00000100:00100000:3.0:1788572336.271531:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:3.0:1788572336.271539:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+172:3649:x1875449639073024:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.271550:0:8663:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935944, current: 8589935944, replaying 00000100:00100000:3.0:1788572336.271560:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+172:3649:x1875449639073024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23us (231us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.271566:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00010000:00080000:3.0:1788572336.271582:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935944, next_transno: 8589935944 00010000:00080000:3.0:1788572336.271585:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935944) 00010000:00080000:3.0:1788572336.271593:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639073024 t8589935944 from 0@lo req@ffff94e637798e00 x1875449639073024/t0(8589935944) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.271630:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2638 count 1 00002000:00010000:3.0:1788572336.271728:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.271736:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335265 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.271748:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4e:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.271753:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.271759:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335265 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.271786:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335265 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.271795:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335265 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.271803:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335265 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.271817:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.271929:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.271946:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935945 00010000:00080000:3.0:1788572336.271950:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935945 00010000:00010000:3.0:1788572336.271960:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572336.271964:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335265 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.271972:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.271976:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335265 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.271984:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335265 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.272034:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335265 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.272042:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335265 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.272065:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.272067:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.272069:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572336.272252:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e501ff2d80 x1875449639073024/t8589935944(8589935944) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.272262:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.272264:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.272268:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.272275:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935944 00000100:00080000:1.0:1788572336.272296:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e61e761880 x1875449639070208/t8589935945(8589935945) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.272306:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639073024:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.272317:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639070208:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.272344:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.272374:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070208 00000100:00100000:1.0:1788572336.272379:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070208 00000100:00100000:1.0:1788572336.272414:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:1.0:1788572336.272421:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+173:3649:x1875449639070208:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.272429:0:8466:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935945, current: 8589935945, replaying 00000100:00100000:1.0:1788572336.272437:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+173:3649:x1875449639070208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17us (94us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.272443:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00010000:00080000:3.0:1788572336.273469:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935945, next_transno: 8589935945 00010000:00080000:3.0:1788572336.273480:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935945) 00010000:00080000:3.0:1788572336.273491:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639070208 t8589935945 from 0@lo req@ffff94e637799180 x1875449639070208/t0(8589935945) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.273532:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2630 count 1 00002000:00010000:3.0:1788572336.273712:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.273720:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b833526c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.273734:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa46:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.273738:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.273745:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b833526c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.273762:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b833526c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.273780:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b833526c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.273788:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b833526c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.273807:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.273977:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.274031:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935946 00010000:00080000:3.0:1788572336.274035:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935946 00010000:00010000:3.0:1788572336.274044:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572336.274050:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b833526c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.274073:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.274077:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b833526c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.274086:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b833526c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.274101:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b833526c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.274108:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b833526c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572336.274803:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e61e761880 x1875449639070208/t8589935945(8589935945) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.274814:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.274817:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.274823:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.274831:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935945 00000100:00080000:1.0:1788572336.274864:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e501ff3800 x1875449639072256/t8589935946(8589935946) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.274876:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639070208:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.274897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639072256:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.274935:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.275133:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639072256 00000100:00100000:0.0:1788572336.275140:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639072256 00000100:00100000:0.0:1788572336.275187:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:0.0:1788572336.275197:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+174:3649:x1875449639072256:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.275209:0:43975:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935946, current: 8589935946, replaying 00000100:00100000:0.0:1788572336.275223:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+174:3649:x1875449639072256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29us (288us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.275229:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00010000:00080000:3.0:1788572336.275369:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935946, next_transno: 8589935946 00010000:00080000:3.0:1788572336.275373:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935946) 00010000:00080000:3.0:1788572336.275380:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639072256 t8589935946 from 0@lo req@ffff94e63779bb80 x1875449639072256/t0(8589935946) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.275410:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2636 count 1 00002000:00010000:3.0:1788572336.275496:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.275503:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b8335273 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.275516:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4c:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.275520:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.275527:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b8335273 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.275540:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b8335273 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.275548:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b8335273 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.275556:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b8335273 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.275570:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572336.275701:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.275708:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b8335273 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.275715:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.275719:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b8335273 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.275728:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b8335273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.275743:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b8335273 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.275751:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a3a0df5/0xdb7edb52b8335273 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.275767:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.275770:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.275771:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.275797:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.275799:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.275801:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788572336.275860:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.275873:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935947 00010000:00080000:3.0:1788572336.275876:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935947 00000100:00080000:2.0:1788572336.277493:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e501ff3800 x1875449639072256/t8589935946(8589935946) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.277507:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1788572336.277511:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:2.0:1788572336.277517:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.277526:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935946 00000100:00080000:2.0:1788572336.277633:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e501ff0000 x1875449639073408/t8589935947(8589935947) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.277646:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639072256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.277666:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639073408:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.277728:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.280638:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073408 00000100:00100000:0.0:1788572336.280651:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073408 00000100:00100000:3.0:1788572336.283218:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:3.0:1788572336.283234:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+175:3649:x1875449639073408:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.283251:0:43964:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935947, current: 8589935947, replaying 00000100:00100000:3.0:1788572336.283278:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+175:3649:x1875449639073408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48us (5549us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.283286:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00010000:00080000:0.0:1788572336.283378:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935947, next_transno: 8589935947 00010000:00080000:0.0:1788572336.283382:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935947) 00010000:00080000:0.0:1788572336.283390:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639073408 t8589935947 from 0@lo req@ffff94e61e57fb80 x1875449639073408/t0(8589935947) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788572336.283424:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2640 count 1 00002000:00010000:0.0:1788572336.283526:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.283532:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b833527a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.283555:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa50:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.283559:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.283564:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b833527a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.283576:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b833527a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.283584:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b833527a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.283588:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b833527a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.283651:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572336.283674:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572336.283681:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b833527a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.283694:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641280c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.283699:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b833527a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.283708:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b833527a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.283727:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b833527a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.283736:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ebe61fa/0xdb7edb52b833527a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.283753:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.283755:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.283757:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788572336.283935:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1788572336.283961:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935948 00010000:00080000:0.0:1788572336.283965:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935948 00000100:00080000:3.0:1788572336.283972:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e501ff0000 x1875449639073408/t8589935947(8589935947) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.283981:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1788572336.283984:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572336.283999:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572336.284026:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935947 00000100:00080000:3.0:1788572336.284075:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e501ff3100 x1875449639073536/t8589935948(8589935948) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572336.284094:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639073408:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.284110:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639073536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.284144:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.284379:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073536 00000100:00100000:0.0:1788572336.284385:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073536 00000100:00100000:0.0:1788572336.284417:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:0.0:1788572336.284425:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+176:3649:x1875449639073536:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.284433:0:43965:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935948, current: 8589935948, replaying 00000100:00100000:0.0:1788572336.284446:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+176:3649:x1875449639073536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23us (302us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.284453:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00010000:00080000:3.0:1788572336.284463:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935948, next_transno: 8589935948 00010000:00080000:3.0:1788572336.284466:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935948) 00010000:00080000:3.0:1788572336.284472:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639073536 t8589935948 from 0@lo req@ffff94e6412c0000 x1875449639073536/t0(8589935948) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.284497:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2641 count 1 00002000:00010000:3.0:1788572336.284566:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.284572:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335281 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.284583:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa51:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.284588:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.284593:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335281 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.284605:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335281 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.284614:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335281 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.284621:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335281 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.284649:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.284728:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.284740:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935949 00010000:00080000:3.0:1788572336.284744:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935949 00000100:00080000:3.0:1788572336.284769:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e501ff3100 x1875449639073536/t8589935948(8589935948) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572336.284773:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1788572336.284777:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00010000:00010000:0.0:1788572336.284779:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335281 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572336.284779:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:3.0:1788572336.284784:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788572336.284787:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80c00 already unused, calling callback (ffffffffc0be44f0) 00000100:00080000:3.0:1788572336.284791:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935948 00000100:00080000:3.0:1788572336.284808:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e506550700 x1875449639070720/t8589935949(8589935949) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572336.284817:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639073536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.284827:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639070720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.284851:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572336.285050:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335281 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.285073:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335281 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.285088:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335281 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.285097:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a206dd75/0xdb7edb52b8335281 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.285112:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.285114:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.285116:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572336.285127:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639070720 00000100:00100000:0.0:1788572336.285132:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639070720 00000100:00100000:0.0:1788572336.285168:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:0.0:1788572336.285176:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+177:3649:x1875449639070720:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:0.0:1788572336.285183:0:8464:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935949, current: 8589935949, replaying 00000100:00100000:0.0:1788572336.285189:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+177:3649:x1875449639070720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16us (339us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572336.285194:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00010000:00080000:3.0:1788572336.285252:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935949, next_transno: 8589935949 00010000:00080000:3.0:1788572336.285255:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935949) 00010000:00080000:3.0:1788572336.285261:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639070720 t8589935949 from 0@lo req@ffff94e6412c2a00 x1875449639070720/t0(8589935949) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.285282:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2631 count 1 00002000:00010000:3.0:1788572336.285343:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.285348:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8335288 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.285358:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa47:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.285361:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.285365:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8335288 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.285375:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8335288 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.285383:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8335288 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.285390:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8335288 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.285411:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.285493:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.285503:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935950 00010000:00080000:3.0:1788572336.285507:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935950 00010000:00010000:0.0:1788572336.285579:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.285585:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8335288 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788572336.285762:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e506550700 x1875449639070720/t8589935949(8589935949) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.285771:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.285774:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.285779:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.285786:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935949 00000100:00080000:1.0:1788572336.285818:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e501ff2a00 x1875449639072128/t8589935950(8589935950) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.285828:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639070720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.285840:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639072128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.285865:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788572336.285948:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.285952:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8335288 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.285959:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8335288 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.285967:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8335288 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.285972:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029d9c7f4/0xdb7edb52b8335288 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.285982:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.285983:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.285985:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572336.285994:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639072128 00000100:00100000:0.0:1788572336.285998:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639072128 00000100:00100000:1.0:1788572336.286428:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:1.0:1788572336.286437:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+178:3649:x1875449639072128:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:1.0:1788572336.286448:0:8465:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935950, current: 8589935950, replaying 00000100:00100000:1.0:1788572336.286459:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+178:3649:x1875449639072128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24us (593us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572336.286464:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00010000:00080000:3.0:1788572336.286465:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935950, next_transno: 8589935950 00010000:00080000:3.0:1788572336.286469:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935950) 00010000:00080000:3.0:1788572336.286475:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639072128 t8589935950 from 0@lo req@ffff94e637798380 x1875449639072128/t0(8589935950) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.286504:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2635 count 1 00002000:00010000:3.0:1788572336.286585:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.286592:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b833528f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.286603:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4b:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.286607:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.286613:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b833528f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.286624:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b833528f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.286633:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b833528f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.286641:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b833528f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.286663:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788572336.286760:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.286766:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b833528f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788572336.286770:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00010000:0.0:1788572336.286773:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac80e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.286776:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b833528f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.286784:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b833528f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788572336.286793:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935951 00010000:00080000:3.0:1788572336.286796:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935951 00000100:00080000:1.0:1788572336.286885:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e501ff2a00 x1875449639072128/t8589935950(8589935950) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.286891:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.286893:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.286895:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.286900:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935950 00000100:00080000:1.0:1788572336.286921:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e501ff1c00 x1875449639073152/t8589935951(8589935951) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.286928:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639072128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.286939:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639073152:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.286962:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.287066:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073152 00000100:00100000:3.0:1788572336.287072:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073152 00000100:00100000:3.0:1788572336.287101:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:3.0:1788572336.287107:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+179:3649:x1875449639073152:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.287114:0:43966:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935951, current: 8589935951, replaying 00000100:00100000:3.0:1788572336.287125:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+179:3649:x1875449639073152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19us (162us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.287134:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00010000:00080000:3.0:1788572336.287145:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935951, next_transno: 8589935951 00010000:00080000:3.0:1788572336.287148:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935951) 00010000:00080000:3.0:1788572336.287152:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639073152 t8589935951 from 0@lo req@ffff94e637798700 x1875449639073152/t0(8589935951) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.287175:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2639 count 1 00002000:00010000:3.0:1788572336.287223:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.287229:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b8335296 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.287238:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4f:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.287241:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.287245:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b8335296 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.287254:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b8335296 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.287263:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b8335296 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.287270:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b8335296 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.287285:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788572336.287347:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1788572336.287358:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935952 00010000:00080000:3.0:1788572336.287361:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935952 00010000:00010000:3.0:1788572336.287371:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572336.287377:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b8335296 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.287384:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.287387:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b8335296 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.287395:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b8335296 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.287410:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b8335296 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.287411:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b833528f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.287419:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b8335296 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.287420:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007222a829/0xdb7edb52b833528f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.287436:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.287436:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.287438:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.287438:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.287439:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.287440:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572336.287510:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e501ff1c00 x1875449639073152/t8589935951(8589935951) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.287518:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:1.0:1788572336.287520:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:1.0:1788572336.287524:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572336.287530:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935951 00000100:00080000:1.0:1788572336.287543:0:3649:0:(client.c:3554:ptlrpc_replay_req()) @@@ REPLAY req@ffff94e5032b7100 x1875449639073664/t8589935952(8589935952) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572319 ref 1 fl New:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572336.287562:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639073152:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.287569:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639073664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.287587:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572336.290184:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639073664 00000100:00100000:0.0:1788572336.290197:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639073664 00000100:00100000:3.0:1788572336.290343:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:3.0:1788572336.290354:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+180:3649:x1875449639073664:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.290368:0:43974:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 8589935952, current: 8589935952, replaying 00000100:00100000:3.0:1788572336.290381:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+180:3649:x1875449639073664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30us (2792us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.290390:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00010000:00080000:3.0:1788572336.290436:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 8589935952, next_transno: 8589935952 00010000:00080000:3.0:1788572336.290441:0:114791:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (8589935952) 00010000:00080000:3.0:1788572336.290449:0:114791:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449639073664 t8589935952 from 0@lo req@ffff94e63ae3ce00 x1875449639073664/t0(8589935952) o6->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 544/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788572336.290483:0:114791:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2642 count 1 00002000:00010000:3.0:1788572336.290587:0:114791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.290596:0:114791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833529d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.290612:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa52:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.290616:0:114791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.290623:0:114791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833529d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.290636:0:114791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833529d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.290646:0:114791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833529d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.290654:0:114791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833529d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.290678:0:114791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572336.290759:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.290767:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833529d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.290775:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.290779:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833529d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.290788:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833529d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788572336.290873:0:114791:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00010000:1.0:1788572336.290881:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833529d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.290889:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b833529d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 114791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788572336.290889:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935953 00010000:00080000:3.0:1788572336.290893:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 8589935953 00010000:00010000:1.0:1788572336.290909:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.290911:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.290913:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572336.290954:0:3649:0:(client.c:3439:ptlrpc_replay_interpret()) @@@ got reply req@ffff94e5032b7100 x1875449639073664/t8589935952(8589935952) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572352 ref 2 fl Interpret:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572336.290963:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1788572336.290967:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935776 gen 2 00000100:00100000:0.0:1788572336.290973:0:3649:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e60fc3df80 x1875449639032576/t8589935777(8589935777) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572336.290981:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e640d5d800 from lustre-OST0000_UUID committed 8589935776 last 8589935952 00000100:00080000:0.0:1788572336.291238:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1788572336.292316:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639073664:0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788572336.292419:0:114906:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1788572336.292424:0:114906:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:3.0:1788572336.292428:0:114906:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:3.0:1788572336.292468:0:114906:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1788572336.292594:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639100288:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788572336.292656:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.292860:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639100288 00000100:00100000:3.0:1788572336.292869:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639100288 00000100:00100000:3.0:1788572336.292954:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701 00000100:00100000:3.0:1788572336.292966:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+181:3649:x1875449639100288:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788572336.292982:0:8663:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff94e62d288700 x1875449639100288/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 224/0 e 0 to 0 dl 1788572347 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572336.293066:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+181:3649:x1875449639100288:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 89us (396us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572336.293073:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701 00010000:00080000:1.0:1788572336.293083:0:114791:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 8589935953 00010000:00080000:1.0:1788572336.293091:0:114791:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00010000:00080000:1.0:1788572336.293099:0:114791:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788572336.293101:0:114791:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788572336.293195:0:114791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00100000:0.0:1788572336.304354:0:114775:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788572336.304386:0:114775:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788572336.304400:0:114775:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000001:00080000:0.0:1788572336.304406:0:114775:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589935952 is committed 00010000:00080000:1.0:1788572336.306961:0:114791:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-OST0000: cancel recovery timer 00010000:00080000:1.0:1788572336.306983:0:114791:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.202.13@tcp: req@ffff94e637715880 x1875449616093184/t0(0) o400->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:751/0 lens 224/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788572336.307480:0:114791:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff94e5063a9880 x1875449639100032/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:751/0 lens 224/0 e 0 to 0 dl 1788572346 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788572336.307667:0:114791:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff94e62d288700 x1875449639100288/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:752/0 lens 224/0 e 0 to 0 dl 1788572347 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.307788:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788572336.307797:0:3649:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff94e634b28e00 x1875449639100032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572351 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.307807:0:3649:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff94e634b28e00 x1875449639100032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572351 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.307814:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501c62000 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:2.0:1788572336.307825:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1788572336.307828:0:3649:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1788572336.307835:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000017622ac9): req@ffff94e637590700 x1875449639085184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/224 e 0 to 0 dl 1788572326 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.307850:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639100032:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788572336.307945:0:8656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8656:1875449639100544:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788572336.307984:0:8656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.308029:0:8656:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e504f77e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572336.308105:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.308139:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639100416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572336.308162:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.308198:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639085184 00000100:00100000:2.0:1788572336.308204:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639085184 00000100:00100000:2.0:1788572336.308241:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639100416 00000100:00100000:2.0:1788572336.308245:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639100416 00000100:00100000:2.0:1788572336.308266:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:2.0:1788572336.308275:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639085184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572336.308290:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8388608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572336.308341:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639085184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572336.308348:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:2.0:1788572336.308362:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:2.0:1788572336.308368:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639100416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572336.308377:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8388608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572336.308404:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639100416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572336.308410:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00000100:00100000:2.0:1788572336.308451:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639085184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572336.308476:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639100416:0@lo:13:osp-pre-0-1.0 00010000:02000000:1.0:1788572336.308653:0:114791:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-OST0000: Recovery over after 0:01, of 3 clients 3 recovered and 0 were evicted. 00002000:00080000:1.0:1788572336.309970:0:114791:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788572336.309979:0:114791:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000100:00100000:2.0:1788572336.310449:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589935952 gen 2 00000004:00080000:2.0:1788572336.310457:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3df80, transno 8589935777 00000004:00080000:2.0:1788572336.310467:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c1f80, transno 8589935778 00000004:00080000:2.0:1788572336.310470:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c1500, transno 8589935779 00000004:00080000:2.0:1788572336.310472:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c1880, transno 8589935780 00000004:00080000:2.0:1788572336.310475:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c0e00, transno 8589935781 00000004:00080000:2.0:1788572336.310477:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c3480, transno 8589935782 00000004:00080000:2.0:1788572336.310480:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c3800, transno 8589935783 00000004:00080000:2.0:1788572336.310482:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c2300, transno 8589935784 00000004:00080000:2.0:1788572336.310485:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d952a00, transno 8589935785 00000004:00080000:2.0:1788572336.310488:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552d500, transno 8589935786 00000004:00080000:2.0:1788572336.310490:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d950380, transno 8589935787 00000004:00080000:2.0:1788572336.310492:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552f480, transno 8589935788 00000004:00080000:2.0:1788572336.310495:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552ed80, transno 8589935789 00000004:00080000:2.0:1788572336.310497:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552d180, transno 8589935790 00000004:00080000:2.0:1788572336.310499:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552e680, transno 8589935791 00000004:00080000:2.0:1788572336.310501:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d950e00, transno 8589935792 00000004:00080000:2.0:1788572336.310503:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552c000, transno 8589935793 00000004:00080000:2.0:1788572336.310505:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552dc00, transno 8589935794 00000004:00080000:2.0:1788572336.310508:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e570a80, transno 8589935795 00000004:00080000:2.0:1788572336.310510:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d950a80, transno 8589935796 00000004:00080000:2.0:1788572336.310513:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552ca80, transno 8589935797 00000004:00080000:2.0:1788572336.310515:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50552c380, transno 8589935798 00000004:00080000:2.0:1788572336.310517:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e572a00, transno 8589935799 00000004:00080000:2.0:1788572336.310520:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641107b80, transno 8589935800 00000004:00080000:2.0:1788572336.310522:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4700, transno 8589935801 00000004:00080000:2.0:1788572336.310524:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104a80, transno 8589935802 00000004:00080000:2.0:1788572336.310527:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac6680, transno 8589935803 00000004:00080000:2.0:1788572336.310529:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5880, transno 8589935804 00000004:00080000:2.0:1788572336.310532:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5500, transno 8589935805 00000004:00080000:2.0:1788572336.310535:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac6300, transno 8589935806 00000004:00080000:2.0:1788572336.310537:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d3800, transno 8589935807 00000004:00080000:2.0:1788572336.310540:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d0700, transno 8589935808 00000004:00080000:2.0:1788572336.310543:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c000, transno 8589935809 00000004:00080000:2.0:1788572336.310545:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d1c00, transno 8589935810 00000004:00080000:2.0:1788572336.310548:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c380, transno 8589935811 00000004:00080000:2.0:1788572336.310550:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2e680, transno 8589935812 00000004:00080000:2.0:1788572336.310552:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2ce00, transno 8589935813 00000004:00080000:2.0:1788572336.310554:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2ed80, transno 8589935814 00000004:00080000:2.0:1788572336.310557:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d1180, transno 8589935815 00000004:00080000:2.0:1788572336.310559:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d2a00, transno 8589935816 00000004:00080000:2.0:1788572336.310561:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5038c2a00, transno 8589935817 00000004:00080000:2.0:1788572336.310563:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5038c0000, transno 8589935818 00000004:00080000:2.0:1788572336.310566:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f100, transno 8589935819 00000004:00080000:2.0:1788572336.310568:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f800, transno 8589935820 00000004:00080000:2.0:1788572336.310570:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5038c0700, transno 8589935821 00000004:00080000:2.0:1788572336.310572:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5038c0380, transno 8589935822 00000004:00080000:2.0:1788572336.310574:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d880, transno 8589935823 00000004:00080000:2.0:1788572336.310576:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d180, transno 8589935824 00000004:00080000:2.0:1788572336.310579:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d3480, transno 8589935825 00000004:00080000:2.0:1788572336.310581:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5038c3100, transno 8589935826 00000004:00080000:2.0:1788572336.310583:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5180, transno 8589935827 00000004:00080000:2.0:1788572336.310586:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6300, transno 8589935828 00000004:00080000:2.0:1788572336.310588:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4380, transno 8589935829 00000004:00080000:2.0:1788572336.310590:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a7b80, transno 8589935830 00000004:00080000:2.0:1788572336.310604:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6a00, transno 8589935831 00000004:00080000:2.0:1788572336.310607:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4000, transno 8589935832 00000004:00080000:2.0:1788572336.310609:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a7100, transno 8589935833 00000004:00080000:2.0:1788572336.310611:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5f80, transno 8589935834 00000004:00080000:2.0:1788572336.310614:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5c00, transno 8589935835 00000004:00080000:2.0:1788572336.310616:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2df80, transno 8589935836 00000004:00080000:2.0:1788572336.310618:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d500, transno 8589935837 00000004:00080000:2.0:1788572336.310620:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f480, transno 8589935838 00000004:00080000:2.0:1788572336.310623:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767dc00, transno 8589935839 00000004:00080000:2.0:1788572336.310625:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767d180, transno 8589935840 00000004:00080000:2.0:1788572336.310628:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767df80, transno 8589935841 00000004:00080000:2.0:1788572336.310630:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767c380, transno 8589935842 00000004:00080000:2.0:1788572336.310632:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767c700, transno 8589935843 00000004:00080000:2.0:1788572336.310634:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767c000, transno 8589935844 00000004:00080000:2.0:1788572336.310636:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767ed80, transno 8589935845 00000004:00080000:2.0:1788572336.310639:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc12680, transno 8589935846 00000004:00080000:2.0:1788572336.310641:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10700, transno 8589935847 00000004:00080000:2.0:1788572336.310643:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767f100, transno 8589935848 00000004:00080000:2.0:1788572336.310645:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11c00, transno 8589935849 00000004:00080000:2.0:1788572336.310648:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10e00, transno 8589935850 00000004:00080000:2.0:1788572336.310650:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc10380, transno 8589935851 00000004:00080000:2.0:1788572336.310652:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11f80, transno 8589935852 00000004:00080000:2.0:1788572336.310655:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13480, transno 8589935853 00000004:00080000:2.0:1788572336.310658:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641194e00, transno 8589935854 00000004:00080000:2.0:1788572336.310660:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767f800, transno 8589935855 00000004:00080000:2.0:1788572336.310663:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767d500, transno 8589935856 00000004:00080000:2.0:1788572336.310665:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767e680, transno 8589935857 00000004:00080000:2.0:1788572336.310668:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc11500, transno 8589935858 00000004:00080000:2.0:1788572336.310670:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc13800, transno 8589935859 00000004:00080000:2.0:1788572336.310680:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641195500, transno 8589935860 00000004:00080000:2.0:1788572336.310683:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c2680, transno 8589935861 00000004:00080000:2.0:1788572336.310685:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c3100, transno 8589935862 00000004:00080000:2.0:1788572336.310687:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c3480, transno 8589935863 00000004:00080000:2.0:1788572336.310690:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0a80, transno 8589935864 00000004:00080000:2.0:1788572336.310693:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0e00, transno 8589935865 00000004:00080000:2.0:1788572336.310695:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d4000, transno 8589935866 00000004:00080000:2.0:1788572336.310698:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d7480, transno 8589935867 00000004:00080000:2.0:1788572336.310700:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c1880, transno 8589935868 00000004:00080000:2.0:1788572336.310703:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d5f80, transno 8589935869 00000004:00080000:2.0:1788572336.310706:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff4700, transno 8589935870 00000004:00080000:2.0:1788572336.310708:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c3800, transno 8589935871 00000004:00080000:2.0:1788572336.310711:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc45c00, transno 8589935872 00000004:00080000:2.0:1788572336.310713:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d5880, transno 8589935873 00000004:00080000:2.0:1788572336.310715:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b2680, transno 8589935874 00000004:00080000:2.0:1788572336.310719:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778dc00, transno 8589935875 00000004:00080000:2.0:1788572336.310721:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778ed80, transno 8589935876 00000004:00080000:2.0:1788572336.310725:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc8ea00, transno 8589935877 00000004:00080000:2.0:1788572336.310727:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b3800, transno 8589935878 00000004:00080000:2.0:1788572336.310729:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778c000, transno 8589935879 00000004:00080000:2.0:1788572336.310732:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc8ca80, transno 8589935880 00000004:00080000:2.0:1788572336.310734:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0000, transno 8589935881 00000004:00080000:2.0:1788572336.310737:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb2a00, transno 8589935882 00000004:00080000:2.0:1788572336.310739:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b2d80, transno 8589935883 00000004:00080000:2.0:1788572336.310741:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778f100, transno 8589935884 00000004:00080000:2.0:1788572336.310744:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490380, transno 8589935885 00000004:00080000:2.0:1788572336.310746:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618432a00, transno 8589935886 00000004:00080000:2.0:1788572336.310749:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb3480, transno 8589935887 00000004:00080000:2.0:1788572336.310751:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184ed880, transno 8589935888 00000004:00080000:2.0:1788572336.310753:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184efb80, transno 8589935889 00000004:00080000:2.0:1788572336.310756:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc8c700, transno 8589935890 00000004:00080000:2.0:1788572336.310758:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618433b80, transno 8589935891 00000004:00080000:2.0:1788572336.310761:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634beaa00, transno 8589935892 00000004:00080000:2.0:1788572336.310763:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4a80, transno 8589935893 00000004:00080000:2.0:1788572336.310766:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4380, transno 8589935894 00000004:00080000:2.0:1788572336.310768:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184eed80, transno 8589935895 00000004:00080000:2.0:1788572336.310771:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e637b80, transno 8589935896 00000004:00080000:2.0:1788572336.310774:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184ee300, transno 8589935897 00000004:00080000:2.0:1788572336.310776:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac7b80, transno 8589935898 00000004:00080000:2.0:1788572336.310778:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4e00, transno 8589935899 00000004:00080000:2.0:1788572336.310781:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618430e00, transno 8589935900 00000004:00080000:2.0:1788572336.310784:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c0380, transno 8589935901 00000004:00080000:2.0:1788572336.310786:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e636a00, transno 8589935902 00000004:00080000:2.0:1788572336.310789:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b7800, transno 8589935903 00000004:00080000:2.0:1788572336.310792:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173f100, transno 8589935904 00000004:00080000:2.0:1788572336.310795:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5df80, transno 8589935905 00000004:00080000:2.0:1788572336.310798:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b6300, transno 8589935906 00000004:00080000:2.0:1788572336.310800:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173c700, transno 8589935907 00000004:00080000:2.0:1788572336.310803:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5fb80, transno 8589935908 00000004:00080000:2.0:1788572336.310806:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5f480, transno 8589935909 00000004:00080000:2.0:1788572336.310808:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5f100, transno 8589935910 00000004:00080000:2.0:1788572336.310810:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173fb80, transno 8589935911 00000004:00080000:2.0:1788572336.310813:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5c380, transno 8589935912 00000004:00080000:2.0:1788572336.310815:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5d500, transno 8589935913 00000004:00080000:2.0:1788572336.310817:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b7b80, transno 8589935914 00000004:00080000:2.0:1788572336.310819:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173e300, transno 8589935915 00000004:00080000:2.0:1788572336.310822:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5f800, transno 8589935916 00000004:00080000:2.0:1788572336.310824:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5ea00, transno 8589935917 00000004:00080000:2.0:1788572336.310827:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5ca80, transno 8589935918 00000004:00080000:2.0:1788572336.310829:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5d880, transno 8589935919 00000004:00080000:2.0:1788572336.310831:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5e300, transno 8589935920 00000004:00080000:2.0:1788572336.310833:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5d180, transno 8589935921 00000004:00080000:2.0:1788572336.310836:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5dc00, transno 8589935922 00000004:00080000:2.0:1788572336.310838:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5ed80, transno 8589935923 00000004:00080000:2.0:1788572336.310841:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637717800, transno 8589935924 00000004:00080000:2.0:1788572336.310844:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5c700, transno 8589935925 00000004:00080000:2.0:1788572336.310846:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6b800, transno 8589935926 00000004:00080000:2.0:1788572336.310849:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae69180, transno 8589935927 00000004:00080000:2.0:1788572336.310851:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae69f80, transno 8589935928 00000004:00080000:2.0:1788572336.310853:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6bb80, transno 8589935929 00000004:00080000:2.0:1788572336.310856:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae68000, transno 8589935930 00000004:00080000:2.0:1788572336.310859:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae69500, transno 8589935931 00000004:00080000:2.0:1788572336.310861:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779a300, transno 8589935932 00000004:00080000:2.0:1788572336.310864:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5e680, transno 8589935933 00000004:00080000:2.0:1788572336.310867:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5c000, transno 8589935934 00000004:00080000:2.0:1788572336.310870:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6ad80, transno 8589935935 00000004:00080000:2.0:1788572336.310872:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641696a00, transno 8589935936 00000004:00080000:2.0:1788572336.310875:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6a680, transno 8589935937 00000004:00080000:2.0:1788572336.310878:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506552680, transno 8589935938 00000004:00080000:2.0:1788572336.310880:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae68700, transno 8589935939 00000004:00080000:2.0:1788572336.310883:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b28380, transno 8589935940 00000004:00080000:2.0:1788572336.310886:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799880, transno 8589935941 00000004:00080000:2.0:1788572336.310888:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104700, transno 8589935942 00000004:00080000:2.0:1788572336.310891:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff2680, transno 8589935943 00000004:00080000:2.0:1788572336.310893:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff2d80, transno 8589935944 00000004:00080000:2.0:1788572336.310896:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e761880, transno 8589935945 00000004:00080000:2.0:1788572336.310899:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff3800, transno 8589935946 00000004:00080000:2.0:1788572336.310901:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff0000, transno 8589935947 00000004:00080000:2.0:1788572336.310903:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff3100, transno 8589935948 00000004:00080000:2.0:1788572336.310906:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506550700, transno 8589935949 00000004:00080000:2.0:1788572336.310909:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff2a00, transno 8589935950 00000004:00080000:2.0:1788572336.310911:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff1c00, transno 8589935951 00000004:00080000:2.0:1788572336.310913:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b7100, transno 8589935952 00000100:00080000:2.0:1788572336.310920:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1788572336.310931:0:3649:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff94e6412c1c00 x1875449639100288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572352 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.310941:0:3649:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff94e6412c1c00 x1875449639100288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788572352 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.310948:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from RECOVER to FULL 00000004:00080000:2.0:1788572336.310958:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:2.0:1788572336.310961:0:3649:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1788572336.310966:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009dca05cd): req@ffff94e63aeb1180 x1875449639081856/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.310982:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009dca05cd): req@ffff94e6411eb100 x1875449639082368/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.310991:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009dca05cd): req@ffff94e63aeb3800 x1875449639080448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/224 e 0 to 0 dl 1788572325 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.311000:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000017622ac9): req@ffff94e63aeb0a80 x1875449639081984/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.311030:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000017622ac9): req@ffff94e63779b100 x1875449639082496/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.311039:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000017622ac9): req@ffff94e63aeb2300 x1875449639080960/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/224 e 0 to 0 dl 1788572325 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.311048:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000062cb9b0c): req@ffff94e63aeb0700 x1875449639082112/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.311069:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000062cb9b0c): req@ffff94e637592d80 x1875449639082624/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788572336.311077:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000062cb9b0c): req@ffff94e6377d2680 x1875449639082240/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572336.311084:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639100288:0@lo:400:ldlm_lock_repla.0 00000004:00080000:2.0:1788572336.311686:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 16 changes, 8 in progress, 8 in flight, 176 done 00000004:00080000:2.0:1788572336.311733:0:111999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4253332728570ns, next at 4254332726344ns, rc = 0 00000100:00100000:2.0:1788572336.311759:0:111999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:111999:1875449639100800:0@lo:7:osp-pre-0-0.0 00000100:00100000:2.0:1788572336.311823:0:111999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.311855:0:111999:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e60fc81600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572336.311892:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.311929:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.311959:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.311986:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572336.311991:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639100672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572336.312037:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.312078:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639100544 00000100:00100000:3.0:1788572336.312087:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639100544 00000100:00100000:2.0:1788572336.312094:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.312122:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.312143:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639100800 00000100:00100000:3.0:1788572336.312146:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639100800 00000100:00100000:3.0:1788572336.312166:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639081984 00000100:00100000:3.0:1788572336.312168:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639081984 00000100:00100000:3.0:1788572336.312182:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639082496 00000100:00100000:3.0:1788572336.312184:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639082496 00000100:00100000:3.0:1788572336.312197:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639080960 00000100:00100000:3.0:1788572336.312199:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639080960 00000100:00100000:3.0:1788572336.312214:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639082112 00000100:00100000:3.0:1788572336.312216:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639082112 00000100:00100000:3.0:1788572336.312231:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639082624 00000100:00100000:3.0:1788572336.312234:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639082624 00000100:00100000:3.0:1788572336.312254:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00100000:3.0:1788572336.312262:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:8656:x1875449639100544:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788572336.312496:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00100000:1.0:1788572336.312505:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:111999:x1875449639100800:12345-0@lo:7:osp-pre-0-0.0 00002000:00080000:1.0:1788572336.312665:0:8466:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788572336.312670:0:8466:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000401:0xb61:0x0] 00000100:00100000:0.0:1788572336.312825:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00100000:0.0:1788572336.312836:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:0:x1875449639081984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572336.312859:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2645 count 1 00002000:00010000:0.0:1788572336.312946:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572336.312954:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b83352a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.312971:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa55:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:0.0:1788572336.312976:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572336.312982:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b83352a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.312999:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b83352a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.313032:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b83352a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.313039:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b83352a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.313067:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572336.313396:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:111999:x1875449639100800:12345-0@lo:7:osp-pre-0-0.0 Request processed in 891us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572336.313404:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00100000:1.0:1788572336.313434:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:1.0:1788572336.313442:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:0:x1875449639082496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.313456:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2649 count 1 00002000:00010000:1.0:1788572336.313511:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.313517:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83352ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.313532:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa59:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.313536:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.313540:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83352ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.313549:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83352ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.313558:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83352ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.313565:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83352ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.313581:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572336.313661:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:0:x1875449639082496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 220us (1730us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788572336.313668:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00100000:1.0:1788572336.313758:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00100000:1.0:1788572336.313765:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449639080960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.313778:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2643 count 1 00002000:00010000:1.0:1788572336.313825:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.313831:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b83352b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.313844:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa53:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.313848:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.313852:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b83352b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.313863:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b83352b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.313871:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b83352b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.313879:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b83352b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.313895:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572336.313957:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3651:x1875449639080960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 192us (1997us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788572336.313964:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00100000:1.0:1788572336.313977:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00100000:1.0:1788572336.313983:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:0:x1875449639082112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.313995:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2646 count 1 00002000:00010000:1.0:1788572336.314066:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.314072:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83352b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314084:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa56:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.314087:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.314091:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83352b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314100:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83352b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314109:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83352b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314116:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83352b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314132:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788572336.314190:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:0:x1875449639082112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 207us (2095us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788572336.314196:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:1.0:1788572336.314210:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:1.0:1788572336.314217:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:0:x1875449639082624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.314229:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2650 count 1 00002000:00010000:1.0:1788572336.314270:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.314275:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83352c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314287:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5a:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.314289:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.314293:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83352c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314301:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83352c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314309:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83352c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314315:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83352c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314328:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1788572336.314384:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:0:x1875449639082624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 167us (2260us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788572336.314390:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00100000:1.0:1788572336.314454:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.314497:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.314532:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.314567:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639081856 00000100:00100000:1.0:1788572336.314575:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639081856 00000100:00100000:1.0:1788572336.314605:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639082368 00000100:00100000:1.0:1788572336.314608:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639082368 00000100:00100000:1.0:1788572336.314625:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:1.0:1788572336.314631:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:0:x1875449639081856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.314644:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2644 count 1 00002000:00010000:1.0:1788572336.314822:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.314828:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83352c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314837:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa54:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.314840:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.314844:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83352c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314852:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83352c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314860:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83352c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314867:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83352c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.314877:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1788572336.314947:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:0:x1875449639081856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 316us (493us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788572336.314954:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00100000:1.0:1788572336.314980:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:1.0:1788572336.314987:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:0:x1875449639082368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.314998:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2648 count 1 00002000:00010000:1.0:1788572336.315167:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.315172:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b83352ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315181:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa58:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.315184:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.315187:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b83352ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315197:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b83352ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315204:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b83352ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315212:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b83352ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315221:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1788572336.315280:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:0:x1875449639082368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 293us (781us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788572336.315286:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00100000:1.0:1788572336.315342:0:111999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:111999:1875449639100800:0@lo:7:osp-pre-0-0.0 00000004:00080000:1.0:1788572336.315355:0:111999:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x280000401:0xb61:0x0] 00010000:00010000:1.0:1788572336.315375:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788572336.315382:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b83352a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315396:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641281400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.315401:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b83352a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315412:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b83352a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315429:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b83352a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315436:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069eea793/0xdb7edb52b83352a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315455:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788572336.315459:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83352ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315465:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.315469:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83352ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315476:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83352ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315486:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83352ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315494:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009109bce2/0xdb7edb52b83352ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315509:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788572336.315513:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b83352b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315519:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.315522:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b83352b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315529:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b83352b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315539:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b83352b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315547:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b78fd8c/0xdb7edb52b83352b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315559:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788572336.315563:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83352b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315570:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.315573:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83352b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315580:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83352b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315590:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83352b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315605:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d999cbdd/0xdb7edb52b83352b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315617:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572336.315620:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83352c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315627:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.315629:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83352c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315637:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83352c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315646:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83352c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315653:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a625287/0xdb7edb52b83352c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315664:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572336.315667:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83352c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315745:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.315748:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83352c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315756:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83352c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315767:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83352c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315774:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088ffa1cc/0xdb7edb52b83352c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315787:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.315791:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b83352ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315796:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.315799:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b83352ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315811:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b83352ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315821:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b83352ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315828:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e50ced0/0xdb7edb52b83352ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.315839:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.315841:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.315843:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572336.315857:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639100672 00000100:00100000:1.0:1788572336.315862:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639100672 00000100:00100000:1.0:1788572336.315892:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639080448 00000100:00100000:1.0:1788572336.315895:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639080448 00000100:00100000:1.0:1788572336.315911:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:1.0:1788572336.315918:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3651:x1875449639100672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572336.315932:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572336.315969:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3651:x1875449639100672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (3931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572336.315975:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:1.0:1788572336.315993:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:1.0:1788572336.315999:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3650:x1875449639080448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572336.316030:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572336.316065:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3650:x1875449639080448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572336.316071:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000004:00080000:1.0:1788572336.316107:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63aeb1180/2, rc 0, transno 12884901894 00000100:00100000:1.0:1788572336.316118:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:0:1875449639081856:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572336.316128:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6411eb100/2, rc 0, transno 12884901895 00000100:00100000:1.0:1788572336.316131:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6411eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:0:1875449639082368:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.316144:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639080448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572336.316238:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639101056:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572336.316269:0:43964:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00000100:00100000:1.0:1788572336.316270:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1788572336.316274:0:43964:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788572336.316303:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639101056 00000100:00100000:1.0:1788572336.316307:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639101056 00000100:00100000:1.0:1788572336.316329:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:1.0:1788572336.316336:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+13:3652:x1875449639101056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.316351:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2652 count 1 00000100:00100000:3.0:1788572336.316385:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:8656:x1875449639100544:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4122us (8400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572336.316397:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00002000:00010000:1.0:1788572336.316428:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.316434:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b83352d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.316446:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5c:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.316449:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.316455:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b83352d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.316467:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b83352d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.316480:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b83352d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.316487:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b83352d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.316501:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572336.316590:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+14:3652:x1875449639101056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 254us (319us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788572336.316596:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000004:00080000:1.0:1788572336.316640:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3df80/2, rc 0, transno 12884901896 00000100:00100000:1.0:1788572336.316649:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639101056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572336.317041:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:0:x1875449639081984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4205us (5145us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788572336.317049:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00010000:00010000:0.0:1788572336.317162:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.317170:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b83352d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.317178:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637780e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.317182:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b83352d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.317191:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b83352d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.317205:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b83352d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.317213:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e6056b/0xdb7edb52b83352d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.317229:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.317231:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.317233:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.318289:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.318296:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572336.318423:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572336.318443:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639100928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.318494:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.318539:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639100928 00000100:00100000:1.0:1788572336.318545:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639100928 00000100:00100000:1.0:1788572336.318590:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:0.0:1788572336.318701:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572336.318712:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639101184:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572336.318744:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.318795:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3650:x1875449639100928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.318824:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2651 count 1 00000100:00100000:3.0:1788572336.318895:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639101184 00000100:00100000:3.0:1788572336.318900:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639101184 00002000:00010000:1.0:1788572336.318925:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1788572336.318932:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00010000:00010000:1.0:1788572336.318933:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b83352dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572336.318939:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3652:x1875449639101184:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572336.318948:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5b:0x0].0x0 since=4253s v=(0 0) 00002000:00080000:3.0:1788572336.318950:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2653 count 1 00010000:00010000:1.0:1788572336.318953:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.318961:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b83352dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.318974:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b83352dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.318985:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b83352dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.318993:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b83352dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572336.319026:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.319031:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83352e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.319039:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5d:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.319042:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.319046:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83352e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.319067:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83352e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.319075:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83352e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.319087:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83352e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.319106:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788572336.319119:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637592d80/2, rc 0, transno 12884901893 00000100:00100000:2.0:1788572336.319131:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637592d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1875449639082624:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572336.319182:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.319188:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83352e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319197:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.319201:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83352e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319211:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83352e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572336.319215:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3652:x1875449639101184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 277us (471us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788572336.319222:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00010000:00010000:0.0:1788572336.319226:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83352e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319233:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009331b6ea/0xdb7edb52b83352e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572336.319248:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3fb80/2, rc 0, transno 12884901897 00010000:00010000:0.0:1788572336.319250:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.319252:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572336.319253:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639101184:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572336.319254:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.319329:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572336.319399:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3650:x1875449639100928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 607us (905us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1788572336.319405:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000004:00080000:1.0:1788572336.319431:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3d880/2, rc 0, transno 12884901898 00000100:00100000:1.0:1788572336.319436:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639100928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.319468:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572336.319506:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63aeb0700/2, rc 0, transno 12884901892 00000100:00100000:3.0:1788572336.319509:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639082240 00000100:00100000:2.0:1788572336.319511:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1875449639082112:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572336.319513:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639082240 00000100:00100000:2.0:1788572336.319530:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:2.0:1788572336.319537:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+15:0:x1875449639082240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572336.319551:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2647 count 1 00002000:00010000:2.0:1788572336.319614:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.319620:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b83352ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.319629:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa57:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.319633:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.319637:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b83352ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.319647:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b83352ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.319654:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b83352ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.319666:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b83352ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319744:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572336.319749:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b83352dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319756:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637781800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.319759:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b83352dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319768:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b83352dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319779:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b83352dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319786:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096e2070b/0xdb7edb52b83352dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319801:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572336.319804:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b83352ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319810:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1ce00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572336.319812:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b83352ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319824:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b83352ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319833:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b83352ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572336.319840:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.319841:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572336.319843:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.319882:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572336.319959:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639101312:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572336.319988:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572336.320028:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639101312 00000100:00100000:3.0:1788572336.320032:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639101312 00000100:00100000:3.0:1788572336.320068:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:3.0:1788572336.320076:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+16:3650:x1875449639101312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572336.320088:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2654 count 1 00010000:00010000:2.0:1788572336.320131:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788572336.320136:0:43973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbc63ee5/0xdb7edb52b83352ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788572336.320140:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572336.320145:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83352f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.320152:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5e:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:3.0:1788572336.320156:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572336.320160:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83352f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.320169:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83352f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.320177:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83352f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.320184:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83352f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.320198:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572336.320224:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+18:0:x1875449639082240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 688us (755us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788572336.320232:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:2.0:1788572336.320269:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639101440:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.320296:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.320327:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639100672:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788572336.320339:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63aeb0a80/2, rc 0, transno 12884901889 00000100:00100000:2.0:1788572336.320368:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:0:1875449639081984:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572336.320381:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63779b100/2, rc 0, transno 12884901890 00000100:00100000:2.0:1788572336.320384:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:0:1875449639082496:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572336.320392:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63aeb2300/2, rc 0, transno 12884901891 00000100:00100000:2.0:1788572336.320395:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639080960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.320435:0:8656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8656:1875449639100544:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788572336.320450:0:8656:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000004:00080000:2.0:1788572336.320475:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6377d2680/2, rc 0, transno 12884901899 00000100:00100000:2.0:1788572336.320479:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1875449639082240:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572336.320509:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572336.320514:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83352f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.320522:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac81400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572336.320526:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83352f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.320534:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83352f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.320546:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83352f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.320553:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d12fc627/0xdb7edb52b83352f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.320570:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.320572:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.320574:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572336.320771:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639101952:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.320798:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.320816:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572336.320821:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639101824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.320841:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.320865:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639101440 00000100:00100000:1.0:1788572336.320870:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639101440 00000100:00100000:1.0:1788572336.320898:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639101952 00000100:00100000:1.0:1788572336.320901:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639101952 00000100:00100000:1.0:1788572336.320919:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639101824 00000100:00100000:1.0:1788572336.320921:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639101824 00000100:00100000:1.0:1788572336.320940:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:1.0:1788572336.320948:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:3651:x1875449639101440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.320966:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2655 count 1 00002000:00010000:1.0:1788572336.321110:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.321116:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b83352f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321125:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5f:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.321128:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.321132:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b83352f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321143:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b83352f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321151:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b83352f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321157:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b83352f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321172:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572336.321259:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3651:x1875449639101440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 311us (961us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788572336.321267:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:1.0:1788572336.321285:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:1.0:1788572336.321292:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:3651:x1875449639101952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.321305:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2659 count 1 00002000:00010000:1.0:1788572336.321354:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.321359:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f31191d/0xdb7edb52b83352ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321368:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa63:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.321371:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.321375:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f31191d/0xdb7edb52b83352ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321384:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f31191d/0xdb7edb52b83352ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321391:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f31191d/0xdb7edb52b83352ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321398:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f31191d/0xdb7edb52b83352ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321411:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572336.321468:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3651:x1875449639101952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 176us (668us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788572336.321474:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:1.0:1788572336.321487:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:1.0:1788572336.321494:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+20:3651:x1875449639101824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.321504:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2658 count 1 00002000:00010000:1.0:1788572336.321548:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.321553:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8335306 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321560:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa62:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.321562:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.321566:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8335306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321574:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8335306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321581:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8335306 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.321587:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8335306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572336.321704:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639101568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.321736:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.321757:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639102080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.321777:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.321798:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572336.321804:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639101696:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.321824:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.321841:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639102208:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572336.321860:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572336.321887:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639101568 00000100:00100000:2.0:1788572336.321892:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639101568 00000100:00100000:2.0:1788572336.321915:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639102080 00000100:00100000:2.0:1788572336.321918:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639102080 00000100:00100000:2.0:1788572336.321934:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639101696 00000100:00100000:2.0:1788572336.321936:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639101696 00000100:00100000:2.0:1788572336.321952:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639102208 00000100:00100000:2.0:1788572336.321954:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639102208 00000100:00100000:2.0:1788572336.321973:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:2.0:1788572336.321980:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+24:3652:x1875449639101568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572336.321992:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2656 count 1 00002000:00010000:2.0:1788572336.322075:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.322082:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b833530d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322090:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa60:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.322093:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.322097:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b833530d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322106:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b833530d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322115:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b833530d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322122:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b833530d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322137:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788572336.322214:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+25:3652:x1875449639101568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 233us (476us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788572336.322221:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:2.0:1788572336.322236:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:2.0:1788572336.322242:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+24:3652:x1875449639102080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572336.322253:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2660 count 1 00002000:00010000:2.0:1788572336.322298:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.322303:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335314 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322312:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa64:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.322315:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.322319:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322329:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322337:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335314 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322348:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322357:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1788572336.322419:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+25:3652:x1875449639102080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 177us (641us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788572336.322426:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:2.0:1788572336.322439:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:2.0:1788572336.322445:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+24:3652:x1875449639101696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572336.322457:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2657 count 1 00002000:00010000:2.0:1788572336.322500:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.322505:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833531b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322513:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa61:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.322516:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.322520:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833531b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322530:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833531b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322539:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833531b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322552:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833531b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322561:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1788572336.322734:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+25:3652:x1875449639101696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 289us (908us total) trans 12884901905 rc 0/0 00000100:00100000:2.0:1788572336.322741:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:2.0:1788572336.322754:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:2.0:1788572336.322760:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+24:3652:x1875449639102208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572336.322771:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2661 count 1 00002000:00010000:2.0:1788572336.322816:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572336.322821:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335322 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322829:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa65:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:2.0:1788572336.322831:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572336.322835:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322843:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322850:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335322 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322862:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.322871:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1788572336.322931:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+25:3652:x1875449639102208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 170us (1069us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788572336.322937:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000004:00080000:2.0:1788572336.322993:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57dc00/2, rc 0, transno 12884901905 00000100:00100000:2.0:1788572336.323034:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639101696:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572336.323048:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57f100/2, rc 0, transno 12884901906 00000100:00100000:2.0:1788572336.323052:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639102208:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572336.323071:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3ce00/2, rc 0, transno 12884901903 00000100:00100000:2.0:1788572336.323075:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639101568:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572336.323082:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57ce00/2, rc 0, transno 12884901904 00000100:00100000:2.0:1788572336.323085:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639102080:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572336.323100:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788572336.323105:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b83352f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323113:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572336.323118:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b83352f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323135:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b83352f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323153:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b83352f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323161:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001898055a/0xdb7edb52b83352f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323181:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788572336.323185:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f31191d/0xdb7edb52b83352ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323191:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572336.323194:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f31191d/0xdb7edb52b83352ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323201:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f31191d/0xdb7edb52b83352ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323210:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f31191d/0xdb7edb52b83352ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323217:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f31191d/0xdb7edb52b83352ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323232:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572336.323235:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b833530d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323241:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1c400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572336.323244:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b833530d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323251:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b833530d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323260:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b833530d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323267:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000063a5856/0xdb7edb52b833530d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323278:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572336.323281:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323287:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1c000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572336.323290:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335314 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323303:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335314 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323313:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335314 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323320:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d77f4541/0xdb7edb52b8335314 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323333:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572336.323336:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833531b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323344:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1d400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572336.323347:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833531b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323356:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833531b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323366:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833531b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323374:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74aebb4/0xdb7edb52b833531b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323390:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572336.323393:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323400:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e60fa1da00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572336.323403:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335322 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323411:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335322 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323421:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335322 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323427:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070436ed2/0xdb7edb52b8335322 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572336.323438:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.323439:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.323441:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.323691:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572336.323784:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+25:3651:x1875449639101824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2289us (2940us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1788572336.323791:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000004:00080000:1.0:1788572336.323830:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57f480/2, rc 0, transno 12884901907 00000100:00100000:1.0:1788572336.323834:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639101824:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572336.323843:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57c700/2, rc 0, transno 12884901902 00000100:00100000:1.0:1788572336.323847:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639101952:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572336.323855:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3ea00/2, rc 0, transno 12884901901 00000100:00100000:1.0:1788572336.323858:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639101440:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572336.323884:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.323890:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8335306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.323898:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.323902:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8335306 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.323911:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8335306 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.323922:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8335306 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.323930:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8335306 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.323943:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.323945:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.323946:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.323959:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572336.324164:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639102464:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.324197:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.324223:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572336.324228:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639102336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.324248:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.324264:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639102848:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572336.324281:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.324308:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639102464 00000100:00100000:1.0:1788572336.324313:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639102464 00000100:00100000:1.0:1788572336.324342:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639102336 00000100:00100000:1.0:1788572336.324345:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639102336 00000100:00100000:1.0:1788572336.324358:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639102848 00000100:00100000:1.0:1788572336.324360:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639102848 00000100:00100000:1.0:1788572336.324374:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:1.0:1788572336.324382:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449639102464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.324402:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2663 count 1 00002000:00010000:1.0:1788572336.324478:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.324485:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a94370ec/0xdb7edb52b8335329 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324496:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa67:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.324499:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.324504:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a94370ec/0xdb7edb52b8335329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324515:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a94370ec/0xdb7edb52b8335329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324523:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a94370ec/0xdb7edb52b8335329 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324531:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a94370ec/0xdb7edb52b8335329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324545:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572336.324620:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+28:3651:x1875449639102464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 238us (421us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1788572336.324625:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:1.0:1788572336.324639:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:1.0:1788572336.324646:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449639102336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.324657:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2662 count 1 00002000:00010000:1.0:1788572336.324704:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.324710:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8335330 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324718:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa66:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.324722:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.324725:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8335330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324734:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8335330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324742:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8335330 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324755:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8335330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324771:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572336.324831:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+28:3651:x1875449639102336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 185us (581us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788572336.324838:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:1.0:1788572336.324852:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:1.0:1788572336.324858:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449639102848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.324869:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2666 count 1 00002000:00010000:1.0:1788572336.324912:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.324917:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003266f0c7/0xdb7edb52b8335337 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324925:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa6a:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.324928:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.324931:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003266f0c7/0xdb7edb52b8335337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324940:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003266f0c7/0xdb7edb52b8335337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572336.324946:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+27:3650:x1875449639101312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4871us (4956us total) trans 12884901900 rc 0/0 00010000:00010000:1.0:1788572336.324947:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003266f0c7/0xdb7edb52b8335337 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572336.324954:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00010000:00010000:1.0:1788572336.324960:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003266f0c7/0xdb7edb52b8335337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.324968:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788572336.325000:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572336.325021:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a94370ec/0xdb7edb52b8335329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.325029:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.325032:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a94370ec/0xdb7edb52b8335329 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572336.325039:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+27:3651:x1875449639102848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 182us (757us total) trans 12884901910 rc 0/0 00010000:00010000:3.0:1788572336.325041:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a94370ec/0xdb7edb52b8335329 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572336.325046:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00010000:00010000:3.0:1788572336.325066:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a94370ec/0xdb7edb52b8335329 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.325074:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a94370ec/0xdb7edb52b8335329 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.325089:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00080000:1.0:1788572336.325090:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e57d500/2, rc 0, transno 12884901909 00010000:00010000:3.0:1788572336.325092:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8335330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572336.325095:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639102336:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572336.325098:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.325101:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8335330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572336.325103:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a7b80/2, rc 0, transno 12884901910 00000100:00100000:1.0:1788572336.325106:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639102848:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572336.325110:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8335330 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788572336.325113:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a5180/2, rc 0, transno 12884901908 00000100:00100000:1.0:1788572336.325116:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639102464:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572336.325121:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8335330 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.325128:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8335330 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572336.325137:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639102592:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572336.325138:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572336.325141:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003266f0c7/0xdb7edb52b8335337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.325147:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.325150:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003266f0c7/0xdb7edb52b8335337 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572336.325160:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572336.325163:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003266f0c7/0xdb7edb52b8335337 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.325174:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003266f0c7/0xdb7edb52b8335337 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572336.325178:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788572336.325181:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003266f0c7/0xdb7edb52b8335337 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572336.325183:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639102720:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572336.325194:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.325195:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.325197:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572336.325200:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.325219:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639102592 00000100:00100000:1.0:1788572336.325224:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639102592 00000100:00100000:1.0:1788572336.325243:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639102720 00000100:00100000:1.0:1788572336.325245:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639102720 00000100:00100000:1.0:1788572336.325258:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00100000:1.0:1788572336.325263:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3652:x1875449639102592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572336.325277:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2664 count 1 00002000:00010000:1.0:1788572336.325321:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.325326:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071bc60cb/0xdb7edb52b833533e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325335:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa68:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.325338:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.325342:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071bc60cb/0xdb7edb52b833533e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325352:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071bc60cb/0xdb7edb52b833533e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325360:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071bc60cb/0xdb7edb52b833533e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325367:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071bc60cb/0xdb7edb52b833533e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325386:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572336.325439:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572336.325444:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071bc60cb/0xdb7edb52b833533e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572336.325447:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3652:x1875449639102592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 183us (286us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1788572336.325453:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00010000:00010000:3.0:1788572336.325453:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572336.325456:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071bc60cb/0xdb7edb52b833533e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572336.325465:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00010000:00010000:3.0:1788572336.325465:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071bc60cb/0xdb7edb52b833533e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572336.325471:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3652:x1875449639102720:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572336.325476:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071bc60cb/0xdb7edb52b833533e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572336.325481:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2665 count 1 00010000:00010000:3.0:1788572336.325489:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071bc60cb/0xdb7edb52b833533e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572336.325502:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.325504:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572336.325505:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572336.325519:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572336.325524:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8335345 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325531:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa69:0x0].0x0 since=4253s v=(0 0) 00010000:00010000:1.0:1788572336.325534:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572336.325538:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8335345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325546:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8335345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325554:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8335345 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325561:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8335345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325577:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572336.325629:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3652:x1875449639102720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 158us (427us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1788572336.325634:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000004:00080000:1.0:1788572336.325664:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a4380/2, rc 0, transno 12884901912 00000100:00100000:1.0:1788572336.325669:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639102720:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572336.325675:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e5058a6300/2, rc 0, transno 12884901911 00000100:00100000:1.0:1788572336.325678:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639102592:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572336.325689:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572336.325694:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8335345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325701:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572336.325704:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8335345 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325712:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8335345 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325723:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8335345 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325731:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8335345 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572336.325745:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.325747:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.325748:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.325764:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572336.325780:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572336.325873:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572336.325937:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3c700/2, rc 0, transno 12884901900 00000100:00100000:0.0:1788572336.325942:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639101312:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572336.326113:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572336.643225:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639102976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572336.643306:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572336.643402:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639102976 00000100:00100000:1.0:1788572336.643409:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639102976 00000100:00100000:1.0:1788572336.643467:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742 00000100:00100000:1.0:1788572336.643478:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639102976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572336.643515:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572336.643567:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639102976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572336.643577:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742 00000100:00100000:1.0:1788572336.643617:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639102976:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788572336.836210:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572337.069300:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572337.069354:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572337.069386:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572337.069417:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572337.069445:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616093568 00000100:00100000:0.0:1788572337.069455:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616093568 00000100:00100000:0.0:1788572337.069524:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616093440 00000100:00100000:0.0:1788572337.069527:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616093440 00000100:00100000:0.0:1788572337.069556:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4551 00000100:00100000:0.0:1788572337.069567:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616093568:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572337.069639:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616093568:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 74us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572337.069651:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4551 00000100:00100000:0.0:1788572337.069669:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4552 00000100:00100000:0.0:1788572337.069677:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616093440:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572337.069703:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616093440:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572337.069709:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4552 00000100:00080000:0.0:1788572337.069726:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572337.069730:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572337.070276:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616093312 00000100:00100000:1.0:1788572337.070283:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616093312 00000100:00100000:1.0:1788572337.070334:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 145 00000100:00100000:1.0:1788572337.070343:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616093312:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572337.070380:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616093312:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 38us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572337.070386:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 145 00000100:00100000:1.0:1788572337.070421:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616093696 00000100:00100000:1.0:1788572337.070425:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616093696 00000100:00100000:1.0:1788572337.070456:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3702 00000100:00100000:1.0:1788572337.070463:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616093696:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572337.070488:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616093696:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572337.070493:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3702 00000100:00080000:0.0:1788572337.071198:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572337.157904:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639103104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572337.157981:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572337.158222:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639103104 00000100:00100000:2.0:1788572337.158243:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639103104 00000100:00100000:2.0:1788572337.158301:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:2.0:1788572337.158311:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639103104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572337.158340:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572337.158385:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639103104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572337.158392:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00080000:2.0:1788572337.158412:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572337.158452:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639103104:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572337.868532:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572338.701960:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639103232:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.701961:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639103360:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.710915:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.710999:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639103872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.711064:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.711085:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639104384:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.711115:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.711168:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788572338.711177:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639103488:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.711206:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.711227:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639104000:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.711255:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.711275:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639104512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.711300:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.711356:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639103360 00000100:00100000:3.0:1788572338.711364:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639103360 00000100:00100000:3.0:1788572338.711421:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:3.0:1788572338.711432:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639103360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.711499:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639103360:12345-0@lo:400:kworker.0 Request processed in 69us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.711507:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00000100:00100000:3.0:1788572338.711532:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639103872 00000100:00100000:3.0:1788572338.711536:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639103872 00000100:00100000:3.0:1788572338.711576:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639103488 00000100:00100000:3.0:1788572338.711579:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639103488 00000100:00100000:3.0:1788572338.711594:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639104512 00000100:00100000:3.0:1788572338.711597:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639104512 00000100:00100000:3.0:1788572338.711612:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4553 00000100:00100000:3.0:1788572338.711618:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639103872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.711649:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639103872:12345-0@lo:400:kworker.0 Request processed in 31us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.711655:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4553 00000100:00100000:3.0:1788572338.711667:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4554 00000100:00100000:3.0:1788572338.711674:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639103488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.711698:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639103488:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.711704:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4554 00000100:00100000:3.0:1788572338.711715:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4555 00000100:00100000:3.0:1788572338.711720:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639104512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.714058:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639104512:12345-0@lo:400:kworker.0 Request processed in 2326us (2747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.714073:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4555 00000100:00100000:3.0:1788572338.714138:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639104384 00000100:00100000:3.0:1788572338.714148:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639104384 00000100:00100000:3.0:1788572338.714211:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639104000 00000100:00100000:3.0:1788572338.714215:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639104000 00000100:00100000:3.0:1788572338.714241:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703 00000100:00100000:3.0:1788572338.714248:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639104384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.714316:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639104384:12345-0@lo:400:kworker.0 Request processed in 69us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.714323:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703 00000100:00100000:3.0:1788572338.714335:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704 00000100:00100000:3.0:1788572338.714342:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639104000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.714371:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639104000:12345-0@lo:400:kworker.0 Request processed in 31us (3117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.714377:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704 00000100:00100000:3.0:1788572338.714459:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639103488:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.714472:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639104000:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.714486:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639104512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.714498:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639103360:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.714511:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639103872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.714523:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639104384:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.718637:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639103616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.719347:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.719407:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639104128:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.719442:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.719465:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639104640:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.719501:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572338.719562:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639104640 00000100:00100000:3.0:1788572338.719572:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639104640 00000100:00100000:3.0:1788572338.719642:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4556 00000100:00100000:3.0:1788572338.719653:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639104640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.719722:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639104640:12345-0@lo:400:kworker.0 Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572338.719732:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4556 00000100:00100000:3.0:1788572338.719865:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639104640:0@lo:400:kworker.0 00000100:00100000:0.0:1788572338.721655:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639103616 00000100:00100000:0.0:1788572338.721671:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639103616 00000100:00100000:0.0:1788572338.721753:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705 00000100:00100000:0.0:1788572338.721766:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639103616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572338.721874:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639103616:12345-0@lo:400:kworker.0 Request processed in 112us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572338.721881:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705 00000100:00100000:1.0:1788572338.722075:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639104128 00000100:00100000:1.0:1788572338.722081:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639104128 00000100:00100000:1.0:1788572338.722138:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744 00000100:00100000:1.0:1788572338.722146:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639104128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572338.722189:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639104128:12345-0@lo:400:kworker.0 Request processed in 45us (2746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572338.722196:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744 00000100:00100000:3.0:1788572338.722793:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639103616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572338.722812:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639104128:0@lo:400:kworker.0 00000100:00100000:2.0:1788572338.726067:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788572338.726141:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572338.726148:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572338.726152:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572338.726155:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572338.726179:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639103232 00000100:00100000:2.0:1788572338.726189:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639103232 00000100:00100000:2.0:1788572338.726250:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788572338.726261:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639103232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572338.726335:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639103232:12345-0@lo:400:kworker.0 Request processed in 76us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572338.726342:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788572338.726411:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639103232:0@lo:400:kworker.0 00000100:00100000:2.0:1788572338.726423:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639103744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572338.726456:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572338.726484:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639103744 00000100:00100000:2.0:1788572338.726488:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639103744 00000100:00100000:2.0:1788572338.726535:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4557 00000100:00100000:2.0:1788572338.726541:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639103744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572338.726572:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639103744:12345-0@lo:400:kworker.0 Request processed in 31us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572338.726578:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4557 00000100:00080000:2.0:1788572338.726592:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572338.726612:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639103744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572338.726619:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639104256:0@lo:400:kworker.0 00000100:00100000:2.0:1788572338.726645:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572338.726674:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639104768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572338.726701:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572338.726722:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639104768 00000100:00100000:2.0:1788572338.726725:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639104768 00000100:00100000:2.0:1788572338.726758:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4558 00000100:00100000:2.0:1788572338.726764:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639104768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572338.726794:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639104768:12345-0@lo:400:kworker.0 Request processed in 30us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572338.726799:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4558 00000100:00080000:2.0:1788572338.726813:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572338.727088:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639104768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572338.731312:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639104256 00000100:00100000:0.0:1788572338.731336:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639104256 00000100:00100000:0.0:1788572338.731440:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706 00000100:00100000:0.0:1788572338.731451:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3653:x1875449639104256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572338.731546:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3653:x1875449639104256:12345-0@lo:400:kworker.0 Request processed in 97us (4900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572338.731554:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706 00000100:00080000:2.0:1788572338.732969:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572338.733090:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639104256:0@lo:400:kworker.0 00010000:00010000:1.0:1788572338.886964:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572339.907176:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572340.228252:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572340.228279:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639104896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572340.228408:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572340.228471:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639104896 00000100:00100000:3.0:1788572340.228479:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639104896 00000100:00100000:3.0:1788572340.228531:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745 00000100:00100000:3.0:1788572340.228541:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639104896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572340.228584:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572340.228636:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639104896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572340.228643:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745 00000100:00100000:3.0:1788572340.228695:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639104896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572340.739299:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572340.739325:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639105024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572340.739399:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572340.739516:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639105024 00000100:00100000:0.0:1788572340.739525:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639105024 00000100:00100000:0.0:1788572340.739592:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:0.0:1788572340.739604:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639105024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572340.739645:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572340.739694:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639105024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572340.739701:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000100:00100000:0.0:1788572340.739744:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639105024:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788572340.739822:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572340.932400:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572341.407919:0:115132:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788572341.767463:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639105280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572341.767539:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572341.767600:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572341.767607:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639105152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572341.767632:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572341.767666:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639105280 00000100:00100000:2.0:1788572341.767674:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639105280 00000100:00100000:2.0:1788572341.767727:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:2.0:1788572341.767737:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3653:x1875449639105280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572341.767766:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572341.767813:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3653:x1875449639105280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572341.768178:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572341.768192:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639105408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572341.768236:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572341.768743:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639105408 00000100:00100000:0.0:1788572341.768750:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639105408 00000100:00100000:2.0:1788572341.772378:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:2.0:1788572341.772434:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639105152 00000100:00100000:2.0:1788572341.772444:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639105152 00000100:00100000:2.0:1788572341.772540:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746 00000100:00100000:2.0:1788572341.772549:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639105152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572341.772592:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572341.772673:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639105152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (5038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572341.772678:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746 00000100:00080000:2.0:1788572341.772695:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572341.772742:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639105152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572341.772763:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639105280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572341.775713:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:0.0:1788572341.775733:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639105408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572341.775762:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572341.776144:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639105408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 417us (7905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572341.776152:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00000001:00080000:2.0:1788572341.777663:0:114775:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901912 is committed 00000100:00100000:3.0:1788572341.784193:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639105408:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1788572341.784966:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 22 committed 00010000:00010000:1.0:1788572341.955256:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572342.186167:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572342.186204:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572342.186236:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572342.186265:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572342.186356:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616094208 00000100:00100000:1.0:1788572342.186369:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616094208 00000100:00100000:1.0:1788572342.186443:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3707 00000100:00100000:1.0:1788572342.186454:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616094208:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572342.186597:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616094208:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 145us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572342.186605:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3707 00000100:00100000:3.0:1788572342.186692:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616093824 00000100:00100000:3.0:1788572342.186698:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616093824 00000100:00100000:3.0:1788572342.186741:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 147 00000100:00100000:3.0:1788572342.186749:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616093824:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572342.186776:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616093824:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572342.186782:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 147 00000100:00100000:3.0:1788572342.186810:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616094080 00000100:00100000:3.0:1788572342.186813:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616094080 00000100:00100000:3.0:1788572342.186858:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616093952 00000100:00100000:3.0:1788572342.186861:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616093952 00000100:00100000:3.0:1788572342.186886:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4559 00000100:00100000:3.0:1788572342.186893:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616094080:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572342.186921:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616094080:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572342.186928:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4559 00000100:00100000:3.0:1788572342.186941:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4560 00000100:00100000:3.0:1788572342.186948:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616093952:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572342.186971:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616093952:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572342.186977:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4560 00000100:00080000:0.0:1788572342.187157:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572342.187161:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572342.187164:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572342.289768:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572342.289791:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639105536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572342.289869:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572342.290066:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639105536 00000100:00100000:0.0:1788572342.290073:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639105536 00000100:00100000:0.0:1788572342.290128:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:0.0:1788572342.290138:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639105536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572342.290170:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572342.290212:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639105536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572342.290229:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00000100:00100000:0.0:1788572342.290271:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639105536:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788572342.290340:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000004:0.0:1788572342.609886:0:115185:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788572342.610207:0:115185:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788572342.982205:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788572343.767794:0:115235:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788572343.769209:0:115235:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788572343.822977:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639105664:0@lo:400:kworker.0 00000100:00100000:3.0:1788572343.823100:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572343.823166:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639106176:0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.825106:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639105664 00000100:00100000:1.0:1788572343.825119:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639105664 00000100:00100000:1.0:1788572343.825185:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788572343.825335:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639105664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.825487:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639105664:12345-0@lo:400:kworker.0 Request processed in 290us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572343.825494:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788572343.827433:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639105920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.827527:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572343.827571:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572343.827576:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639106432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.827608:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572343.827760:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639105920 00000100:00100000:1.0:1788572343.827769:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639105920 00000100:00100000:1.0:1788572343.827814:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639106176 00000100:00100000:1.0:1788572343.827817:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639106176 00000100:00100000:1.0:1788572343.827845:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4561 00000100:00100000:1.0:1788572343.827853:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639105920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.833449:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639106944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.833519:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572343.833566:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572343.833574:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639106048:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.833605:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572343.833633:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639106560:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.833656:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572343.833674:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639107072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.833691:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572343.833729:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639105792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.833752:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572343.833769:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639106304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.833789:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572343.833798:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639106816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.833816:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572343.833846:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639106944 00000100:00100000:2.0:1788572343.833853:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639106944 00000100:00100000:2.0:1788572343.833890:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639107072 00000100:00100000:2.0:1788572343.833894:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639107072 00000100:00100000:2.0:1788572343.833907:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639106304 00000100:00100000:2.0:1788572343.833910:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639106304 00000100:00100000:2.0:1788572343.833924:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4562 00000100:00100000:2.0:1788572343.833932:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639106176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.833982:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639106176:12345-0@lo:400:kworker.0 Request processed in 51us (6413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572343.833989:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4562 00000100:00100000:2.0:1788572343.834022:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4563 00000100:00100000:2.0:1788572343.834028:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639106944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572343.834773:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639106176:0@lo:400:kworker.0 00000100:00100000:3.0:1788572343.834786:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639106688:0@lo:400:kworker.0 00000100:00100000:3.0:1788572343.834826:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572343.834854:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639107200:0@lo:400:kworker.0 00000100:00100000:3.0:1788572343.836041:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572343.836120:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639105664:0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.837706:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639106432 00000100:00100000:1.0:1788572343.837720:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639106432 00000100:00100000:1.0:1788572343.837774:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639106048 00000100:00100000:1.0:1788572343.837778:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639106048 00000100:00100000:1.0:1788572343.837805:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639106816 00000100:00100000:1.0:1788572343.837808:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639106816 00000100:00100000:1.0:1788572343.837834:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639106688 00000100:00100000:1.0:1788572343.837838:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639106688 00000100:00100000:2.0:1788572343.837838:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639106944:12345-0@lo:400:kworker.0 Request processed in 3804us (4312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572343.837853:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4563 00000100:00100000:1.0:1788572343.837866:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:2.0:1788572343.837886:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639107200 00000100:00100000:2.0:1788572343.837892:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639107200 00000100:00100000:2.0:1788572343.837921:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4564 00000100:00100000:2.0:1788572343.837929:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639107072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.838021:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639107072:12345-0@lo:400:kworker.0 Request processed in 92us (4327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572343.838028:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4564 00000100:00100000:2.0:1788572343.838041:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4565 00000100:00100000:2.0:1788572343.838048:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639106304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.838100:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639106304:12345-0@lo:400:kworker.0 Request processed in 52us (4310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572343.838107:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4565 00000100:00100000:2.0:1788572343.838122:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4566 00000100:00100000:2.0:1788572343.838129:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639107200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.838166:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639107200:12345-0@lo:400:kworker.0 Request processed in 37us (3288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572343.838173:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4566 00000100:00100000:2.0:1788572343.838195:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639106560 00000100:00100000:2.0:1788572343.838200:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639106560 00000100:00100000:2.0:1788572343.838223:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639105792 00000100:00100000:2.0:1788572343.838226:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639105792 00000100:00100000:2.0:1788572343.838245:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747 00000100:00100000:2.0:1788572343.838251:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639106560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.838298:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639106560:12345-0@lo:400:kworker.0 Request processed in 47us (4641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572343.838305:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747 00000100:00100000:2.0:1788572343.838316:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748 00000100:00100000:2.0:1788572343.838322:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639105792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.838348:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639105792:12345-0@lo:400:kworker.0 Request processed in 27us (4596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572343.838353:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748 00000100:00100000:2.0:1788572343.838399:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639107200:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.838436:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639105792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.838449:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639106304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.838477:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639106560:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.838488:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639107072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.838501:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639106944:0@lo:400:kworker.0 00000100:00100000:0.0:1788572343.838819:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:0.0:1788572343.838832:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639106048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572343.838884:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639106048:12345-0@lo:400:kworker.0 Request processed in 58us (5279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572343.838890:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00100000:0.0:1788572343.838903:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:0.0:1788572343.838910:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639106816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572343.838941:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639106816:12345-0@lo:400:kworker.0 Request processed in 32us (5124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572343.838947:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000100:00100000:1.0:1788572343.838956:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639106432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572343.838962:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:0.0:1788572343.838971:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639106688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572343.838995:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639106432:12345-0@lo:400:kworker.0 Request processed in 1121us (11387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572343.839012:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00080000:1.0:1788572343.839036:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572343.839040:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572343.839042:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572343.839044:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572343.839084:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639105920:12345-0@lo:400:kworker.0 Request processed in 11232us (11558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572343.839089:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4561 00000100:00100000:0.0:1788572343.839103:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639106688:12345-0@lo:400:kworker.0 Request processed in 131us (4275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572343.839109:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000100:00100000:2.0:1788572343.839252:0:3652:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901912 gen 2 00000004:00080000:2.0:1788572343.839269:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb0a80, transno 12884901889 00000004:00080000:2.0:1788572343.839287:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779b100, transno 12884901890 00000004:00080000:2.0:1788572343.839290:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb2300, transno 12884901891 00000004:00080000:2.0:1788572343.839295:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb0700, transno 12884901892 00000004:00080000:2.0:1788572343.839297:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637592d80, transno 12884901893 00000004:00080000:2.0:1788572343.839300:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb1180, transno 12884901894 00000004:00080000:2.0:1788572343.839302:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6411eb100, transno 12884901895 00000004:00080000:2.0:1788572343.839305:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3df80, transno 12884901896 00000004:00080000:2.0:1788572343.839307:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3fb80, transno 12884901897 00000004:00080000:2.0:1788572343.839310:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3d880, transno 12884901898 00000004:00080000:2.0:1788572343.839313:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377d2680, transno 12884901899 00000004:00080000:2.0:1788572343.839315:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3c700, transno 12884901900 00000004:00080000:2.0:1788572343.839317:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3ea00, transno 12884901901 00000004:00080000:2.0:1788572343.839320:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57c700, transno 12884901902 00000004:00080000:2.0:1788572343.839322:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3ce00, transno 12884901903 00000004:00080000:2.0:1788572343.839324:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57ce00, transno 12884901904 00000004:00080000:2.0:1788572343.839326:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57dc00, transno 12884901905 00000004:00080000:2.0:1788572343.839328:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57f100, transno 12884901906 00000004:00080000:2.0:1788572343.839330:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57f480, transno 12884901907 00000004:00080000:2.0:1788572343.839334:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5180, transno 12884901908 00000004:00080000:2.0:1788572343.839337:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e57d500, transno 12884901909 00000004:00080000:2.0:1788572343.839342:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a7b80, transno 12884901910 00000004:00080000:2.0:1788572343.839345:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6300, transno 12884901911 00000004:00080000:2.0:1788572343.839347:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4380, transno 12884901912 00000100:00100000:2.0:1788572343.839353:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639106688:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.839395:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639106816:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.839419:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639106048:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.839430:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639105920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572343.839440:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639106432:0@lo:400:kworker.0 00000004:00080000:1.0:1788572343.839693:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 3 in progress, 0 in flight, 21 done 00000004:00080000:1.0:1788572343.839725:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00010000:00010000:1.0:1788572344.006903:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572345.027492:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572345.351413:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639107328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572345.351495:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572345.352584:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639107328 00000100:00100000:3.0:1788572345.352608:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639107328 00000100:00100000:3.0:1788572345.352678:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:3.0:1788572345.352687:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639107328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572345.352726:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572345.352803:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639107328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572345.352810:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 00000100:00100000:0.0:1788572345.352955:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639107328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572345.859423:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572345.859451:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639107456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572345.859538:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572345.859644:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639107456 00000100:00100000:0.0:1788572345.859654:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639107456 00000100:00100000:0.0:1788572345.859733:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:0.0:1788572345.859744:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639107456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572345.859775:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572345.859822:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639107456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572345.859829:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000100:00080000:1.0:1788572345.859903:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572345.860099:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639107456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572346.052403:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572346.884400:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572346.884443:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639107584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572346.884526:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572346.884696:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639107584 00000100:00100000:3.0:1788572346.884705:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639107584 00000100:00100000:3.0:1788572346.884767:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:3.0:1788572346.884778:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639107584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572346.884810:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00080000:1.0:1788572346.884867:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572346.884872:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639107584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572346.884881:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00100000:0.0:1788572346.884956:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639107584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572346.886592:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639107712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572346.886659:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572346.886782:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639107840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572346.886825:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572346.886825:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639107712 00000100:00100000:3.0:1788572346.886842:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639107712 00000100:00100000:3.0:1788572346.886895:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:3.0:1788572346.886916:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639107712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572346.886961:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572346.887034:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639107712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572346.887095:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639107712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572346.891091:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639107840 00000100:00100000:1.0:1788572346.891115:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639107840 00000100:00100000:1.0:1788572346.891239:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:1.0:1788572346.891254:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639107840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572346.891287:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572346.891415:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639107840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (4586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572346.891424:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00100000:1.0:1788572346.891486:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639107840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788572346.896976:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572346.901206:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00010000:00010000:1.0:1788572347.079327:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572347.296047:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572347.296390:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616094336 00000100:00100000:1.0:1788572347.296402:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616094336 00000100:00100000:1.0:1788572347.296475:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:1.0:1788572347.296487:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616094336:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572347.296569:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616094336:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 84us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572347.296576:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 149 00000100:00100000:0.0:1788572347.300875:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572347.300912:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572347.300947:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572347.301038:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616094592 00000100:00100000:2.0:1788572347.301050:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616094592 00000100:00100000:2.0:1788572347.301109:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616094464 00000100:00100000:2.0:1788572347.301111:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616094464 00000100:00100000:2.0:1788572347.301132:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4567 00000100:00100000:2.0:1788572347.301140:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616094592:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572347.301211:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616094592:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 71us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572347.301218:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4567 00000100:00100000:2.0:1788572347.301232:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4568 00000100:00100000:2.0:1788572347.301237:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616094464:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572347.301256:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616094464:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 19us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572347.301262:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4568 00000100:00080000:0.0:1788572347.301314:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572347.301318:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572347.301384:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616094720 00000100:00100000:1.0:1788572347.301389:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616094720 00000100:00100000:1.0:1788572347.301439:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3712 00000100:00100000:1.0:1788572347.301446:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616094720:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572347.301470:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616094720:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572347.301476:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3712 00000100:00080000:0.0:1788572347.301568:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572347.395393:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572347.395431:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639107968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572347.395521:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572347.395909:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639107968 00000100:00100000:0.0:1788572347.395925:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639107968 00000100:00100000:0.0:1788572347.396062:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:0.0:1788572347.396074:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639107968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572347.396105:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572347.396165:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639107968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572347.396174:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00000100:00080000:2.0:1788572347.396277:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572347.396418:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639107968:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572348.099905:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572348.931311:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639108096:0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.931418:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572348.931485:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639108608:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.931496:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639108352:0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.931522:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.931543:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572348.931547:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639109120:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.931572:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639108864:0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.931586:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.931614:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639109120 00000100:00100000:3.0:1788572348.931622:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639109120 00000100:00100000:0.0:1788572348.931629:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639109632:0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.931662:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572348.931684:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788572348.931687:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:0.0:1788572348.931693:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639108480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.931701:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639109120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.931718:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572348.931737:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639108992:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.931760:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639109120:12345-0@lo:400:kworker.0 Request processed in 61us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572348.931768:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.931772:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00100000:0.0:1788572348.931792:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639109504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.931793:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639108480 00000100:00100000:3.0:1788572348.931799:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639108480 00000100:00100000:0.0:1788572348.931825:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.931832:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:3.0:1788572348.931840:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639108480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.931865:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639109120:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.931876:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639108480:12345-0@lo:400:kworker.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572348.931883:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00100000:0.0:1788572348.931892:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639108480:0@lo:400:kworker.0 00000100:00080000:3.0:1788572348.931901:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572348.931921:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639108096 00000100:00100000:0.0:1788572348.931927:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639108096 00000100:00100000:3.0:1788572348.931927:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.931953:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639109376:0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.931963:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788572348.931972:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639108096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.931980:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.932027:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788572348.932036:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639108224:0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.932061:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639108096:12345-0@lo:400:kworker.0 Request processed in 91us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572348.932069:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788572348.932101:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639108608 00000100:00100000:0.0:1788572348.932105:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639108608 00000100:00100000:0.0:1788572348.932140:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639108352 00000100:00100000:0.0:1788572348.932143:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639108352 00000100:00100000:2.0:1788572348.932159:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639109632 00000100:00100000:0.0:1788572348.932160:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639109504 00000100:00100000:0.0:1788572348.932165:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639109504 00000100:00100000:2.0:1788572348.932166:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639109632 00000100:00100000:0.0:1788572348.932182:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639109376 00000100:00100000:0.0:1788572348.932187:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639109376 00000100:00100000:2.0:1788572348.932202:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4569 00000100:00100000:0.0:1788572348.932210:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4570 00000100:00100000:2.0:1788572348.932215:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639108608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.932223:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639108352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.932264:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639108608:12345-0@lo:400:kworker.0 Request processed in 54us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572348.932271:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639108352:12345-0@lo:400:kworker.0 Request processed in 50us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572348.932276:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4569 00000100:00100000:0.0:1788572348.932284:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4570 00000100:00100000:0.0:1788572348.932301:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4571 00000100:00100000:0.0:1788572348.932309:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639109504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.932335:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639109504:12345-0@lo:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572348.932340:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4571 00000100:00100000:0.0:1788572348.932353:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4572 00000100:00100000:0.0:1788572348.932359:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639109632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.932384:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639109632:12345-0@lo:400:kworker.0 Request processed in 27us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572348.932390:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4572 00000100:00100000:0.0:1788572348.932414:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4573 00000100:00100000:0.0:1788572348.932419:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639109376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.932446:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639109376:12345-0@lo:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572348.932453:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4573 00000100:00100000:2.0:1788572348.932458:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639108992 00000100:00100000:2.0:1788572348.932464:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639108992 00000100:00100000:0.0:1788572348.932475:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639108864 00000100:00100000:0.0:1788572348.932481:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639108864 00000100:00100000:2.0:1788572348.932499:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751 00000100:00100000:2.0:1788572348.932508:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639108992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.932515:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:0.0:1788572348.932523:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639108864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.932554:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639108992:12345-0@lo:400:kworker.0 Request processed in 47us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572348.932564:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639108864:12345-0@lo:400:kworker.0 Request processed in 40us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572348.932564:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751 00000100:00100000:0.0:1788572348.932573:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00080000:2.0:1788572348.932602:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572348.932606:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572348.932632:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639108992:0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.932644:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639109504:0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.932653:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639109632:0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.932661:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639108096:0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.932670:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639108608:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.932725:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.932753:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639108736:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.932778:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.932855:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639109248:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.932878:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572348.932900:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639108352:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.932911:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639108864:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.932921:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639109376:0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.932978:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639108224 00000100:00100000:2.0:1788572348.932982:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639108224 00000100:00100000:2.0:1788572348.933029:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752 00000100:00100000:2.0:1788572348.933036:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639108224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.933080:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639108224:12345-0@lo:400:kworker.0 Request processed in 45us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572348.933089:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752 00000100:00100000:2.0:1788572348.933120:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639109248 00000100:00100000:2.0:1788572348.933124:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639109248 00000100:00100000:2.0:1788572348.933150:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:2.0:1788572348.933156:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639109248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572348.933186:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639109248:12345-0@lo:400:kworker.0 Request processed in 30us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572348.933191:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:3.0:1788572348.933260:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639108224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572348.933270:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639109248:0@lo:400:kworker.0 00000100:00080000:3.0:1788572348.933303:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572348.938269:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639108736 00000100:00100000:0.0:1788572348.938284:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639108736 00000100:00100000:0.0:1788572348.938385:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4574 00000100:00100000:0.0:1788572348.938406:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639108736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572348.938511:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639108736:12345-0@lo:400:kworker.0 Request processed in 117us (5731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572348.938518:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4574 00000100:00100000:0.0:1788572348.938583:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639108736:0@lo:400:kworker.0 00000100:00080000:0.0:1788572348.938642:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788572349.124358:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572350.147290:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572350.477297:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572350.477333:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639109760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572350.477452:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572350.477749:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639109760 00000100:00100000:3.0:1788572350.477757:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639109760 00000100:00100000:3.0:1788572350.477827:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00100000:3.0:1788572350.477837:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639109760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572350.477874:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572350.477942:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639109760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572350.477948:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:0.0:1788572350.478347:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639109760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572350.979291:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572350.979313:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639109888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572350.979385:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572350.979474:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639109888 00000100:00100000:1.0:1788572350.979485:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639109888 00000100:00080000:0.0:1788572350.979518:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572350.979553:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:1.0:1788572350.979628:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639109888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572350.979663:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572350.981399:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639109888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1830us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572350.985869:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639109888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572350.993590:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00010000:00010000:3.0:1788572351.181196:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572352.003804:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572352.003833:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639110016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572352.003916:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572352.004276:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572352.004287:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639110144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572352.004332:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572352.004370:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639110144 00000100:00100000:3.0:1788572352.004380:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639110144 00000100:00100000:3.0:1788572352.004426:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:3.0:1788572352.004435:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639110144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572352.004470:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572352.004542:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639110144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572352.004549:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:3.0:1788572352.004609:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639110144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572352.005157:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639110272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572352.005195:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572352.005403:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639110016 00000100:00100000:2.0:1788572352.005409:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639110016 00000100:00100000:2.0:1788572352.005461:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639110272 00000100:00100000:2.0:1788572352.005466:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639110272 00000100:00100000:2.0:1788572352.005495:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:2.0:1788572352.005503:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639110016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572352.005541:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572352.005863:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639110016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 360us (1947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572352.005871:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:2.0:1788572352.005887:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:2.0:1788572352.005893:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639110272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572352.005905:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572352.005932:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639110272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572352.005937:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00080000:0.0:1788572352.006031:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572352.006071:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639110272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572352.006108:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639110016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572352.197851:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572352.422288:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572352.423773:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572352.423820:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572352.423914:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572352.423981:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616095232 00000100:00100000:0.0:1788572352.423992:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616095232 00000100:00100000:0.0:1788572352.424085:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3717 00000100:00100000:0.0:1788572352.424096:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616095232:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572352.424168:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616095232:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 74us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572352.424175:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3717 00000100:00080000:0.0:1788572352.424198:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572352.424671:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616094848 00000100:00100000:2.0:1788572352.424677:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616094848 00000100:00100000:2.0:1788572352.424725:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 151 00000100:00100000:2.0:1788572352.424732:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50330ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616094848:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572352.424773:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50330ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616094848:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 42us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572352.424781:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 151 00000100:00100000:1.0:1788572352.442928:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616094976 00000100:00100000:1.0:1788572352.442945:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616094976 00000100:00080000:2.0:1788572352.443103:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572352.448173:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616095104 00000100:00100000:0.0:1788572352.448191:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616095104 00000100:00100000:0.0:1788572352.448305:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4575 00000100:00080000:2.0:1788572352.448369:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572352.448369:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4576 00000100:00100000:3.0:1788572352.448382:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616095104:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572352.448500:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616095104:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 112us (24576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572352.448509:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4576 00000100:00100000:0.0:1788572352.448756:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2383:x1875449616094976:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572352.448811:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2383:x1875449616094976:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 496us (26532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572352.448818:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4575 00000100:00100000:3.0:1788572352.518052:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639110400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572352.518153:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572352.518322:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639110400 00000100:00100000:2.0:1788572352.518331:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639110400 00000100:00100000:2.0:1788572352.518403:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:2.0:1788572352.518413:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639110400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572352.518458:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572352.518543:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639110400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572352.518550:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:2.0:1788572352.518597:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639110400:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788572352.522867:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572353.221750:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572354.055543:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639110656:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.055613:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.055668:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639111168:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.055695:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.055715:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639111680:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.055741:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.055778:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788572354.055784:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639110528:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.055814:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.055840:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639111040:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.055860:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.055877:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639111552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.055897:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.055912:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639112064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.055949:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.055976:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639110912:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.055999:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.056039:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639111424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056056:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.056076:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639111936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056092:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.056105:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572354.056110:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639110784:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056126:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.056138:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639111296:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056166:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.056179:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639111808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056194:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572354.056218:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639111168 00000100:00100000:0.0:1788572354.056224:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639111168 00000100:00100000:0.0:1788572354.056268:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639111040 00000100:00100000:0.0:1788572354.056271:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639111040 00000100:00100000:0.0:1788572354.056285:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639112064 00000100:00100000:0.0:1788572354.056288:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639112064 00000100:00100000:0.0:1788572354.056300:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639111936 00000100:00100000:0.0:1788572354.056302:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639111936 00000100:00100000:0.0:1788572354.056312:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639110784 00000100:00100000:0.0:1788572354.056315:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639110784 00000100:00100000:0.0:1788572354.056323:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639111808 00000100:00100000:0.0:1788572354.056325:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639111808 00000100:00100000:0.0:1788572354.056338:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4577 00000100:00100000:0.0:1788572354.056347:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639111168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056399:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639111168:12345-0@lo:400:kworker.0 Request processed in 54us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.056406:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4577 00000100:00100000:0.0:1788572354.056421:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4578 00000100:00100000:0.0:1788572354.056427:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639111040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056454:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639111040:12345-0@lo:400:kworker.0 Request processed in 28us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.056459:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4578 00000100:00100000:0.0:1788572354.056469:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4579 00000100:00100000:0.0:1788572354.056474:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639112064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056495:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639112064:12345-0@lo:400:kworker.0 Request processed in 22us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.056501:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4579 00000100:00100000:0.0:1788572354.056511:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4580 00000100:00100000:0.0:1788572354.056516:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639111936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056558:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639111936:12345-0@lo:400:kworker.0 Request processed in 42us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.056564:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4580 00000100:00100000:0.0:1788572354.056574:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4581 00000100:00100000:0.0:1788572354.056579:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639110784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056602:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639110784:12345-0@lo:400:kworker.0 Request processed in 24us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.056608:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4581 00000100:00100000:0.0:1788572354.056618:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4582 00000100:00100000:0.0:1788572354.056624:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639111808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056648:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639111808:12345-0@lo:400:kworker.0 Request processed in 25us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.056653:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4582 00000100:00100000:0.0:1788572354.056671:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639110528 00000100:00100000:0.0:1788572354.056675:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639110528 00000100:00100000:0.0:1788572354.056699:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788572354.056705:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50330d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639110528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056735:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50330d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639110528:12345-0@lo:400:kworker.0 Request processed in 31us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.056741:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788572354.056768:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639111680 00000100:00100000:0.0:1788572354.056771:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639111680 00000100:00100000:0.0:1788572354.056798:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639111552 00000100:00100000:0.0:1788572354.056801:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639111552 00000100:00100000:0.0:1788572354.056816:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639110912 00000100:00100000:0.0:1788572354.056819:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639110912 00000100:00100000:0.0:1788572354.056833:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639111296 00000100:00100000:0.0:1788572354.056837:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639111296 00000100:00100000:0.0:1788572354.056855:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:0.0:1788572354.056862:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639111680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056890:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639111680:12345-0@lo:400:kworker.0 Request processed in 29us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.056897:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00000100:00100000:0.0:1788572354.056907:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:0.0:1788572354.056913:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639111552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056937:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639111552:12345-0@lo:400:kworker.0 Request processed in 25us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.056942:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:00100000:0.0:1788572354.056951:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:0.0:1788572354.056957:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639110912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.056982:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639110912:12345-0@lo:400:kworker.0 Request processed in 26us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.056988:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00100000:0.0:1788572354.056998:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:0.0:1788572354.057026:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639111296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057053:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639111296:12345-0@lo:400:kworker.0 Request processed in 51us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.057058:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00080000:0.0:1788572354.057085:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572354.057089:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572354.057091:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572354.057093:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572354.057133:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639110656 00000100:00100000:0.0:1788572354.057137:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639110656 00000100:00100000:0.0:1788572354.057171:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639111424 00000100:00100000:0.0:1788572354.057175:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639111424 00000100:00100000:0.0:1788572354.057191:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755 00000100:00100000:0.0:1788572354.057197:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639110656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057229:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639110656:12345-0@lo:400:kworker.0 Request processed in 32us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.057234:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755 00000100:00100000:0.0:1788572354.057245:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756 00000100:00100000:0.0:1788572354.057251:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639111424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057276:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639111424:12345-0@lo:400:kworker.0 Request processed in 26us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572354.057282:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756 00000100:00100000:0.0:1788572354.057319:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639110784:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057331:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639111296:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057341:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639111808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057352:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639110912:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057362:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639111424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057372:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639111936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057411:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639110528:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057422:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639111040:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057430:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639111552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057439:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639112064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057450:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639110656:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057460:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639111168:0@lo:400:kworker.0 00000100:00100000:0.0:1788572354.057470:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639111680:0@lo:400:kworker.0 00010000:00010000:2.0:1788572354.249224:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572355.267429:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572355.587620:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572355.587662:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639112192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572355.587743:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572355.587999:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639112192 00000100:00100000:3.0:1788572355.588037:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639112192 00000100:00100000:3.0:1788572355.588094:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757 00000100:00100000:3.0:1788572355.588104:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639112192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572355.588189:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572355.588358:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639112192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 255us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572355.588366:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757 00000100:00100000:1.0:1788572355.592095:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639112192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572356.099230:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572356.099254:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639112320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572356.099367:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572356.099704:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639112320 00000100:00100000:0.0:1788572356.099714:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639112320 00000100:00100000:0.0:1788572356.099786:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:0.0:1788572356.099797:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639112320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572356.099830:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572356.099902:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639112320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572356.099909:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:3.0:1788572356.100045:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639112320:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788572356.100101:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572356.292029:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572357.124318:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572357.124329:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572357.124346:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639112576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572357.124346:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639112448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572357.124475:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572357.124488:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639112704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572357.130561:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572357.130726:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639112448 00000100:00100000:3.0:1788572357.130736:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639112448 00000100:00100000:3.0:1788572357.130829:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758 00000100:00100000:3.0:1788572357.130839:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639112448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572357.130894:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572357.134139:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639112448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3289us (3572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572357.134155:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758 00000100:00100000:3.0:1788572357.134278:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639112448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572357.137763:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572357.139371:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639112704 00000100:00100000:3.0:1788572357.139384:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639112704 00000100:00100000:3.0:1788572357.139459:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873 00000100:00100000:3.0:1788572357.139471:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639112704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572357.139504:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572357.139591:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639112704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572357.139599:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873 00000100:00080000:2.0:1788572357.139740:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572357.139787:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639112704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572357.139836:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572357.141477:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639112576 00000100:00100000:1.0:1788572357.141491:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639112576 00000100:00100000:1.0:1788572357.141662:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:1.0:1788572357.141673:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639112576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572357.141697:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572357.141764:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639112576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572357.141771:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00000100:00100000:0.0:1788572357.145418:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639112576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788572357.146376:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572357.315702:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572357.537239:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572357.537481:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616095360 00000100:00100000:2.0:1788572357.537491:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616095360 00000100:00100000:2.0:1788572357.537554:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 153 00000100:00100000:2.0:1788572357.537566:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50330c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616095360:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572357.537674:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50330c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616095360:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 110us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572357.537681:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 153 00000100:00100000:2.0:1788572357.547053:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572357.547215:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616095616 00000100:00100000:0.0:1788572357.547227:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616095616 00000100:00100000:0.0:1788572357.547317:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4583 00000100:00100000:0.0:1788572357.547328:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616095616:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572357.547412:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616095616:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572357.547419:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4583 00000100:00080000:3.0:1788572357.547588:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572357.577436:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572357.577489:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572357.577592:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616095744 00000100:00100000:1.0:1788572357.577602:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616095744 00000100:00100000:1.0:1788572357.577690:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4037 00000100:00100000:1.0:1788572357.577700:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2382:x1875449616095744:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:1.0:1788572357.577743:0:43966:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b8334d5d 00000100:00080000:1.0:1788572357.577753:0:43966:0:(import.c:65:import_set_state_nolock()) ffff94e64155f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572357.577799:0:43966:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901912 00000100:00100000:1.0:1788572357.578117:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+2:2382:x1875449616095744:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 417us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572357.578126:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4037 00010000:00010000:1.0:1788572357.578149:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572357.583763:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616095488 00000100:00100000:0.0:1788572357.583779:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616095488 00000100:00100000:0.0:1788572357.583861:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4584 00000100:00100000:0.0:1788572357.583887:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616095488:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572357.583978:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616095488:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 99us (6552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572357.583985:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4584 00000100:00080000:3.0:1788572357.584312:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572357.584318:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572357.635593:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639112832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572357.635676:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572357.636182:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639112832 00000100:00100000:0.0:1788572357.636191:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639112832 00000100:00100000:0.0:1788572357.636272:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875 00000100:00100000:0.0:1788572357.636282:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639112832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572357.636307:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572357.636376:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639112832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572357.636383:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875 00000100:00100000:2.0:1788572357.636517:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639112832:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572357.636752:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572358.340143:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572359.175345:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639113216:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.175413:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572359.175469:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639113728:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.175491:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572359.175504:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639114240:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.175519:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572359.175544:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788572359.175550:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639113088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.175569:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572359.175585:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639113600:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.175601:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572359.175613:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639114112:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.175629:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572359.175653:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639113216 00000100:00100000:0.0:1788572359.175659:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639113216 00000100:00100000:0.0:1788572359.175712:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639114240 00000100:00100000:0.0:1788572359.175715:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639114240 00000100:00100000:0.0:1788572359.175728:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639113600 00000100:00100000:0.0:1788572359.175731:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639113600 00000100:00100000:0.0:1788572359.175752:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4585 00000100:00100000:0.0:1788572359.175769:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639113216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.175814:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639113216:12345-0@lo:400:kworker.0 Request processed in 55us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572359.175821:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4585 00000100:00100000:0.0:1788572359.175836:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4586 00000100:00100000:0.0:1788572359.175841:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639114240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.175861:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639114240:12345-0@lo:400:kworker.0 Request processed in 21us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572359.175867:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4586 00000100:00100000:0.0:1788572359.175875:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4587 00000100:00100000:0.0:1788572359.175881:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639113600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.175899:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639113600:12345-0@lo:400:kworker.0 Request processed in 19us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572359.175904:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4587 00000100:00100000:0.0:1788572359.175924:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639113728 00000100:00100000:0.0:1788572359.175927:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639113728 00000100:00100000:0.0:1788572359.175950:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639114112 00000100:00100000:0.0:1788572359.175954:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639114112 00000100:00100000:0.0:1788572359.175970:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:0.0:1788572359.175975:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639113728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.176001:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639113728:12345-0@lo:400:kworker.0 Request processed in 26us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572359.176028:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00000100:00100000:0.0:1788572359.176038:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:0.0:1788572359.176043:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639114112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.176069:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639114112:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572359.176075:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00100000:0.0:1788572359.176118:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639113600:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.176129:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639114112:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.176137:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639113216:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.176145:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639113728:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.176152:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639114240:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.176595:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639112960:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.176633:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572359.176678:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639113472:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.176701:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572359.176725:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639113984:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.176743:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572359.176764:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639114496:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.176783:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572359.176802:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788572359.176807:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639113344:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.176827:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572359.176838:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639113856:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.176855:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572359.176870:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639114368:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.176885:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572359.176910:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639113088 00000100:00100000:2.0:1788572359.176915:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639113088 00000100:00100000:2.0:1788572359.176942:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639113856 00000100:00100000:2.0:1788572359.176945:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639113856 00000100:00100000:2.0:1788572359.176962:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759 00000100:00100000:2.0:1788572359.176968:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639113088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.177056:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639113088:12345-0@lo:400:kworker.0 Request processed in 88us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572359.177062:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759 00000100:00100000:2.0:1788572359.177076:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760 00000100:00100000:2.0:1788572359.177082:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639113856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.177114:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639113856:12345-0@lo:400:kworker.0 Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572359.177119:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760 00000100:00100000:2.0:1788572359.177135:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639113472 00000100:00100000:2.0:1788572359.177139:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639113472 00000100:00100000:2.0:1788572359.177162:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639114496 00000100:00100000:2.0:1788572359.177165:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639114496 00000100:00100000:2.0:1788572359.177180:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639114368 00000100:00100000:2.0:1788572359.177183:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639114368 00000100:00100000:2.0:1788572359.177199:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4588 00000100:00100000:2.0:1788572359.177205:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639113472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.177232:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639113472:12345-0@lo:400:kworker.0 Request processed in 28us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572359.177241:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4588 00000100:00100000:2.0:1788572359.177253:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4589 00000100:00100000:2.0:1788572359.177259:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639114496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.177286:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639114496:12345-0@lo:400:kworker.0 Request processed in 27us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572359.177292:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4589 00000100:00100000:2.0:1788572359.177302:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4590 00000100:00100000:2.0:1788572359.177308:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639114368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.177333:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639114368:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572359.177339:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4590 00000100:00100000:2.0:1788572359.177381:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639113088:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.177406:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639113856:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.177416:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639114368:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.177425:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639113472:0@lo:400:kworker.0 00000100:00100000:2.0:1788572359.177433:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639114496:0@lo:400:kworker.0 00000100:00100000:3.0:1788572359.178967:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639113984 00000100:00100000:3.0:1788572359.178982:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639113984 00000100:00100000:3.0:1788572359.179091:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639113344 00000100:00100000:3.0:1788572359.179095:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639113344 00000100:00100000:3.0:1788572359.179127:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:3.0:1788572359.179135:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639113984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572359.179215:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639113984:12345-0@lo:400:kworker.0 Request processed in 82us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572359.179224:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000100:00100000:3.0:1788572359.179238:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:3.0:1788572359.179243:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c5d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639113344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572359.179266:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c5d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639113344:12345-0@lo:400:kworker.0 Request processed in 24us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572359.179271:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00000100:00080000:3.0:1788572359.179459:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572359.179463:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572359.179467:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572359.179470:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572359.179519:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639113344:0@lo:400:kworker.0 00000100:00100000:3.0:1788572359.179534:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639113984:0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.182911:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639112960 00000100:00100000:0.0:1788572359.182929:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639112960 00000100:00100000:0.0:1788572359.183073:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788572359.183085:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50330f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639112960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572359.183203:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50330f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639112960:12345-0@lo:400:kworker.0 Request processed in 121us (6569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572359.183211:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788572359.184989:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639112960:0@lo:400:kworker.0 00010000:00010000:2.0:1788572359.369158:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572360.387258:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572360.707348:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639114624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572360.707422:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572360.707684:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639114624 00000100:00100000:3.0:1788572360.707693:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639114624 00000100:00100000:3.0:1788572360.707762:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761 00000100:00100000:3.0:1788572360.707772:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639114624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572360.707806:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572360.707872:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639114624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572360.707879:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761 00000100:00100000:2.0:1788572360.708197:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639114624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572361.220337:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639114752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572361.220427:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572361.220646:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639114752 00000100:00100000:0.0:1788572361.220655:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639114752 00000100:00100000:0.0:1788572361.220728:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:0.0:1788572361.220738:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639114752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572361.220779:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572361.220835:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639114752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572361.220842:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:0.0:1788572361.220888:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639114752:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788572361.221065:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572361.412603:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572362.244493:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639114880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572362.244916:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572362.245063:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572362.245074:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639115008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572362.245107:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572362.245190:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639115008 00000100:00100000:1.0:1788572362.245199:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639115008 00000100:00100000:1.0:1788572362.245256:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762 00000100:00100000:1.0:1788572362.245265:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639115008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572362.245307:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572362.245399:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639115008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572362.245407:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762 00000100:00100000:3.0:1788572362.245749:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639115008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572362.246881:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639114880 00000100:00100000:0.0:1788572362.246891:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639114880 00000100:00100000:0.0:1788572362.246960:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:0.0:1788572362.246971:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639114880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572362.246999:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572362.247085:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639114880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572362.247093:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:0.0:1788572362.247119:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572362.247133:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639115136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572362.247175:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572362.247211:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639115136 00000100:00100000:0.0:1788572362.247215:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639115136 00000100:00100000:0.0:1788572362.247240:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:0.0:1788572362.247247:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639115136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572362.247258:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572362.247288:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639115136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572362.247295:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000100:00100000:0.0:1788572362.247347:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639115136:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788572362.247422:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572362.247660:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639114880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572362.435697:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572362.657144:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572362.657199:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572362.657251:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572362.657420:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616095872 00000100:00100000:2.0:1788572362.657431:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616095872 00000100:00100000:2.0:1788572362.657528:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 155 00000100:00100000:2.0:1788572362.657543:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50330c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616095872:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572362.657636:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50330c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616095872:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 96us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572362.657646:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 155 00000100:00100000:2.0:1788572362.657700:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616096128 00000100:00100000:2.0:1788572362.657707:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616096128 00000100:00100000:2.0:1788572362.657767:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616096000 00000100:00100000:2.0:1788572362.657771:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616096000 00000100:00100000:2.0:1788572362.657794:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4591 00000100:00100000:2.0:1788572362.657801:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616096128:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572362.657850:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616096128:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 47us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572362.657858:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4591 00000100:00100000:2.0:1788572362.657878:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4592 00000100:00100000:2.0:1788572362.657888:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2383:x1875449616096000:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572362.657927:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2383:x1875449616096000:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 40us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572362.657935:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4592 00000100:00080000:1.0:1788572362.658346:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572362.658351:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572362.755900:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639115264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572362.755991:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572362.756148:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639115264 00000100:00100000:0.0:1788572362.756158:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639115264 00000100:00100000:0.0:1788572362.756220:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879 00000100:00100000:0.0:1788572362.756229:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639115264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572362.756252:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572362.756301:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639115264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572362.756308:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000100:00080000:1.0:1788572362.756380:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572362.756415:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639115264:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1788572362.763916:0:114775:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000020:00000080:3.0:1788572362.763927:0:114775:0:(genops.c:885:class_export_put()) final put ffff94e62d804800/35eb2d60-2de0-4b00-9815-d5153edd0057 00000020:00000080:2.0:1788572362.764067:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e62d804800/35eb2d60-2de0-4b00-9815-d5153edd0057 for lustre-OST0000 00000020:00000080:2.0:1788572362.769713:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e64155f000 for lustre-OST0000 00010000:00010000:2.0:1788572363.459480:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572364.291610:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639115392:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.291674:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572364.291720:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639115904:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.291738:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572364.291749:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639116416:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.291762:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572364.291782:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639116928:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.291797:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572364.291811:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572364.291823:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639115520:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.291840:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572364.291867:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639116032:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.291888:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572364.291901:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639116544:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.291916:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572364.291938:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639115520 00000100:00100000:3.0:1788572364.291944:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639115520 00000100:00100000:3.0:1788572364.291987:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763 00000100:00100000:3.0:1788572364.291994:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639115520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.292052:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639115520:12345-0@lo:400:kworker.0 Request processed in 58us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572364.292057:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763 00000100:00100000:3.0:1788572364.292095:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639115520:0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292256:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639115648:0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292287:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572364.292311:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639116160:0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292325:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572364.292334:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639116672:0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292344:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572364.292356:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572364.292360:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639115776:0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292371:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572364.292378:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639116288:0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292389:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572364.292403:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639116800:0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292425:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572364.292448:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639115904 00000100:00100000:1.0:1788572364.292453:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639115904 00000100:00100000:1.0:1788572364.292479:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639116928 00000100:00100000:1.0:1788572364.292481:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639116928 00000100:00100000:1.0:1788572364.292489:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639116032 00000100:00100000:1.0:1788572364.292490:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639116032 00000100:00100000:1.0:1788572364.292498:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639115648 00000100:00100000:1.0:1788572364.292500:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639115648 00000100:00100000:1.0:1788572364.292505:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639116672 00000100:00100000:1.0:1788572364.292506:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639116672 00000100:00100000:1.0:1788572364.292512:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639116800 00000100:00100000:1.0:1788572364.292513:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639116800 00000100:00100000:1.0:1788572364.292523:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4593 00000100:00100000:1.0:1788572364.292527:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639115904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292551:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639115904:12345-0@lo:400:kworker.0 Request processed in 24us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572364.292555:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4593 00000100:00100000:1.0:1788572364.292571:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4594 00000100:00100000:1.0:1788572364.292574:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639116928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292588:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639116928:12345-0@lo:400:kworker.0 Request processed in 15us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572364.292592:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4594 00000100:00100000:1.0:1788572364.292598:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4595 00000100:00100000:1.0:1788572364.292601:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639116032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292614:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639116032:12345-0@lo:400:kworker.0 Request processed in 13us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572364.292617:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4595 00000100:00100000:1.0:1788572364.292623:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4596 00000100:00100000:1.0:1788572364.292626:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6411eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639115648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292641:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6411eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639115648:12345-0@lo:400:kworker.0 Request processed in 15us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572364.292644:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4596 00000100:00100000:1.0:1788572364.292650:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4597 00000100:00100000:1.0:1788572364.292653:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639116672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292666:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639116672:12345-0@lo:400:kworker.0 Request processed in 13us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572364.292670:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4597 00000100:00100000:1.0:1788572364.292675:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4598 00000100:00100000:1.0:1788572364.292679:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639116800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292690:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639116800:12345-0@lo:400:kworker.0 Request processed in 12us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572364.292693:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4598 00000100:00100000:1.0:1788572364.292706:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639116288 00000100:00100000:1.0:1788572364.292708:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639116288 00000100:00100000:1.0:1788572364.292721:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:1.0:1788572364.292724:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639116288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292753:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639116288:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572364.292757:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000100:00080000:1.0:1788572364.292777:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572364.292781:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572364.292801:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639116288:0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292816:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639116800:0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292826:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639115648:0@lo:400:kworker.0 00000100:00100000:1.0:1788572364.292833:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639116672:0@lo:400:kworker.0 00000100:00100000:2.0:1788572364.292858:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639115392 00000100:00100000:2.0:1788572364.292863:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639115392 00000100:00100000:2.0:1788572364.292891:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788572364.292898:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50330f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639115392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572364.292934:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50330f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639115392:12345-0@lo:400:kworker.0 Request processed in 37us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572364.292940:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788572364.293080:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639116032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572364.293085:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639116416 00000100:00100000:0.0:1788572364.293089:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639116416 00000100:00100000:3.0:1788572364.293090:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639115392:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.293098:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639115904:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.293108:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639116928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572364.293140:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639116544 00000100:00100000:3.0:1788572364.293143:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639116160 00000100:00100000:0.0:1788572364.293144:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639116544 00000100:00100000:3.0:1788572364.293145:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639116160 00000100:00100000:0.0:1788572364.293164:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639115776 00000100:00100000:0.0:1788572364.293166:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639115776 00000100:00080000:2.0:1788572364.293203:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572364.293206:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572364.293242:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1788572364.293250:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639116416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.293287:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639116416:12345-0@lo:400:kworker.0 Request processed in 39us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572364.293294:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1788572364.293305:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:3.0:1788572364.293311:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639116544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.293337:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639116544:12345-0@lo:400:kworker.0 Request processed in 26us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572364.293343:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00100000:3.0:1788572364.293353:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:3.0:1788572364.293359:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639116160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.293388:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639116160:12345-0@lo:400:kworker.0 Request processed in 30us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572364.293394:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00100000:3.0:1788572364.293406:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:3.0:1788572364.293417:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639115776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.293445:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639115776:12345-0@lo:400:kworker.0 Request processed in 34us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572364.293449:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00000100:00100000:3.0:1788572364.293479:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639116544:0@lo:400:kworker.0 00000100:00100000:3.0:1788572364.293489:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639116416:0@lo:400:kworker.0 00000100:00100000:0.0:1788572364.295046:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639115776:0@lo:400:kworker.0 00000100:00100000:0.0:1788572364.295267:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639116160:0@lo:400:kworker.0 00010000:00010000:2.0:1788572364.483807:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572365.507306:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572365.831715:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572365.831751:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639117056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572365.831837:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572365.831985:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639117056 00000100:00100000:3.0:1788572365.831995:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639117056 00000100:00100000:3.0:1788572365.832084:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00100000:3.0:1788572365.832094:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639117056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572365.832132:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572365.832197:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639117056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572365.832203:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000100:00100000:2.0:1788572365.832297:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639117056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572366.339549:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572366.339589:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639117184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572366.339685:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572366.339987:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639117184 00000100:00100000:0.0:1788572366.339996:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639117184 00000100:00100000:0.0:1788572366.340101:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880 00000100:00100000:0.0:1788572366.340113:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639117184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572366.340154:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572366.340209:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639117184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572366.340217:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880 00000100:00100000:0.0:1788572366.340268:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639117184:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788572366.340575:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572366.532328:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572367.363407:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639117312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572367.363491:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572367.363722:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639117312 00000100:00100000:3.0:1788572367.363732:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639117312 00000100:00100000:3.0:1788572367.363796:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:3.0:1788572367.363808:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639117312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572367.363858:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572367.363915:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639117312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572367.363922:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00000100:00100000:0.0:1788572367.364055:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572367.364066:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639117440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572367.364097:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572367.364132:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639117440 00000100:00100000:0.0:1788572367.364136:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639117440 00000100:00100000:0.0:1788572367.364181:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:0.0:1788572367.364187:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639117440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572367.364199:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572367.364231:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639117440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572367.364237:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:0.0:1788572367.364286:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639117440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572367.364317:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639117312:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572367.364380:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572367.364559:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639117568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572367.364590:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572367.364662:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639117568 00000100:00100000:2.0:1788572367.364666:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639117568 00000100:00100000:2.0:1788572367.364707:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766 00000100:00100000:2.0:1788572367.364713:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639117568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572367.364738:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572367.364791:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639117568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572367.364798:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766 00000100:00100000:1.0:1788572367.364879:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639117568:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788572367.555399:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572367.781321:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572367.781378:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572367.781413:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572367.781446:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616096512 00000100:00100000:1.0:1788572367.781455:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616096512 00000100:00100000:1.0:1788572367.781514:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616096384 00000100:00100000:1.0:1788572367.781517:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616096384 00000100:00100000:1.0:1788572367.781541:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4599 00000100:00100000:1.0:1788572367.781551:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616096512:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572367.781622:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616096512:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 72us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572367.781629:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4599 00000100:00100000:1.0:1788572367.781647:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4600 00000100:00100000:1.0:1788572367.781654:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616096384:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572367.781696:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616096384:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 42us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572367.781703:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4600 00000100:00080000:1.0:1788572367.781719:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572367.781724:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572367.782077:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616096256 00000100:00100000:2.0:1788572367.782082:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616096256 00000100:00100000:2.0:1788572367.782123:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 157 00000100:00100000:2.0:1788572367.782131:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616096256:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572367.782176:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616096256:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 46us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572367.782186:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 157 00000100:00100000:1.0:1788572367.889589:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572367.889613:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639117696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572367.889703:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572367.889878:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639117696 00000100:00100000:3.0:1788572367.889886:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639117696 00000100:00100000:3.0:1788572367.889952:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1788572367.889962:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639117696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572367.889984:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572367.890061:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639117696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572367.890068:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1788572367.890115:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639117696:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572367.890350:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572368.579344:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572369.411671:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639118080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.411761:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.412034:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639117952:0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.412071:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.412110:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639117952 00000100:00100000:0.0:1788572369.412118:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639117952 00000100:00100000:1.0:1788572369.412214:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639118592:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.412242:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572369.412262:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639119104:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.412283:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572369.412334:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639118208:0@lo:400:kworker.0 00000100:00100000:2.0:1788572369.412367:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572369.412444:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639117824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572369.412477:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.423340:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767 00000100:00100000:0.0:1788572369.423370:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639117952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.423459:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639117952:12345-0@lo:400:kworker.0 Request processed in 105us (11388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572369.423465:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767 00000100:00100000:1.0:1788572369.423648:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639118592 00000100:00100000:1.0:1788572369.423658:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639118592 00000100:00100000:1.0:1788572369.423699:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639118208 00000100:00100000:1.0:1788572369.423701:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639118208 00000100:00100000:1.0:1788572369.423733:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:1.0:1788572369.423741:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639118592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.423782:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639118592:12345-0@lo:400:kworker.0 Request processed in 43us (11540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.423786:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:1.0:1788572369.423796:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:1.0:1788572369.423801:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639118208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.423843:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639118208:12345-0@lo:400:kworker.0 Request processed in 42us (11475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.423850:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000100:00080000:1.0:1788572369.423868:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572369.423885:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572369.423922:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639118592:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.423988:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639118080 00000100:00100000:1.0:1788572369.423993:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639118080 00000100:00100000:1.0:1788572369.424344:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639119104 00000100:00100000:1.0:1788572369.424349:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639119104 00000100:00100000:1.0:1788572369.424370:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4601 00000100:00100000:1.0:1788572369.424376:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639118080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.424424:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639118080:12345-0@lo:400:kworker.0 Request processed in 48us (12665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.424430:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4601 00000100:00100000:1.0:1788572369.424442:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4602 00000100:00100000:1.0:1788572369.424448:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639119104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.424474:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639119104:12345-0@lo:400:kworker.0 Request processed in 26us (12190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.424480:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4602 00000100:00100000:1.0:1788572369.424519:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639118080:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.424536:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639119104:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.424673:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639117824 00000100:00100000:1.0:1788572369.424678:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639117824 00000100:00100000:1.0:1788572369.424891:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788572369.424900:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639117824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.424939:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639117824:12345-0@lo:400:kworker.0 Request processed in 40us (12461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.424944:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788572369.427679:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639117952:0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.427697:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639118464:0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.427787:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.427837:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639118976:0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.427865:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.427950:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639118976 00000100:00100000:0.0:1788572369.427957:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639118976 00000100:00100000:0.0:1788572369.428039:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:0.0:1788572369.428049:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639118976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572369.428105:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639118976:12345-0@lo:400:kworker.0 Request processed in 58us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572369.428113:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00080000:0.0:1788572369.428134:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572369.428161:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639118976:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.428462:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639118464 00000100:00100000:1.0:1788572369.428467:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639118464 00000100:00100000:3.0:1788572369.428472:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639117824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572369.428481:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639118336:0@lo:400:kworker.0 00000100:00100000:3.0:1788572369.428509:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572369.428519:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639118336 00000100:00100000:1.0:1788572369.428522:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639118336 00000100:00100000:3.0:1788572369.428532:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639118848:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.428544:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4603 00000100:00100000:1.0:1788572369.428550:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639118464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572369.428554:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572369.428572:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639119360:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.428586:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639118464:12345-0@lo:400:kworker.0 Request processed in 37us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.428596:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4603 00000100:00100000:3.0:1788572369.428605:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788572369.428644:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572369.428647:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572369.428724:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639118208:0@lo:400:kworker.0 00000100:00100000:2.0:1788572369.428732:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639118720:0@lo:400:kworker.0 00000100:00100000:2.0:1788572369.428760:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572369.428787:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639118720 00000100:00100000:2.0:1788572369.428791:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639118720 00000100:00100000:2.0:1788572369.428834:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768 00000100:00100000:2.0:1788572369.428840:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639118720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572369.428884:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639118720:12345-0@lo:400:kworker.0 Request processed in 33us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572369.428890:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768 00000100:00100000:2.0:1788572369.428916:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639118720:0@lo:400:kworker.0 00000100:00100000:2.0:1788572369.428922:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639119232:0@lo:400:kworker.0 00000100:00100000:2.0:1788572369.428944:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572369.428973:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639118464:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.431399:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639119360 00000100:00100000:1.0:1788572369.431413:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639119360 00000100:00100000:1.0:1788572369.431518:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4604 00000100:00100000:1.0:1788572369.431529:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639118336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.431628:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639118336:12345-0@lo:400:kworker.0 Request processed in 102us (3118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.431636:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4604 00000100:00100000:1.0:1788572369.431654:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4605 00000100:00100000:1.0:1788572369.431660:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639119360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.431690:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639119360:12345-0@lo:400:kworker.0 Request processed in 30us (3083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.431695:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4605 00000100:00080000:1.0:1788572369.431921:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572369.431947:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639118848 00000100:00100000:1.0:1788572369.431951:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639118848 00000100:00100000:1.0:1788572369.431987:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:1.0:1788572369.431993:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639118848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.432049:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639118848:12345-0@lo:400:kworker.0 Request processed in 56us (3494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.432056:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00000100:00080000:1.0:1788572369.432074:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572369.432130:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639118336:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.432144:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639118848:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.432159:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639119360:0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.433600:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639119232 00000100:00100000:1.0:1788572369.433613:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639119232 00000100:00100000:1.0:1788572369.433678:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4606 00000100:00100000:1.0:1788572369.433687:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639119232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572369.434975:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639119232:12345-0@lo:400:kworker.0 Request processed in 1281us (6021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572369.434987:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4606 00000100:00080000:2.0:1788572369.435583:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572369.435685:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639119232:0@lo:400:kworker.0 00010000:00010000:2.0:1788572369.603230:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572370.627442:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572370.947536:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639119488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572370.947618:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572370.947976:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639119488 00000100:00100000:3.0:1788572370.947986:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639119488 00000100:00100000:3.0:1788572370.948070:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769 00000100:00100000:3.0:1788572370.948080:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639119488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572370.948121:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572370.948184:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639119488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572370.948192:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769 00000100:00100000:0.0:1788572370.948602:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639119488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572371.459343:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639119616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572371.459417:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572371.460799:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639119616 00000100:00100000:0.0:1788572371.460812:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639119616 00000100:00100000:0.0:1788572371.460901:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884 00000100:00100000:0.0:1788572371.460922:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639119616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572371.460963:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572371.461061:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639119616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572371.461068:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884 00000100:00100000:1.0:1788572371.461273:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639119616:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788572371.464116:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572371.651429:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572372.483554:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572372.483586:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639119744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572372.483674:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572372.483685:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572372.483687:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639120000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572372.483735:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572372.483766:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639119872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572372.483782:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639120000 00000100:00100000:0.0:1788572372.483791:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639120000 00000100:00100000:3.0:1788572372.483795:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572372.483835:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639119744 00000100:00100000:3.0:1788572372.483840:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639119744 00000100:00100000:0.0:1788572372.483854:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000100:00100000:0.0:1788572372.483866:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639120000:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572372.483905:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639119872 00000100:00100000:3.0:1788572372.483910:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639119872 00000004:00000024:0.0:1788572372.483921:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572372.483946:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:3.0:1788572372.483956:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639119744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572372.483979:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572372.483989:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639120000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572372.483997:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770 00000100:00100000:3.0:1788572372.484045:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639119744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572372.484053:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00000100:00100000:0.0:1788572372.484060:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:0.0:1788572372.484069:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639119872:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572372.484077:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788572372.484081:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572372.484116:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639119872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572372.484122:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639119744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572372.484124:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000100:00100000:3.0:1788572372.484156:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639119872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572372.484176:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639120000:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788572372.675352:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572372.897928:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572372.898051:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616096640 00000100:00100000:3.0:1788572372.898067:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616096640 00000100:00100000:3.0:1788572372.898129:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 159 00000100:00100000:3.0:1788572372.898140:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50328b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616096640:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572372.898232:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50328b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616096640:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 94us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572372.898240:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 159 00000100:00100000:2.0:1788572372.900179:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572372.900285:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616096896 00000100:00100000:1.0:1788572372.900294:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616096896 00000100:00080000:3.0:1788572372.900359:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572372.900365:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4607 00000100:00100000:1.0:1788572372.900376:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616096896:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572372.900458:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616096896:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 84us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572372.900466:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4607 00000100:00100000:1.0:1788572372.901627:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572372.901682:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616096768 00000100:00100000:3.0:1788572372.901689:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616096768 00000100:00100000:3.0:1788572372.901770:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4608 00000100:00100000:3.0:1788572372.901780:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2383:x1875449616096768:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572372.901844:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2383:x1875449616096768:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 65us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572372.901851:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4608 00000100:00080000:2.0:1788572372.901974:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572372.996579:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639120128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572372.996660:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572372.997042:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639120128 00000100:00100000:3.0:1788572372.997051:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639120128 00000100:00100000:3.0:1788572372.997123:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:3.0:1788572372.997134:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639120128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572372.997164:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788572372.997684:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572372.998521:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639120128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1383us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572372.998532:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00000100:00100000:2.0:1788572373.004374:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639120128:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572373.700384:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572374.533515:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639120512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.533590:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572374.533662:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639121024:0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.533700:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572374.533719:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639121536:0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.533741:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572374.533771:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788572374.533777:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639120640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.533799:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572374.533819:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639121152:0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.533852:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572374.533867:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639121664:0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.533898:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572374.533932:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639120512 00000100:00100000:1.0:1788572374.533940:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639120512 00000100:00100000:1.0:1788572374.533994:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639121536 00000100:00100000:1.0:1788572374.533997:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639121536 00000100:00100000:1.0:1788572374.534045:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639121664 00000100:00100000:1.0:1788572374.534049:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639121664 00000100:00100000:1.0:1788572374.534075:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4609 00000100:00100000:1.0:1788572374.534084:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639120512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.534142:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639120512:12345-0@lo:400:kworker.0 Request processed in 58us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572374.534150:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4609 00000100:00100000:1.0:1788572374.534167:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4610 00000100:00100000:1.0:1788572374.534173:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639121536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.534200:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639121536:12345-0@lo:400:kworker.0 Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572374.534206:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4610 00000100:00100000:1.0:1788572374.534218:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4611 00000100:00100000:1.0:1788572374.534223:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639121664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.534248:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639121664:12345-0@lo:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572374.534254:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4611 00000100:00100000:1.0:1788572374.534290:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639121664:0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.534301:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639120512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.534309:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639121536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572374.534614:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639121024 00000100:00100000:0.0:1788572374.534618:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639121024 00000100:00100000:0.0:1788572374.534657:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639120640 00000100:00100000:0.0:1788572374.534660:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639120640 00000100:00100000:0.0:1788572374.534680:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:0.0:1788572374.534699:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639121024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572374.534737:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639121024:12345-0@lo:400:kworker.0 Request processed in 51us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572374.534742:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00000100:00100000:0.0:1788572374.534754:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:0.0:1788572374.534760:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639120640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572374.534783:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639120640:12345-0@lo:400:kworker.0 Request processed in 24us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572374.534788:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000100:00100000:1.0:1788572374.534999:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639120640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.538985:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639121024:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.541295:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639120256:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.541389:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572374.541454:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639120768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.541485:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572374.541509:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639121280:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.541533:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572374.541549:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639121792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.541570:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572374.541594:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572374.541602:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639120384:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.541626:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572374.541645:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639120896:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.541665:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572374.541680:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639121408:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.541710:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572374.541749:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639121280 00000100:00100000:2.0:1788572374.541757:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639121280 00000100:00100000:2.0:1788572374.541808:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639121408 00000100:00100000:2.0:1788572374.541811:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639121408 00000100:00100000:2.0:1788572374.541835:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:2.0:1788572374.541844:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639121280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.541901:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639121280:12345-0@lo:400:kworker.0 Request processed in 57us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572374.541911:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00000100:00100000:2.0:1788572374.541926:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:2.0:1788572374.541932:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639121408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.541958:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639121408:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572374.541963:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:2.0:1788572374.541992:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639120768 00000100:00100000:2.0:1788572374.541995:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639120768 00000100:00100000:2.0:1788572374.542055:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639121792 00000100:00100000:2.0:1788572374.542058:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639121792 00000100:00100000:2.0:1788572374.542069:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639120896 00000100:00100000:2.0:1788572374.542071:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639120896 00000100:00100000:2.0:1788572374.542083:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4612 00000100:00100000:2.0:1788572374.542089:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639120768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.542117:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639120768:12345-0@lo:400:kworker.0 Request processed in 28us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572374.542123:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4612 00000100:00100000:2.0:1788572374.542133:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4613 00000100:00100000:2.0:1788572374.542139:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639121792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.542166:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639121792:12345-0@lo:400:kworker.0 Request processed in 27us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572374.542171:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4613 00000100:00100000:2.0:1788572374.542182:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4614 00000100:00100000:2.0:1788572374.542187:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639120896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.542211:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639120896:12345-0@lo:400:kworker.0 Request processed in 24us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572374.542220:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4614 00000100:00080000:2.0:1788572374.542234:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572374.542239:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572374.542241:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572374.542243:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572374.542252:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639121152 00000100:00100000:2.0:1788572374.542255:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639121152 00000100:00100000:2.0:1788572374.542275:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639120384 00000100:00100000:2.0:1788572374.542278:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639120384 00000100:00100000:2.0:1788572374.542291:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771 00000100:00100000:2.0:1788572374.542297:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639121152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.542333:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639121152:12345-0@lo:400:kworker.0 Request processed in 36us (8480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572374.542339:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771 00000100:00100000:2.0:1788572374.542350:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772 00000100:00100000:2.0:1788572374.542356:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639120384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.542380:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639120384:12345-0@lo:400:kworker.0 Request processed in 25us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572374.542385:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772 00000100:00100000:2.0:1788572374.542417:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639120384:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.542426:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639120896:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.542434:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639121408:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.542442:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639120768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.542450:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639121280:0@lo:400:kworker.0 00000100:00100000:2.0:1788572374.542458:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639121792:0@lo:400:kworker.0 00000100:00100000:0.0:1788572374.543508:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639120256 00000100:00100000:0.0:1788572374.543517:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639120256 00000100:00100000:0.0:1788572374.543565:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788572374.543572:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639120256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572374.543632:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639120256:12345-0@lo:400:kworker.0 Request processed in 61us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572374.543639:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788572374.543758:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639120256:0@lo:400:kworker.0 00000100:00100000:1.0:1788572374.543867:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639121152:0@lo:400:kworker.0 00010000:00010000:2.0:1788572374.723303:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572375.749645:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572376.067659:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572376.067683:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639121920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572376.067758:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572376.067867:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639121920 00000100:00100000:1.0:1788572376.067877:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639121920 00000100:00100000:1.0:1788572376.067934:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773 00000100:00100000:1.0:1788572376.067945:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639121920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572376.067980:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:1.0:1788572376.068083:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639121920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572376.068091:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773 00000100:00100000:2.0:1788572376.068288:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639121920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572376.584726:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639122048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572376.584805:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572376.584957:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639122048 00000100:00100000:0.0:1788572376.584967:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639122048 00000100:00100000:0.0:1788572376.585078:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:0.0:1788572376.585089:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639122048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572376.585119:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572376.585172:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639122048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572376.585179:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00100000:0.0:1788572376.585232:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639122048:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788572376.585455:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572376.771871:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572377.603375:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639122176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572377.603454:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572377.624301:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639122304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572377.628448:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639122176 00000100:00100000:3.0:1788572377.628466:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639122176 00000100:00100000:0.0:1788572377.630590:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572377.630688:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572377.630703:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639122432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572377.630768:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572377.630807:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639122432 00000100:00100000:0.0:1788572377.630814:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639122432 00000100:00100000:0.0:1788572377.630868:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1788572377.630879:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639122432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572377.630918:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572377.630967:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639122432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572377.630974:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1788572377.631083:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639122432:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788572377.631407:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572377.631431:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639122304 00000100:00100000:0.0:1788572377.631436:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639122304 00000100:00100000:0.0:1788572377.631474:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:0.0:1788572377.631480:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639122304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572377.631604:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572377.631715:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639122304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572377.631722:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00080000:0.0:1788572377.631743:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572377.631769:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639122304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572377.632357:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:3.0:1788572377.632372:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639122176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572377.632390:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572377.632445:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639122176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (28990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572377.632450:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:3.0:1788572377.632493:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639122176:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572377.796716:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572378.016640:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572378.016802:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616097152 00000100:00100000:2.0:1788572378.016813:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616097152 00000100:00100000:2.0:1788572378.016905:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4615 00000100:00100000:2.0:1788572378.016917:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2385:x1875449616097152:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572378.017050:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2385:x1875449616097152:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 126us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572378.017058:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4615 00000100:00080000:0.0:1788572378.017551:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572378.018190:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572378.018748:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572378.018987:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616097280 00000100:00100000:0.0:1788572378.019030:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616097280 00000100:00100000:0.0:1788572378.019127:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4616 00000100:00100000:0.0:1788572378.019141:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616097280:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572378.019223:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616097280:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 86us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572378.019231:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4616 00000100:00080000:1.0:1788572378.020188:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572378.021063:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616097024 00000100:00100000:2.0:1788572378.021215:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616097024 00000100:00100000:3.0:1788572378.021818:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 161 00000100:00100000:3.0:1788572378.021833:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50328bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616097024:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572378.022495:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50328bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616097024:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 663us (4306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572378.022504:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 161 00000100:00100000:2.0:1788572378.115846:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639122560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572378.115936:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572378.116169:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639122560 00000100:00100000:0.0:1788572378.116179:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639122560 00000100:00100000:0.0:1788572378.116262:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:0.0:1788572378.116273:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639122560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572378.116459:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572378.116512:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639122560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 241us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572378.116519:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000100:00100000:2.0:1788572378.116882:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639122560:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572378.117022:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572378.819330:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572379.651309:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639122944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.651337:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639123072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.651406:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572379.651466:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639123584:0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.651491:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572379.651508:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639124096:0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.651528:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572379.651554:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788572379.651560:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639122688:0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.651586:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572379.651621:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639123200:0@lo:400:kworker.0 00000100:00100000:0.0:1788572379.651631:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572379.651652:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639123456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.651653:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572379.651669:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639123712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572379.651672:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572379.651686:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639123968:0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.651687:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572379.651699:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639124224:0@lo:400:kworker.0 00000100:00100000:0.0:1788572379.651703:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572379.651716:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788572379.651717:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572379.651721:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639122816:0@lo:400:kworker.0 00000100:00100000:0.0:1788572379.651739:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572379.651743:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639123072 00000100:00100000:2.0:1788572379.651750:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639123072 00000100:00100000:0.0:1788572379.651752:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639123328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572379.651771:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572379.651783:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639123840:0@lo:400:kworker.0 00000100:00100000:0.0:1788572379.651800:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572379.651800:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639123456 00000100:00100000:2.0:1788572379.651803:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639123456 00000100:00100000:2.0:1788572379.651818:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639123712 00000100:00100000:2.0:1788572379.651820:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639123712 00000100:00100000:0.0:1788572379.651825:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639124096 00000100:00100000:0.0:1788572379.651828:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639124096 00000100:00100000:2.0:1788572379.651836:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639123840 00000100:00100000:2.0:1788572379.651839:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639123840 00000100:00100000:0.0:1788572379.651848:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639122944 00000100:00100000:0.0:1788572379.651851:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639122944 00000100:00100000:0.0:1788572379.651860:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639123200 00000100:00100000:2.0:1788572379.651860:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:0.0:1788572379.651862:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639123200 00000100:00100000:2.0:1788572379.651867:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639123072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572379.651872:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639123968 00000100:00100000:0.0:1788572379.651874:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639123968 00000100:00100000:0.0:1788572379.651883:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639124224 00000100:00100000:0.0:1788572379.651885:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639124224 00000100:00100000:0.0:1788572379.651896:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639123328 00000100:00100000:0.0:1788572379.651898:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639123328 00000100:00100000:0.0:1788572379.651912:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4617 00000100:00100000:0.0:1788572379.651918:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639124096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.651919:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639123072:12345-0@lo:400:kworker.0 Request processed in 53us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572379.651926:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1788572379.651942:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:0.0:1788572379.651945:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639124096:12345-0@lo:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572379.651948:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639123456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572379.651951:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4617 00000100:00100000:0.0:1788572379.651963:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4618 00000100:00100000:0.0:1788572379.651968:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639122944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.651985:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639123456:12345-0@lo:400:kworker.0 Request processed in 37us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572379.651992:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639122944:12345-0@lo:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572379.651992:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00100000:0.0:1788572379.651997:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4618 00000100:00100000:0.0:1788572379.652045:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4619 00000100:00100000:0.0:1788572379.652053:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639123200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.652184:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:2.0:1788572379.652193:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639123712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572379.652356:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639123584 00000100:00100000:3.0:1788572379.652361:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639123584 00000100:00100000:3.0:1788572379.652389:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639122816 00000100:00100000:3.0:1788572379.652392:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639122816 00000100:00100000:3.0:1788572379.652411:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775 00000100:00100000:3.0:1788572379.652418:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639123584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572379.653204:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776 00000100:00100000:1.0:1788572379.653217:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639122816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.656750:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639123712:12345-0@lo:400:kworker.0 Request processed in 4546us (5048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572379.656765:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00100000:2.0:1788572379.656805:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:2.0:1788572379.656817:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639123840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.656876:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639123840:12345-0@lo:400:kworker.0 Request processed in 64us (5074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572379.656881:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00100000:2.0:1788572379.656911:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639122688 00000100:00100000:2.0:1788572379.656920:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639122688 00000100:00100000:2.0:1788572379.656979:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788572379.656986:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639122688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.657361:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639122688:12345-0@lo:400:kworker.0 Request processed in 375us (5772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572379.657368:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788572379.657406:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4620 00000100:00100000:2.0:1788572379.657415:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639123968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.657451:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639123968:12345-0@lo:400:kworker.0 Request processed in 38us (5747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572379.657457:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4620 00000100:00100000:2.0:1788572379.657474:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4621 00000100:00100000:2.0:1788572379.657481:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639124224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.657513:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639124224:12345-0@lo:400:kworker.0 Request processed in 33us (5795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572379.657519:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4621 00000100:00100000:2.0:1788572379.657530:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4622 00000100:00100000:2.0:1788572379.657537:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639123328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.657565:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639123328:12345-0@lo:400:kworker.0 Request processed in 29us (5793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572379.657570:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4622 00000100:00100000:2.0:1788572379.658147:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639122688:0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.658174:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639123712:0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.658185:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639124224:0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.658196:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639123072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572379.658207:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639124096:0@lo:400:kworker.0 00000100:00100000:3.0:1788572379.659275:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639123584:12345-0@lo:400:kworker.0 Request processed in 6838us (7764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572379.659286:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775 00000100:00100000:3.0:1788572379.659537:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639123584:0@lo:400:kworker.0 00000100:00100000:3.0:1788572379.659623:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639123328:0@lo:400:kworker.0 00000100:00100000:3.0:1788572379.659650:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639123840:0@lo:400:kworker.0 00000100:00100000:3.0:1788572379.659663:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639122944:0@lo:400:kworker.0 00000100:00100000:3.0:1788572379.659675:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639123456:0@lo:400:kworker.0 00000100:00100000:3.0:1788572379.659688:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639123968:0@lo:400:kworker.0 00000100:00080000:3.0:1788572379.659729:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572379.659736:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572379.659739:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572379.659742:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572379.661735:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639123200:12345-0@lo:400:kworker.0 Request processed in 9675us (10071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572379.661750:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4619 00000100:00100000:3.0:1788572379.662857:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639123200:0@lo:400:kworker.0 00000100:00100000:1.0:1788572379.665955:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639122816:12345-0@lo:400:kworker.0 Request processed in 12732us (14204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572379.665971:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776 00000100:00100000:0.0:1788572379.666189:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639122816:0@lo:400:kworker.0 00010000:00010000:2.0:1788572379.847403:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572380.867717:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572381.187527:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572381.187555:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639124352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572381.187653:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572381.187746:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639124352 00000100:00100000:3.0:1788572381.187754:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639124352 00000100:00100000:3.0:1788572381.187812:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:3.0:1788572381.187823:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639124352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572381.187858:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1788572381.187919:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639124352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572381.187927:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777 00000100:00100000:1.0:1788572381.187989:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639124352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572381.699433:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639124480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572381.699511:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572381.699761:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639124480 00000100:00100000:3.0:1788572381.699769:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639124480 00000100:00100000:3.0:1788572381.699837:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892 00000100:00100000:3.0:1788572381.699846:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639124480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572381.699877:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572381.699930:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639124480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572381.699940:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892 00000100:00100000:3.0:1788572381.699985:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639124480:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788572381.700124:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572381.893717:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572382.723507:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572382.723534:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639124608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572382.723625:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572382.723733:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639124608 00000100:00100000:2.0:1788572382.723741:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639124608 00000100:00100000:2.0:1788572382.723786:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:2.0:1788572382.723793:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639124608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572382.723826:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572382.723876:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639124608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572382.723881:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00100000:2.0:1788572382.723915:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639124608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572382.724309:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639124736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572382.724357:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572382.724449:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639124736 00000100:00100000:0.0:1788572382.724454:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639124736 00000100:00100000:0.0:1788572382.724508:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893 00000100:00100000:0.0:1788572382.724518:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639124736:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572382.724528:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639124864:0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572382.724539:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572382.724567:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572382.724573:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639124736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572382.724579:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893 00000100:00100000:0.0:1788572382.724591:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639124864 00000100:00100000:0.0:1788572382.724594:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639124864 00000100:00100000:0.0:1788572382.724634:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:0.0:1788572382.724641:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639124864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572382.724650:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572382.724682:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639124864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572382.724689:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00080000:3.0:1788572382.724958:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572382.725043:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639124736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572382.725125:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639124864:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572382.915364:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572383.143950:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572383.143993:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572383.144058:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572383.144088:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616097664 00000100:00100000:3.0:1788572383.144097:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616097664 00000100:00100000:3.0:1788572383.144171:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616097536 00000100:00100000:3.0:1788572383.144175:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616097536 00000100:00100000:3.0:1788572383.144218:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4623 00000100:00100000:3.0:1788572383.144229:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616097664:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572383.144304:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616097664:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 78us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572383.144312:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4623 00000100:00100000:3.0:1788572383.144330:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4624 00000100:00100000:3.0:1788572383.144337:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616097536:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572383.144365:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2384:x1875449616097536:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572383.144371:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4624 00000100:00100000:2.0:1788572383.144448:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616097408 00000100:00100000:2.0:1788572383.144453:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616097408 00000100:00100000:2.0:1788572383.144486:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 163 00000100:00100000:2.0:1788572383.144492:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50328b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616097408:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572383.144518:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50328b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616097408:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572383.144524:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 163 00000100:00080000:0.0:1788572383.144755:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572383.144760:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572383.236190:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572383.236217:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639124992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572383.236308:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572383.240207:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639124992 00000100:00100000:0.0:1788572383.240224:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639124992 00000100:00100000:0.0:1788572383.240347:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:0.0:1788572383.240359:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639124992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572383.240396:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572383.240490:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639124992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (4192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572383.240507:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:2.0:1788572383.240714:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639124992:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572383.240844:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572383.940682:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572384.772527:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639125376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.772601:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572384.772660:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639125888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.772692:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572384.772709:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639126400:0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.772730:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572384.772756:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788572384.772763:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639125504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.772785:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572384.772819:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639126016:0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.772846:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572384.772864:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639126528:0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.772885:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572384.772922:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639125376 00000100:00100000:3.0:1788572384.772930:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639125376 00000100:00100000:3.0:1788572384.772973:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639126400 00000100:00100000:3.0:1788572384.772976:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639126400 00000100:00100000:3.0:1788572384.772995:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639126528 00000100:00100000:3.0:1788572384.772998:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639126528 00000100:00100000:3.0:1788572384.773050:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4625 00000100:00100000:3.0:1788572384.773060:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639125376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.773125:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639125376:12345-0@lo:400:kworker.0 Request processed in 67us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572384.773133:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4625 00000100:00100000:3.0:1788572384.774233:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4626 00000100:00100000:3.0:1788572384.774249:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639126400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.774306:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639126400:12345-0@lo:400:kworker.0 Request processed in 64us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572384.774313:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4626 00000100:00100000:3.0:1788572384.774336:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4627 00000100:00100000:3.0:1788572384.774344:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639126528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.774377:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639126528:12345-0@lo:400:kworker.0 Request processed in 34us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572384.774383:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4627 00000100:00100000:3.0:1788572384.774411:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639125888 00000100:00100000:3.0:1788572384.774417:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639125888 00000100:00100000:3.0:1788572384.774465:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639125504 00000100:00100000:3.0:1788572384.774468:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639125504 00000100:00100000:3.0:1788572384.774491:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:3.0:1788572384.774499:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639125888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.774533:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639125888:12345-0@lo:400:kworker.0 Request processed in 35us (1839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572384.774540:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00100000:3.0:1788572384.774552:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:3.0:1788572384.774558:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639125504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.774588:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639125504:12345-0@lo:400:kworker.0 Request processed in 30us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572384.774593:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00080000:3.0:1788572384.774617:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572384.774621:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572384.774635:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639126016 00000100:00100000:3.0:1788572384.774639:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639126016 00000100:00100000:3.0:1788572384.774665:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779 00000100:00100000:3.0:1788572384.774672:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639126016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.774706:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639126016:12345-0@lo:400:kworker.0 Request processed in 34us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572384.774715:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779 00000100:00100000:3.0:1788572384.774762:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639125504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.774777:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639126016:0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.774788:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639126528:0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.774800:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639125376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.774811:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639125888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572384.774820:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639126400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.775703:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639125248:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.775763:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572384.775824:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639125760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.775849:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572384.775872:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639126272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.775897:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572384.775927:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788572384.775934:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639125120:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.775965:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572384.775989:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639125632:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.776055:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572384.776077:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639126144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.776099:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572384.776119:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639126656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.776140:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572384.776171:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639126272 00000100:00100000:1.0:1788572384.776190:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639126272 00000100:00100000:1.0:1788572384.776600:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639126144 00000100:00100000:1.0:1788572384.776604:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639126144 00000100:00100000:1.0:1788572384.776628:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:1.0:1788572384.776636:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639126272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572384.776823:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:2.0:1788572384.776834:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639126144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572384.776894:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639126144:12345-0@lo:400:kworker.0 Request processed in 63us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572384.776901:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:1.0:1788572384.777147:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639126272:12345-0@lo:400:kworker.0 Request processed in 510us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572384.777155:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00100000:1.0:1788572384.777190:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639125120 00000100:00100000:1.0:1788572384.777194:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639125120 00000100:00100000:1.0:1788572384.777236:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788572384.777243:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e615386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639125120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.777276:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e615386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639125120:12345-0@lo:400:kworker.0 Request processed in 34us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572384.777282:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788572384.777326:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639125760 00000100:00100000:1.0:1788572384.777330:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639125760 00000100:00100000:1.0:1788572384.777358:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639125632 00000100:00100000:1.0:1788572384.777361:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639125632 00000100:00100000:1.0:1788572384.777382:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639126656 00000100:00100000:1.0:1788572384.777386:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639126656 00000100:00100000:1.0:1788572384.777404:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4628 00000100:00100000:1.0:1788572384.777410:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639125760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.777915:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639125760:12345-0@lo:400:kworker.0 Request processed in 503us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572384.777922:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4628 00000100:00100000:1.0:1788572384.777939:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4629 00000100:00100000:1.0:1788572384.777947:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639125632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.777978:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639125632:12345-0@lo:400:kworker.0 Request processed in 32us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572384.777984:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4629 00000100:00100000:1.0:1788572384.777996:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4630 00000100:00100000:1.0:1788572384.778002:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639126656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.778054:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639126656:12345-0@lo:400:kworker.0 Request processed in 52us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572384.778059:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4630 00000100:00100000:1.0:1788572384.778107:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639125120:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.778124:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639125632:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.778141:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639126144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.778153:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639126656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.778166:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639125760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572384.778191:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639126272:0@lo:400:kworker.0 00000100:00100000:0.0:1788572384.778360:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639125248 00000100:00100000:0.0:1788572384.778367:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639125248 00000100:00100000:0.0:1788572384.778401:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780 00000100:00100000:0.0:1788572384.778409:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639125248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572384.778466:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639125248:12345-0@lo:400:kworker.0 Request processed in 58us (2702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572384.778473:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780 00000100:00100000:1.0:1788572384.778834:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639125248:0@lo:400:kworker.0 00000100:00080000:3.0:1788572384.779489:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572384.779496:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572384.779499:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572384.779502:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572384.964823:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572385.988152:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572386.307576:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639126784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572386.307651:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572386.307748:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639126784 00000100:00100000:0.0:1788572386.307756:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639126784 00000100:00100000:0.0:1788572386.307880:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781 00000100:00100000:0.0:1788572386.307890:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639126784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572386.307925:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445937152 avail 1299697664 00000100:00100000:0.0:1788572386.308709:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639126784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 817us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572386.308720:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781 00000100:00100000:1.0:1788572386.308802:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639126784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572386.819424:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572386.819449:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639126912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572386.819525:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572386.819573:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639126912 00000100:00100000:0.0:1788572386.819581:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639126912 00000100:00100000:0.0:1788572386.819642:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:0.0:1788572386.819652:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639126912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572386.819682:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572386.819723:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639126912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572386.819731:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000100:00080000:0.0:1788572386.819750:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572386.819785:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639126912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788572387.020083:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572387.845722:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639127040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572387.845832:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572387.845927:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639127040 00000100:00100000:2.0:1788572387.845938:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639127040 00000100:00100000:2.0:1788572387.846032:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897 00000100:00100000:2.0:1788572387.846043:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639127040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572387.846087:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572387.846142:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639127040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572387.846150:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897 00000100:00080000:2.0:1788572387.846428:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572387.846481:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639127040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572387.847322:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572387.847345:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639127168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572387.847414:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572387.847472:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639127168 00000100:00100000:3.0:1788572387.847479:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639127168 00000100:00100000:3.0:1788572387.847547:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782 00000100:00100000:3.0:1788572387.847557:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639127168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572387.847598:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572387.847647:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639127168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572387.847653:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782 00000100:00100000:3.0:1788572387.847699:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639127168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572387.850437:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572387.850470:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639127296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572387.850577:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572387.851094:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639127296 00000100:00100000:3.0:1788572387.851106:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639127296 00000100:00100000:3.0:1788572387.851267:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898 00000100:00100000:3.0:1788572387.851279:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639127296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572387.851310:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572387.851379:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639127296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572387.851386:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898 00000100:00100000:3.0:1788572387.851446:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639127296:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572387.851637:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572388.044097:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572388.262100:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572388.262143:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572388.262170:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572388.262198:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616098048 00000100:00100000:1.0:1788572388.262208:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616098048 00000100:00100000:1.0:1788572388.262299:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616097920 00000100:00100000:1.0:1788572388.262302:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616097920 00000100:00100000:1.0:1788572388.262331:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4631 00000100:00100000:1.0:1788572388.262342:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616098048:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572388.262421:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616098048:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572388.262428:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4631 00000100:00100000:1.0:1788572388.262446:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4632 00000100:00100000:1.0:1788572388.262454:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2385:x1875449616097920:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572388.262478:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+409:2385:x1875449616097920:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572388.262483:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4632 00000100:00080000:1.0:1788572388.262505:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572388.262510:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572388.262697:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616097792 00000100:00100000:3.0:1788572388.262702:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616097792 00000100:00100000:3.0:1788572388.262741:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 165 00000100:00100000:3.0:1788572388.262749:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616097792:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572388.262781:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616097792:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 34us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572388.262787:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 165 00000100:00100000:2.0:1788572388.362533:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572388.362559:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639127424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572388.362633:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572388.362873:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639127424 00000100:00100000:0.0:1788572388.362881:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639127424 00000100:00100000:0.0:1788572388.362939:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:0.0:1788572388.362948:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639127424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572388.362978:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788572388.363137:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572388.363193:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639127424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 245us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572388.363200:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00000100:00100000:2.0:1788572388.363316:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639127424:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572389.063186:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572397.594106:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572397.594258:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616252032 00000100:00100000:1.0:1788572397.594270:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616252032 00000100:00100000:1.0:1788572397.594349:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15481 00000100:00100000:1.0:1788572397.594360:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+105:88093:x1875449616252032:12345-192.168.202.13@tcp:101:bash.0 00010000:00010000:1.0:1788572397.594385:0:9276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572397.594408:0:9276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524600/0xdb7edb52b8339cbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4b245 expref: -99 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572397.594497:0:9276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524e00/0xdb7edb52b8339cc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572397.594513:0:9276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524e00/0xdb7edb52b8339cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572397.594525:0:9276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524e00/0xdb7edb52b8339cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788572397.594575:0:9276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1788572397.594579:0:9276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788572397.594602:0:9276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524e00/0xdb7edb52b8339cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572397.594627:0:9276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524600/0xdb7edb52b8339cbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b245 expref: 107 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572397.594645:0:9276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524e00/0xdb7edb52b8339cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b245 expref: 106 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572397.594653:0:9276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63c570c00) 00010000:00010000:1.0:1788572397.594668:0:9276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788572397.594671:0:9276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61e524e00, rc 0) 00000100:00100000:1.0:1788572397.594731:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+106:88093:x1875449616252032:12345-192.168.202.13@tcp:101:bash.0 Request processed in 373us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572397.594739:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15481 00000100:00080000:0.0:1788572397.595169:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572397.600853:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572397.601914:0:6554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616252160 00000100:00100000:2.0:1788572397.601926:0:6554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616252160 00000100:00100000:2.0:1788572397.601993:0:6554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3252 00000100:00100000:2.0:1788572397.602023:0:6554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+106:88093:x1875449616252160:12345-192.168.202.13@tcp:37:bash.0 00000100:00100000:3.0:1788572397.619107:0:6554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+106:88093:x1875449616252160:12345-192.168.202.13@tcp:37:bash.0 Request processed in 17092us (18251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572397.619120:0:6554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3252 00000100:00100000:3.0:1788572397.656778:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572397.658103:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616252288 00000100:00100000:0.0:1788572397.658118:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616252288 00000100:00100000:0.0:1788572397.658178:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15482 00000100:00100000:0.0:1788572397.658188:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+106:89280:x1875449616252288:12345-192.168.202.13@tcp:101:checkstat.0 00010000:00010000:0.0:1788572397.658207:0:6550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572397.658228:0:6550:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e800/0xdb7edb52b8339ccc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4b24c expref: -99 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658296:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ea00/0xdb7edb52b8339cd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658310:0:6550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ea00/0xdb7edb52b8339cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658322:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ea00/0xdb7edb52b8339cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658336:0:6550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f000/0xdb7edb52b8339cda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c37c005 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658343:0:6550:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f000/0xdb7edb52b8339cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c37c005 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658348:0:6550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f000/0xdb7edb52b8339cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c37c005 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658408:0:6550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ea00/0xdb7edb52b8339cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658414:0:6550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ea00/0xdb7edb52b8339cd3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658420:0:6550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ea00/0xdb7edb52b8339cd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658426:0:6550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172ea00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572397.658442:0:6550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ea00/0xdb7edb52b8339cd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658453:0:6550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ea00/0xdb7edb52b8339cd3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658465:0:6550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63c570c00) 00010000:00010000:0.0:1788572397.658468:0:6550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572397.658472:0:6550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ea00/0xdb7edb52b8339cd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658479:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ea00/0xdb7edb52b8339cd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658492:0:6550:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f000/0xdb7edb52b8339cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c37c005 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658498:0:6550:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f000/0xdb7edb52b8339cda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c37c005 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658503:0:6550:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f000/0xdb7edb52b8339cda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c37c005 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658507:0:6550:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172f000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:0.0:1788572397.658510:0:6550:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f000/0xdb7edb52b8339cda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c37c005 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658515:0:6550:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f000/0xdb7edb52b8339cda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c37c005 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658522:0:6550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c37c005 (ffff94e61e6ef900) 00010000:00010000:0.0:1788572397.658525:0:6550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572397.658532:0:6550:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f000/0xdb7edb52b8339cda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c37c005 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658541:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f000/0xdb7edb52b8339cda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c37c005 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658571:0:6550:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e800/0xdb7edb52b8339ccc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b24c expref: 107 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658581:0:6550:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63c570c00) 00010000:00010000:0.0:1788572397.658583:0:6550:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788572397.658586:0:6550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e800/0xdb7edb52b8339ccc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b24c expref: 107 pid: 6550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572397.658596:0:6550:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e64172e800, rc 0) 00000100:00100000:0.0:1788572397.658668:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+106:89280:x1875449616252288:12345-192.168.202.13@tcp:101:checkstat.0 Request processed in 471us (1893us total) trans 0 rc 301/301 00000100:00100000:0.0:1788572397.658676:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15482 00000004:00080000:2.0:1788572398.083481:0:111999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4315104474226ns, next at 4316104470912ns, rc = 0 00000100:00100000:3.0:1788572398.083570:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639168384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572398.083645:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572398.083831:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639168384 00000100:00100000:2.0:1788572398.083848:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639168384 00000100:00100000:2.0:1788572398.083915:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:2.0:1788572398.083924:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+148:3650:x1875449639168384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572398.083952:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572398.083999:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+148:3650:x1875449639168384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572398.084027:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00080000:0.0:1788572398.084097:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572398.084355:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639168384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572398.085044:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639168512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572398.085088:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572398.085109:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572398.085120:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639168640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572398.085432:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639168512 00000100:00100000:1.0:1788572398.085447:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639168512 00000100:00100000:1.0:1788572398.085503:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:1.0:1788572398.085512:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639168512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572398.085529:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572398.085578:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639168512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572398.085585:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000100:00080000:0.0:1788572398.085823:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572398.085854:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639168512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572398.087393:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572398.087557:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639168640 00000100:00100000:0.0:1788572398.087563:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639168640 00000100:00100000:0.0:1788572398.089062:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790 00000100:00100000:0.0:1788572398.089081:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639168640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572398.089120:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572398.089207:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639168640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572398.089215:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790 00000100:00100000:1.0:1788572398.089326:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639168640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788572398.275286:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572398.504261:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572398.504317:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572398.504350:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572398.504485:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616252544 00000100:00100000:2.0:1788572398.504495:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616252544 00000100:00100000:2.0:1788572398.504551:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616252672 00000100:00100000:2.0:1788572398.504554:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616252672 00000100:00100000:2.0:1788572398.504591:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4646 00000100:00100000:2.0:1788572398.504601:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+106:2385:x1875449616252544:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572398.504613:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616252416 00000100:00100000:0.0:1788572398.504621:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616252416 00000100:00100000:0.0:1788572398.504661:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 169 00000100:00100000:0.0:1788572398.504671:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616252416:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572398.504683:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+106:2385:x1875449616252544:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 81us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572398.504693:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4646 00000100:00100000:0.0:1788572398.504718:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616252416:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 48us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572398.504725:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4647 00000100:00100000:0.0:1788572398.504730:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 169 00000100:00100000:2.0:1788572398.504738:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616252672:12345-192.168.202.13@tcp:400:kworker.0 00000100:00080000:0.0:1788572398.504767:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572398.504771:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616252672:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 35us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572398.504779:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4647 00000100:00100000:2.0:1788572398.603079:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572398.603109:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639168768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572398.603197:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572398.603376:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639168768 00000100:00100000:1.0:1788572398.603386:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639168768 00000100:00100000:1.0:1788572398.603459:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:1.0:1788572398.603470:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639168768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572398.603493:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572398.603547:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639168768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572398.603555:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00000100:00100000:1.0:1788572398.603603:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639168768:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788572398.604168:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572399.305845:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.134760:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639169024:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.134840:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.134893:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639169536:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.134916:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.134932:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639170048:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.134955:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.134976:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788572400.134982:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639168896:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.135028:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.135048:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639169408:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.135067:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.135083:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639169920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.135099:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.135112:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639170432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.135128:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.135153:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639169536 00000100:00100000:2.0:1788572400.135159:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639169536 00000100:00100000:2.0:1788572400.135204:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639169408 00000100:00100000:2.0:1788572400.135207:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639169408 00000100:00100000:2.0:1788572400.135223:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639170432 00000100:00100000:2.0:1788572400.135225:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639170432 00000100:00100000:2.0:1788572400.135244:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4648 00000100:00100000:2.0:1788572400.135252:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639169536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.135297:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639169536:12345-0@lo:400:kworker.0 Request processed in 44us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572400.135303:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4648 00000100:00100000:2.0:1788572400.135319:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4649 00000100:00100000:2.0:1788572400.135324:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639169408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.135347:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639169408:12345-0@lo:400:kworker.0 Request processed in 23us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572400.135352:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4649 00000100:00100000:2.0:1788572400.135361:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4650 00000100:00100000:2.0:1788572400.135367:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639170432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.135387:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639170432:12345-0@lo:400:kworker.0 Request processed in 21us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572400.135393:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4650 00000100:00080000:2.0:1788572400.135410:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572400.135413:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572400.135445:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639169408:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.135454:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639170432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.135462:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639169536:0@lo:400:kworker.0 00000100:00100000:1.0:1788572400.135612:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639169024 00000100:00100000:1.0:1788572400.135617:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639169024 00000100:00100000:1.0:1788572400.135654:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:1.0:1788572400.135662:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639169024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572400.135699:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639169024:12345-0@lo:400:kworker.0 Request processed in 38us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572400.135705:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000100:00100000:1.0:1788572400.135724:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639170048 00000100:00100000:1.0:1788572400.135728:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639170048 00000100:00100000:1.0:1788572400.135754:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639169920 00000100:00100000:1.0:1788572400.135757:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639169920 00000100:00100000:1.0:1788572400.135774:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:1.0:1788572400.135780:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+148:3651:x1875449639170048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572400.135809:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+148:3651:x1875449639170048:12345-0@lo:400:kworker.0 Request processed in 29us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572400.135826:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00100000:1.0:1788572400.135837:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:1.0:1788572400.135843:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+148:3651:x1875449639169920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572400.135869:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+148:3651:x1875449639169920:12345-0@lo:400:kworker.0 Request processed in 27us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572400.135875:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:3.0:1788572400.136062:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639169152:0@lo:400:kworker.0 00000100:00100000:3.0:1788572400.136091:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.136122:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639169664:0@lo:400:kworker.0 00000100:00100000:3.0:1788572400.136140:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.136162:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639170176:0@lo:400:kworker.0 00000100:00100000:3.0:1788572400.136180:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.136195:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572400.136201:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639169280:0@lo:400:kworker.0 00000100:00100000:3.0:1788572400.136219:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.136232:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639169792:0@lo:400:kworker.0 00000100:00100000:3.0:1788572400.136249:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.136263:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639170304:0@lo:400:kworker.0 00000100:00100000:3.0:1788572400.136280:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.136304:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639168896 00000100:00100000:3.0:1788572400.136308:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639168896 00000100:00100000:3.0:1788572400.136338:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788572400.136344:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639168896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572400.136375:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639168896:12345-0@lo:400:kworker.0 Request processed in 31us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572400.136382:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788572400.136406:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639169792 00000100:00100000:3.0:1788572400.136409:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639169792 00000100:00100000:3.0:1788572400.136427:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:3.0:1788572400.136433:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639169792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572400.136463:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639169792:12345-0@lo:400:kworker.0 Request processed in 30us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572400.136469:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00100000:3.0:1788572400.136513:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639169792:0@lo:400:kworker.0 00000100:00100000:0.0:1788572400.136584:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639169152 00000100:00100000:0.0:1788572400.136589:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639169152 00000100:00100000:0.0:1788572400.136624:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639170176 00000100:00100000:0.0:1788572400.136627:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639170176 00000100:00100000:0.0:1788572400.136641:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639170304 00000100:00100000:0.0:1788572400.136643:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639170304 00000100:00100000:0.0:1788572400.136666:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4651 00000100:00100000:0.0:1788572400.136672:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639169152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572400.136708:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639169152:12345-0@lo:400:kworker.0 Request processed in 36us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572400.136714:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4651 00000100:00100000:0.0:1788572400.136727:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4652 00000100:00100000:0.0:1788572400.136733:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639170176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572400.136759:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639170176:12345-0@lo:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572400.136765:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4652 00000100:00100000:0.0:1788572400.136778:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4653 00000100:00100000:0.0:1788572400.136784:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639170304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572400.136809:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639170304:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572400.136814:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4653 00000100:00100000:0.0:1788572400.136855:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639170304:0@lo:400:kworker.0 00000100:00100000:0.0:1788572400.136865:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639169152:0@lo:400:kworker.0 00000100:00100000:0.0:1788572400.136874:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639170176:0@lo:400:kworker.0 00000100:00100000:1.0:1788572400.138045:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639169664 00000100:00100000:1.0:1788572400.138056:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639169664 00000100:00100000:1.0:1788572400.138091:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639169280 00000100:00100000:1.0:1788572400.138095:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639169280 00000100:00100000:1.0:1788572400.138116:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:1.0:1788572400.138123:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639169664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572400.138190:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639169664:12345-0@lo:400:kworker.0 Request processed in 67us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572400.138197:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:1.0:1788572400.138212:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:1.0:1788572400.138218:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639169280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572400.138249:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639169280:12345-0@lo:400:kworker.0 Request processed in 32us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572400.138255:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:0.0:1788572400.138565:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639169280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572400.138578:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639169664:0@lo:400:kworker.0 00000100:00080000:2.0:1788572400.138791:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572400.138796:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572400.138798:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572400.138832:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639168896:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.138847:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639169920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.138858:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639169024:0@lo:400:kworker.0 00000100:00100000:2.0:1788572400.138868:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639170048:0@lo:400:kworker.0 00000001:00080000:0.0:1788572400.147156:0:114775:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884902055 is committed 00000004:00080000:1.0:1788572400.147158:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 30 committed 00000004:00080000:1.0:1788572400.147185:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 28 committed 00000001:00080000:1.0:1788572400.147224:0:111978:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 219043334908 is committed 00000004:00080000:1.0:1788572400.147229:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 27 committed 00000004:00080000:1.0:1788572400.147235:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 29 committed 00000004:00080000:1.0:1788572400.147280:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 26 committed 00000004:00080000:1.0:1788572400.147284:0:111978:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 28 committed 00000100:00100000:1.0:1788572400.147727:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639170944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.147804:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.147920:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788572400.147927:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639170560:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.147950:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.147965:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639171072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.147981:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.148042:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639170944 00000100:00100000:1.0:1788572400.148049:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639170944 00000100:00100000:1.0:1788572400.148094:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639170560 00000100:00100000:1.0:1788572400.148097:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639170560 00000100:00100000:1.0:1788572400.148112:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639171072 00000100:00100000:1.0:1788572400.148115:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639171072 00000100:00100000:1.0:1788572400.148134:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4324 00000100:00100000:1.0:1788572400.148142:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449639170944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.148167:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2813 count 1 00002000:00010000:1.0:1788572400.148280:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xafd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.148290:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea17eff/0xdb7edb52b8339ce1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.148307:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xafd:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.148312:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xafd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.148319:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eea17eff/0xdb7edb52b8339ce1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.148339:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eea17eff/0xdb7edb52b8339ce1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.148350:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea17eff/0xdb7edb52b8339ce1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.148359:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eea17eff/0xdb7edb52b8339ce1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.148377:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.148538:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449639170944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 394us (732us total) trans 12884902056 rc 0/0 00000100:00100000:1.0:1788572400.148546:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4324 00000100:00100000:1.0:1788572400.148565:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4325 00000100:00100000:1.0:1788572400.148572:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449639170560:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572400.148726:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4326 00000100:00100000:0.0:1788572400.148737:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449639171072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572400.148751:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2814 count 1 00002000:00010000:0.0:1788572400.148808:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xafe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.148813:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005907766b/0xdb7edb52b8339ce8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.149106:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.149114:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eea17eff/0xdb7edb52b8339ce1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.149123:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e524000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.149127:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea17eff/0xdb7edb52b8339ce1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.149137:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea17eff/0xdb7edb52b8339ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.149163:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eea17eff/0xdb7edb52b8339ce1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.149171:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eea17eff/0xdb7edb52b8339ce1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.149195:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.149196:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.149198:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.149214:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639170816:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.149253:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.149280:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639171328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.149301:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.149323:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788572400.149329:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639170688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.149376:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.149398:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639171200:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.149420:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.149449:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639170816 00000100:00100000:2.0:1788572400.149455:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639170816 00000100:00100000:2.0:1788572400.149501:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639171328 00000100:00100000:2.0:1788572400.149504:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639171328 00000100:00100000:2.0:1788572400.149521:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639170688 00000100:00100000:2.0:1788572400.149524:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639170688 00000100:00100000:2.0:1788572400.149537:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639171200 00000100:00100000:2.0:1788572400.149539:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639171200 00000100:00100000:2.0:1788572400.149556:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4327 00000100:00100000:2.0:1788572400.149563:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3653:x1875449639170816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.149577:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2812 count 1 00010000:00010000:0.0:1788572400.149717:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xafe:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.149722:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xafe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.149728:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005907766b/0xdb7edb52b8339ce8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.149743:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005907766b/0xdb7edb52b8339ce8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.149753:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005907766b/0xdb7edb52b8339ce8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.149762:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005907766b/0xdb7edb52b8339ce8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.149778:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788572400.150075:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2810 count 1 00002000:00010000:1.0:1788572400.150146:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xafa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.150153:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f85df8da/0xdb7edb52b8339cef lrc: 3/0,1 mode: --/PW res: [0x280000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150161:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xafa:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.150165:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xafa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.150168:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f85df8da/0xdb7edb52b8339cef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150178:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f85df8da/0xdb7edb52b8339cef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150186:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f85df8da/0xdb7edb52b8339cef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150194:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f85df8da/0xdb7edb52b8339cef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150207:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572400.150293:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3650:x1875449639170560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1720us (2340us total) trans 12884902057 rc 0/0 00000100:00100000:1.0:1788572400.150300:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4325 00000100:00100000:1.0:1788572400.150319:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4328 00000100:00100000:1.0:1788572400.150326:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3653:x1875449639171328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.150341:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2816 count 1 00002000:00010000:1.0:1788572400.150382:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.150388:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000303db464/0xdb7edb52b8339cf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150395:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb00:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.150399:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.150403:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000303db464/0xdb7edb52b8339cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150412:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000303db464/0xdb7edb52b8339cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150419:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000303db464/0xdb7edb52b8339cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150426:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000303db464/0xdb7edb52b8339cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150440:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572400.150511:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3653:x1875449639171328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 186us (1209us total) trans 12884902058 rc 0/0 00000100:00100000:1.0:1788572400.150518:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4328 00000100:00100000:1.0:1788572400.150532:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4329 00000100:00100000:1.0:1788572400.150539:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3653:x1875449639170688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.150550:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2811 count 1 00002000:00010000:1.0:1788572400.150605:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xafb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.150611:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bae7234/0xdb7edb52b8339cfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150620:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xafb:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.150623:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xafb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.150628:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bae7234/0xdb7edb52b8339cfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150638:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bae7234/0xdb7edb52b8339cfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150646:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bae7234/0xdb7edb52b8339cfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150655:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bae7234/0xdb7edb52b8339cfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150669:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788572400.150722:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3653:x1875449639170688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 184us (1345us total) trans 12884902059 rc 0/0 00000100:00100000:1.0:1788572400.150728:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4329 00000100:00100000:1.0:1788572400.150740:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4330 00000100:00100000:1.0:1788572400.150746:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3653:x1875449639171200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.150756:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2815 count 1 00002000:00010000:1.0:1788572400.150795:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xaff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.150800:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015d6ce1/0xdb7edb52b8339d04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.150809:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xaff:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.150812:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xaff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.150816:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015d6ce1/0xdb7edb52b8339d04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572400.150969:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3650:x1875449639171072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2234us (2985us total) trans 12884902060 rc 0/0 00000100:00100000:0.0:1788572400.150976:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4326 00010000:00010000:0.0:1788572400.151020:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572400.151026:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005907766b/0xdb7edb52b8339ce8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151034:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172f400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.151038:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005907766b/0xdb7edb52b8339ce8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151047:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005907766b/0xdb7edb52b8339ce8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151062:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005907766b/0xdb7edb52b8339ce8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151070:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005907766b/0xdb7edb52b8339ce8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151088:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572400.151091:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f85df8da/0xdb7edb52b8339cef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151098:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e525e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.151101:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f85df8da/0xdb7edb52b8339cef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151108:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f85df8da/0xdb7edb52b8339cef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151117:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f85df8da/0xdb7edb52b8339cef lrc: 1/0,0 mode: --/PW res: [0x280000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151124:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f85df8da/0xdb7edb52b8339cef lrc: 0/0,0 mode: --/PW res: [0x280000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151136:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572400.151139:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000303db464/0xdb7edb52b8339cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151145:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e525c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.151148:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000303db464/0xdb7edb52b8339cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151160:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000303db464/0xdb7edb52b8339cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151169:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000303db464/0xdb7edb52b8339cf6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151176:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000303db464/0xdb7edb52b8339cf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151186:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.151189:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bae7234/0xdb7edb52b8339cfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151195:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e525200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.151198:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bae7234/0xdb7edb52b8339cfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151205:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bae7234/0xdb7edb52b8339cfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151214:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bae7234/0xdb7edb52b8339cfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151220:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bae7234/0xdb7edb52b8339cfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151235:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.151237:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.151238:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572400.151246:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572400.151264:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639171456:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572400.151296:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572400.151331:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639171456 00000100:00100000:0.0:1788572400.151338:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639171456 00000100:00100000:0.0:1788572400.151369:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4331 00000100:00100000:0.0:1788572400.151375:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3651:x1875449639171456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572400.151388:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2817 count 1 00002000:00010000:0.0:1788572400.151437:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.151442:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c12165f0/0xdb7edb52b8339d0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151451:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb01:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.151454:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.151459:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c12165f0/0xdb7edb52b8339d0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151468:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c12165f0/0xdb7edb52b8339d0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151476:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c12165f0/0xdb7edb52b8339d0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151501:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c12165f0/0xdb7edb52b8339d0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.151518:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572400.151594:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+13:3651:x1875449639171456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 218us (296us total) trans 12884902061 rc 0/0 00000100:00100000:0.0:1788572400.151601:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4331 00000100:00100000:0.0:1788572400.151644:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884902055 gen 2 00000004:00080000:0.0:1788572400.151650:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3c000, transno 12884901913 00000004:00080000:0.0:1788572400.151659:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c0000, transno 12884901914 00000004:00080000:0.0:1788572400.151662:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3f480, transno 12884901915 00000004:00080000:0.0:1788572400.151666:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c2d80, transno 12884901916 00000004:00080000:0.0:1788572400.151668:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3c700, transno 12884901917 00000004:00080000:0.0:1788572400.151671:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c2a00, transno 12884901918 00000004:00080000:0.0:1788572400.151674:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634ad6d80, transno 12884901919 00000004:00080000:0.0:1788572400.151677:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c1880, transno 12884901920 00000004:00080000:0.0:1788572400.151680:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c3b80, transno 12884901921 00000004:00080000:0.0:1788572400.151682:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c0e00, transno 12884901922 00000004:00080000:0.0:1788572400.151685:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c3100, transno 12884901923 00000004:00080000:0.0:1788572400.151688:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63778dc00, transno 12884901924 00000004:00080000:0.0:1788572400.151691:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6131cd880, transno 12884901925 00000004:00080000:0.0:1788572400.151693:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6131cc380, transno 12884901926 00000004:00080000:0.0:1788572400.151695:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c2680, transno 12884901927 00000004:00080000:0.0:1788572400.151698:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c2300, transno 12884901928 00000004:00080000:0.0:1788572400.151700:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0000, transno 12884901929 00000004:00080000:0.0:1788572400.151702:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c1c00, transno 12884901930 00000004:00080000:0.0:1788572400.151705:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d4b1500, transno 12884901931 00000004:00080000:0.0:1788572400.151708:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0e00, transno 12884901932 00000004:00080000:0.0:1788572400.151711:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c3480, transno 12884901933 00000004:00080000:0.0:1788572400.151713:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d4b0380, transno 12884901934 00000004:00080000:0.0:1788572400.151716:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779b100, transno 12884901935 00000004:00080000:0.0:1788572400.151718:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798380, transno 12884901936 00000004:00080000:0.0:1788572400.151720:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798700, transno 12884901937 00000004:00080000:0.0:1788572400.151722:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779aa00, transno 12884901938 00000004:00080000:0.0:1788572400.151724:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e634a80, transno 12884901939 00000004:00080000:0.0:1788572400.151726:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799880, transno 12884901940 00000004:00080000:0.0:1788572400.151729:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e636a00, transno 12884901941 00000004:00080000:0.0:1788572400.151731:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3d180, transno 12884901942 00000004:00080000:0.0:1788572400.151734:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779a300, transno 12884901943 00000004:00080000:0.0:1788572400.151736:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3f480, transno 12884901944 00000004:00080000:0.0:1788572400.151738:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e637b80, transno 12884901945 00000004:00080000:0.0:1788572400.151740:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e635500, transno 12884901946 00000004:00080000:0.0:1788572400.151743:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28bb80, transno 12884901947 00000004:00080000:0.0:1788572400.151745:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799f80, transno 12884901948 00000004:00080000:0.0:1788572400.151747:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289f80, transno 12884901949 00000004:00080000:0.0:1788572400.151749:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799180, transno 12884901950 00000004:00080000:0.0:1788572400.151752:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28a680, transno 12884901951 00000004:00080000:0.0:1788572400.151754:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289180, transno 12884901952 00000004:00080000:0.0:1788572400.151756:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc45880, transno 12884901953 00000004:00080000:0.0:1788572400.151759:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288700, transno 12884901954 00000004:00080000:0.0:1788572400.151761:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3e300, transno 12884901955 00000004:00080000:0.0:1788572400.151763:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3ed80, transno 12884901956 00000004:00080000:0.0:1788572400.151766:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d2f0e00, transno 12884901957 00000004:00080000:0.0:1788572400.151769:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b29500, transno 12884901958 00000004:00080000:0.0:1788572400.151772:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5e300, transno 12884901959 00000004:00080000:0.0:1788572400.151774:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5d880, transno 12884901960 00000004:00080000:0.0:1788572400.151777:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5dc00, transno 12884901961 00000004:00080000:0.0:1788572400.151780:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5ed80, transno 12884901962 00000004:00080000:0.0:1788572400.151783:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5f480, transno 12884901963 00000004:00080000:0.0:1788572400.151785:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5fb80, transno 12884901964 00000004:00080000:0.0:1788572400.151788:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5ce00, transno 12884901965 00000004:00080000:0.0:1788572400.151790:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5f800, transno 12884901966 00000004:00080000:0.0:1788572400.151793:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2e680, transno 12884901967 00000004:00080000:0.0:1788572400.151796:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5c380, transno 12884901968 00000004:00080000:0.0:1788572400.151799:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2df80, transno 12884901969 00000004:00080000:0.0:1788572400.151802:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2ed80, transno 12884901970 00000004:00080000:0.0:1788572400.151804:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d880, transno 12884901971 00000004:00080000:0.0:1788572400.151807:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767ce00, transno 12884901972 00000004:00080000:0.0:1788572400.151810:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f800, transno 12884901973 00000004:00080000:0.0:1788572400.151813:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2ce00, transno 12884901974 00000004:00080000:0.0:1788572400.151816:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2f480, transno 12884901975 00002000:00010000:2.0:1788572400.151984:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xafc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.151991:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8339d12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152000:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xafc:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.152017:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xafc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.152022:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8339d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152033:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8339d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152042:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8339d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152048:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8339d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152062:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572400.152136:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3653:x1875449639170816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2572us (2881us total) trans 12884902062 rc 0/0 00000100:00100000:2.0:1788572400.152143:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4327 00010000:00010000:2.0:1788572400.152163:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572400.152168:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c12165f0/0xdb7edb52b8339d0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152176:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172e400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.152179:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c12165f0/0xdb7edb52b8339d0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152187:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c12165f0/0xdb7edb52b8339d0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152200:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c12165f0/0xdb7edb52b8339d0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152206:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c12165f0/0xdb7edb52b8339d0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152220:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.152223:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8339d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152229:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.152233:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8339d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152240:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8339d12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152249:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8339d12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152256:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000615dffbd/0xdb7edb52b8339d12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.152268:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.152270:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.152271:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.152278:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.152282:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.152513:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b8338d75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152522:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b8338d75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152528:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b8338d75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152533:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.152536:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b8338d75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152542:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b8338d75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152555:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3a7af77b (ffff94e61a333400) 00010000:00010000:3.0:1788572400.152559:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.152563:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b8338d75 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152568:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b8338d75 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3a7af77b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152601:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b833901c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152611:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b833901c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152616:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b833901c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152620:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641556000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.152623:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b833901c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152628:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b833901c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152635:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd9cbfbca (ffff94e502364200) 00010000:00010000:3.0:1788572400.152637:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.152640:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b833901c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152645:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641556000/0xdb7edb52b833901c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd9cbfbca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152659:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833916c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152665:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833916c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152671:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833916c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152676:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.152679:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833916c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152684:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833916c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152692:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdb31f5ad (ffff94e60fef1100) 00010000:00010000:3.0:1788572400.152695:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.152698:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833916c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152703:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833916c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdb31f5ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152718:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957a00/0xdb7edb52b83393d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152725:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957a00/0xdb7edb52b83393d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152731:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957a00/0xdb7edb52b83393d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152735:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a957a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.152738:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957a00/0xdb7edb52b83393d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152745:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957a00/0xdb7edb52b83393d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152753:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4a61047c (ffff94e63c570f00) 00010000:00010000:3.0:1788572400.152755:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.152759:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957a00/0xdb7edb52b83393d4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152764:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a957a00/0xdb7edb52b83393d4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4a61047c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152779:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d200/0xdb7edb52b833950f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152785:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d200/0xdb7edb52b833950f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152791:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d200/0xdb7edb52b833950f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152796:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9d200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.152799:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d200/0xdb7edb52b833950f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152805:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d200/0xdb7edb52b833950f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152812:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9759591f (ffff94e612b14800) 00010000:00010000:3.0:1788572400.152814:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.152817:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d200/0xdb7edb52b833950f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152835:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d200/0xdb7edb52b833950f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9759591f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152850:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9dc00/0xdb7edb52b83395be lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152860:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9dc00/0xdb7edb52b83395be lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152866:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9dc00/0xdb7edb52b83395be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152871:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9dc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.152874:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9dc00/0xdb7edb52b83395be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152880:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9dc00/0xdb7edb52b83395be lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152888:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8be962ae (ffff94e502364800) 00010000:00010000:3.0:1788572400.152891:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.152893:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9dc00/0xdb7edb52b83395be lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152899:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9dc00/0xdb7edb52b83395be lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8be962ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152912:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589e00/0xdb7edb52b83395ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152919:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589e00/0xdb7edb52b83395ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152924:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589e00/0xdb7edb52b83395ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152929:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.152932:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589e00/0xdb7edb52b83395ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152937:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589e00/0xdb7edb52b83395ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152943:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc27c6b01 (ffff94e502297700) 00010000:00010000:3.0:1788572400.152945:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.152948:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589e00/0xdb7edb52b83395ef lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152953:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589e00/0xdb7edb52b83395ef lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc27c6b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152965:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e600/0xdb7edb52b8339619 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152970:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e600/0xdb7edb52b8339619 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152975:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e600/0xdb7edb52b8339619 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152980:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172e600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.152982:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e600/0xdb7edb52b8339619 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152987:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e600/0xdb7edb52b8339619 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.152994:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x89ab79d0 (ffff94e61e6ef300) 00010000:00010000:3.0:1788572400.152996:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153000:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e600/0xdb7edb52b8339619 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153035:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e600/0xdb7edb52b8339619 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x89ab79d0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153050:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b8339643 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153056:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b8339643 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153061:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b8339643 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153066:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172fc00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153069:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b8339643 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153075:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b8339643 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153082:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xda201b01 (ffff94e61e6ef400) 00010000:00010000:3.0:1788572400.153085:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153087:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b8339643 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153093:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fc00/0xdb7edb52b8339643 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xda201b01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153106:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b833966d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153116:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b833966d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153122:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b833966d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153126:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172f600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153129:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b833966d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153135:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b833966d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153142:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf93b0fa4 (ffff94e61e6ef000) 00010000:00010000:3.0:1788572400.153144:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153147:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b833966d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153153:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f600/0xdb7edb52b833966d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf93b0fa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153167:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524c00/0xdb7edb52b8339697 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153173:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524c00/0xdb7edb52b8339697 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153179:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524c00/0xdb7edb52b8339697 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153184:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e524c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153186:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524c00/0xdb7edb52b8339697 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153191:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524c00/0xdb7edb52b8339697 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153198:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9759d473 (ffff94e63c570000) 00010000:00010000:3.0:1788572400.153200:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153203:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524c00/0xdb7edb52b8339697 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153209:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524c00/0xdb7edb52b8339697 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9759d473 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153223:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f800/0xdb7edb52b83396c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153229:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f800/0xdb7edb52b83396c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153234:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f800/0xdb7edb52b83396c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153238:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172f800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153241:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f800/0xdb7edb52b83396c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153246:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f800/0xdb7edb52b83396c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153254:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8913ce56 (ffff94e61e6ef100) 00010000:00010000:3.0:1788572400.153256:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153259:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f800/0xdb7edb52b83396c1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153264:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172f800/0xdb7edb52b83396c1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8913ce56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153277:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588400/0xdb7edb52b83396eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153284:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588400/0xdb7edb52b83396eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153289:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588400/0xdb7edb52b83396eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153294:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153297:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588400/0xdb7edb52b83396eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153302:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588400/0xdb7edb52b83396eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153309:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbab0d2a5 (ffff94e502297900) 00010000:00010000:3.0:1788572400.153311:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153314:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588400/0xdb7edb52b83396eb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153319:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588400/0xdb7edb52b83396eb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbab0d2a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153331:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e200/0xdb7edb52b8339715 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153340:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e200/0xdb7edb52b8339715 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153346:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e200/0xdb7edb52b8339715 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153350:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172e200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153353:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e200/0xdb7edb52b8339715 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153359:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e200/0xdb7edb52b8339715 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153365:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc69d1c8 (ffff94e61e6efc00) 00010000:00010000:3.0:1788572400.153368:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153370:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e200/0xdb7edb52b8339715 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153375:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172e200/0xdb7edb52b8339715 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc69d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153388:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d000/0xdb7edb52b833973f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153395:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d000/0xdb7edb52b833973f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153401:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d000/0xdb7edb52b833973f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153406:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9d000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153410:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d000/0xdb7edb52b833973f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153415:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d000/0xdb7edb52b833973f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153422:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49773b57 (ffff94e502364000) 00010000:00010000:3.0:1788572400.153424:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153427:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d000/0xdb7edb52b833973f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153433:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d000/0xdb7edb52b833973f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x49773b57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153446:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c000/0xdb7edb52b8339769 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153452:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c000/0xdb7edb52b8339769 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153458:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c000/0xdb7edb52b8339769 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153463:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153466:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c000/0xdb7edb52b8339769 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153472:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c000/0xdb7edb52b8339769 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153490:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x68922ffa (ffff94e502364c00) 00010000:00010000:3.0:1788572400.153493:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153496:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c000/0xdb7edb52b8339769 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153501:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c000/0xdb7edb52b8339769 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68922ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153516:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588600/0xdb7edb52b8339793 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153522:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588600/0xdb7edb52b8339793 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153528:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588600/0xdb7edb52b8339793 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153532:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153535:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588600/0xdb7edb52b8339793 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153541:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588600/0xdb7edb52b8339793 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153549:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x25e647f9 (ffff94e502297f00) 00010000:00010000:3.0:1788572400.153552:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153555:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588600/0xdb7edb52b8339793 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153560:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588600/0xdb7edb52b8339793 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x25e647f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153573:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b83397bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153583:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b83397bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153589:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b83397bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153594:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153597:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b83397bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153603:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b83397bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153610:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xea3f471c (ffff94e502297100) 00010000:00010000:3.0:1788572400.153612:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153615:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b83397bd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153620:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b83397bd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xea3f471c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153633:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9de00/0xdb7edb52b83397e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153639:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9de00/0xdb7edb52b83397e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153645:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9de00/0xdb7edb52b83397e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153650:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9de00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153653:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9de00/0xdb7edb52b83397e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153659:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9de00/0xdb7edb52b83397e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153665:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd4f30798 (ffff94e502364d00) 00010000:00010000:3.0:1788572400.153668:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153670:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9de00/0xdb7edb52b83397e7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153675:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9de00/0xdb7edb52b83397e7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd4f30798 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153687:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b8339811 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153693:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b8339811 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153698:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b8339811 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153703:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153706:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b8339811 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153712:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b8339811 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153719:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf6e40be7 (ffff94e502297b00) 00010000:00010000:3.0:1788572400.153721:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153724:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b8339811 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153729:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b8339811 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf6e40be7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153743:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524400/0xdb7edb52b833983b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153749:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524400/0xdb7edb52b833983b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153754:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524400/0xdb7edb52b833983b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153758:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e524400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153761:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524400/0xdb7edb52b833983b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153767:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524400/0xdb7edb52b833983b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153774:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x389d0b0a (ffff94e63c570500) 00010000:00010000:3.0:1788572400.153776:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153779:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524400/0xdb7edb52b833983b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153785:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524400/0xdb7edb52b833983b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x389d0b0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153799:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ca00/0xdb7edb52b8339865 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153808:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ca00/0xdb7edb52b8339865 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153814:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ca00/0xdb7edb52b8339865 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153818:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9ca00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153821:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ca00/0xdb7edb52b8339865 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153828:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ca00/0xdb7edb52b8339865 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153835:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed567499 (ffff94e502364e00) 00010000:00010000:3.0:1788572400.153837:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153840:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ca00/0xdb7edb52b8339865 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153846:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ca00/0xdb7edb52b8339865 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed567499 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153859:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fa00/0xdb7edb52b833988f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153865:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fa00/0xdb7edb52b833988f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153871:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fa00/0xdb7edb52b833988f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153875:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172fa00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153878:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fa00/0xdb7edb52b833988f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153884:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fa00/0xdb7edb52b833988f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153891:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb471693c (ffff94e61e6efb00) 00010000:00010000:3.0:1788572400.153893:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153896:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fa00/0xdb7edb52b833988f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153901:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fa00/0xdb7edb52b833988f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb471693c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153913:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c600/0xdb7edb52b83398b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153920:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c600/0xdb7edb52b83398b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153925:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c600/0xdb7edb52b83398b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153930:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153932:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c600/0xdb7edb52b83398b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153939:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c600/0xdb7edb52b83398b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153947:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf900780b (ffff94e502364b00) 00010000:00010000:3.0:1788572400.153949:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.153953:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c600/0xdb7edb52b83398b9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153959:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c600/0xdb7edb52b83398b9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf900780b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153973:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b83398e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153980:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b83398e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153986:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b83398e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.153991:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.153995:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b83398e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154001:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b83398e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154035:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeaba71ee (ffff94e502297d00) 00010000:00010000:3.0:1788572400.154038:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154041:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b83398e3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154047:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b83398e3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeaba71ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154060:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d400/0xdb7edb52b833990d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154071:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d400/0xdb7edb52b833990d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154077:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d400/0xdb7edb52b833990d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154083:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9d400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154086:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d400/0xdb7edb52b833990d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154092:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d400/0xdb7edb52b833990d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154100:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xccd4d63d (ffff94e502364f00) 00010000:00010000:3.0:1788572400.154102:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154105:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d400/0xdb7edb52b833990d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154111:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9d400/0xdb7edb52b833990d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xccd4d63d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154124:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589c00/0xdb7edb52b8339937 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154131:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589c00/0xdb7edb52b8339937 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154137:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589c00/0xdb7edb52b8339937 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154142:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154146:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589c00/0xdb7edb52b8339937 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154152:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589c00/0xdb7edb52b8339937 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154159:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1bbbde90 (ffff94e502297400) 00010000:00010000:3.0:1788572400.154161:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154164:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589c00/0xdb7edb52b8339937 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154170:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589c00/0xdb7edb52b8339937 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1bbbde90 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154183:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095600/0xdb7edb52b8339961 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154190:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095600/0xdb7edb52b8339961 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154196:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095600/0xdb7edb52b8339961 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154202:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154205:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095600/0xdb7edb52b8339961 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154211:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095600/0xdb7edb52b8339961 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154219:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe2eaed5f (ffff94e502297200) 00010000:00010000:3.0:1788572400.154221:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154225:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095600/0xdb7edb52b8339961 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154231:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095600/0xdb7edb52b8339961 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe2eaed5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154243:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b833998b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154250:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b833998b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154257:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b833998b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154262:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e524800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154265:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b833998b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154272:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b833998b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154279:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf653aaf (ffff94e63c570200) 00010000:00010000:3.0:1788572400.154282:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154285:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b833998b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154291:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524800/0xdb7edb52b833998b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf653aaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154305:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095200/0xdb7edb52b83399b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154317:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095200/0xdb7edb52b83399b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154323:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095200/0xdb7edb52b83399b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154328:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154331:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095200/0xdb7edb52b83399b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154338:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095200/0xdb7edb52b83399b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154346:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xde802f52 (ffff94e502297a00) 00010000:00010000:3.0:1788572400.154349:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154351:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095200/0xdb7edb52b83399b5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154357:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095200/0xdb7edb52b83399b5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xde802f52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154369:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b83399df lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154375:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b83399df lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154380:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b83399df lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154385:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095000 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154389:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b83399df lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154395:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b83399df lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154403:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x507038e1 (ffff94e502297000) 00010000:00010000:3.0:1788572400.154405:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154408:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b83399df lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154413:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095000/0xdb7edb52b83399df lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x507038e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154426:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524a00/0xdb7edb52b8339a09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154432:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524a00/0xdb7edb52b8339a09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154438:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524a00/0xdb7edb52b8339a09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154442:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e524a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154445:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524a00/0xdb7edb52b8339a09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154450:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524a00/0xdb7edb52b8339a09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154457:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ffa6e04 (ffff94e63c570400) 00010000:00010000:3.0:1788572400.154459:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154462:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524a00/0xdb7edb52b8339a09 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154468:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524a00/0xdb7edb52b8339a09 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3ffa6e04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154492:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095c00/0xdb7edb52b8339a33 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154499:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095c00/0xdb7edb52b8339a33 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154505:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095c00/0xdb7edb52b8339a33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154510:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154513:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095c00/0xdb7edb52b8339a33 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154519:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095c00/0xdb7edb52b8339a33 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154527:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9eb7253 (ffff94e502297500) 00010000:00010000:3.0:1788572400.154529:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154532:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095c00/0xdb7edb52b8339a33 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154539:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641095c00/0xdb7edb52b8339a33 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9eb7253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154553:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ce00/0xdb7edb52b8339a5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154563:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ce00/0xdb7edb52b8339a5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154568:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ce00/0xdb7edb52b8339a5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154572:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9ce00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154575:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ce00/0xdb7edb52b8339a5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154581:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ce00/0xdb7edb52b8339a5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154589:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79056c36 (ffff94e502364a00) 00010000:00010000:3.0:1788572400.154592:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154595:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ce00/0xdb7edb52b8339a5d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154601:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9ce00/0xdb7edb52b8339a5d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79056c36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154616:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c200/0xdb7edb52b8339a87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154623:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c200/0xdb7edb52b8339a87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154629:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c200/0xdb7edb52b8339a87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154634:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154638:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c200/0xdb7edb52b8339a87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154645:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c200/0xdb7edb52b8339a87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154652:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x40347b05 (ffff94e619f4ee00) 00010000:00010000:3.0:1788572400.154654:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154657:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c200/0xdb7edb52b8339a87 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154663:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c200/0xdb7edb52b8339a87 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x40347b05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154676:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ee00/0xdb7edb52b8339ab1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154683:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ee00/0xdb7edb52b8339ab1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154689:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ee00/0xdb7edb52b8339ab1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154695:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172ee00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154698:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ee00/0xdb7edb52b8339ab1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154704:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ee00/0xdb7edb52b8339ab1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154711:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d834fa8 (ffff94e61e6ef500) 00010000:00010000:3.0:1788572400.154714:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154717:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ee00/0xdb7edb52b8339ab1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154723:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ee00/0xdb7edb52b8339ab1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5d834fa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154738:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094600/0xdb7edb52b8339adb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154744:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094600/0xdb7edb52b8339adb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154750:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094600/0xdb7edb52b8339adb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154754:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154757:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094600/0xdb7edb52b8339adb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154762:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094600/0xdb7edb52b8339adb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154769:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb2b67a7 (ffff94e502297800) 00010000:00010000:3.0:1788572400.154771:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154774:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094600/0xdb7edb52b8339adb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154779:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094600/0xdb7edb52b8339adb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb2b67a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154794:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524200/0xdb7edb52b8339b05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154805:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524200/0xdb7edb52b8339b05 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154810:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524200/0xdb7edb52b8339b05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154814:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e524200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154817:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524200/0xdb7edb52b8339b05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154822:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524200/0xdb7edb52b8339b05 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154829:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4e466ca (ffff94e63c570600) 00010000:00010000:3.0:1788572400.154832:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154835:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524200/0xdb7edb52b8339b05 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154841:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524200/0xdb7edb52b8339b05 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4e466ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154856:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c800/0xdb7edb52b8339b2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154863:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c800/0xdb7edb52b8339b2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154870:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c800/0xdb7edb52b8339b2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154875:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154879:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c800/0xdb7edb52b8339b2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154885:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c800/0xdb7edb52b8339b2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154893:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd8caca36 (ffff94e619f4ec00) 00010000:00010000:3.0:1788572400.154895:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154898:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c800/0xdb7edb52b8339b2f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154904:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac9c800/0xdb7edb52b8339b2f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd8caca36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154916:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094c00/0xdb7edb52b8339b59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154923:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094c00/0xdb7edb52b8339b59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154928:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094c00/0xdb7edb52b8339b59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154933:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154935:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094c00/0xdb7edb52b8339b59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154942:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094c00/0xdb7edb52b8339b59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154949:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x791bed9 (ffff94e502297600) 00010000:00010000:3.0:1788572400.154952:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.154955:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094c00/0xdb7edb52b8339b59 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154961:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641094c00/0xdb7edb52b8339b59 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x791bed9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154976:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525800/0xdb7edb52b8339b83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154983:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525800/0xdb7edb52b8339b83 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154989:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525800/0xdb7edb52b8339b83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.154995:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e525800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.154998:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525800/0xdb7edb52b8339b83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155030:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525800/0xdb7edb52b8339b83 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155039:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf420cda8 (ffff94e63c570300) 00010000:00010000:3.0:1788572400.155041:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.155044:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525800/0xdb7edb52b8339b83 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155051:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525800/0xdb7edb52b8339b83 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf420cda8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155065:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b8339bad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155076:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b8339bad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155082:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b8339bad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155088:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172ec00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.155091:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b8339bad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155097:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b8339bad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155104:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe5dac78b (ffff94e61e6efe00) 00010000:00010000:3.0:1788572400.155106:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.155109:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b8339bad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155114:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172ec00/0xdb7edb52b8339bad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe5dac78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155126:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956a00/0xdb7edb52b8339bd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155132:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956a00/0xdb7edb52b8339bd7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155138:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956a00/0xdb7edb52b8339bd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155143:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a956a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.155146:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956a00/0xdb7edb52b8339bd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155152:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956a00/0xdb7edb52b8339bd7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155158:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a3eabda (ffff94e619f4eb00) 00010000:00010000:3.0:1788572400.155161:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.155163:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956a00/0xdb7edb52b8339bd7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155169:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956a00/0xdb7edb52b8339bd7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a3eabda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155182:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525a00/0xdb7edb52b8339c01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155188:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525a00/0xdb7edb52b8339c01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155194:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525a00/0xdb7edb52b8339c01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155199:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e525a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.155202:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525a00/0xdb7edb52b8339c01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155208:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525a00/0xdb7edb52b8339c01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155214:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbbf7aafd (ffff94e63c570b00) 00010000:00010000:3.0:1788572400.155217:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.155220:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525a00/0xdb7edb52b8339c01 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155226:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525a00/0xdb7edb52b8339c01 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbbf7aafd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155238:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b8339c2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155245:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b8339c2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155251:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b8339c2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155256:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e525600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.155258:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b8339c2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155263:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b8339c2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155270:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc033b48c (ffff94e63c570d00) 00010000:00010000:3.0:1788572400.155272:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.155275:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b8339c2b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155280:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525600/0xdb7edb52b8339c2b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc033b48c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155292:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b8339c55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155302:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b8339c55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155309:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b8339c55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155314:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e525400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.155317:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b8339c55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155323:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b8339c55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155331:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf4ea92f (ffff94e63c570700) 00010000:00010000:3.0:1788572400.155333:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.155336:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b8339c55 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155342:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e525400/0xdb7edb52b8339c55 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdf4ea92f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6550 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155355:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956e00/0xdb7edb52b8339c7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155361:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956e00/0xdb7edb52b8339c7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155366:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956e00/0xdb7edb52b8339c7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155371:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a956e00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.155374:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956e00/0xdb7edb52b8339c7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155380:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956e00/0xdb7edb52b8339c7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155387:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6189212e (ffff94e619f4e100) 00010000:00010000:3.0:1788572400.155389:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.155392:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956e00/0xdb7edb52b8339c7f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155398:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63a956e00/0xdb7edb52b8339c7f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6189212e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155412:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fe00/0xdb7edb52b8339ca9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155417:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fe00/0xdb7edb52b8339ca9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155423:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fe00/0xdb7edb52b8339ca9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155427:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172fe00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572400.155429:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fe00/0xdb7edb52b8339ca9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155434:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fe00/0xdb7edb52b8339ca9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155441:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x358e2051 (ffff94e61e6ef200) 00010000:00010000:3.0:1788572400.155443:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572400.155446:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fe00/0xdb7edb52b8339ca9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.155451:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e64172fe00/0xdb7edb52b8339ca9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x358e2051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788572400.155624:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c000, transno 12884901976 00000004:00080000:0.0:1788572400.155629:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767ea00, transno 12884901977 00000004:00080000:0.0:1788572400.155632:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5d180, transno 12884901978 00000004:00080000:0.0:1788572400.155635:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767d180, transno 12884901979 00000004:00080000:0.0:1788572400.155637:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767ed80, transno 12884901980 00000004:00080000:0.0:1788572400.155640:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767f100, transno 12884901981 00000004:00080000:0.0:1788572400.155643:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0000, transno 12884901982 00000004:00080000:0.0:1788572400.155645:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767c700, transno 12884901983 00000004:00080000:0.0:1788572400.155648:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc8ca80, transno 12884901984 00000004:00080000:0.0:1788572400.155651:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5ea00, transno 12884901985 00000004:00080000:0.0:1788572400.155653:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3800, transno 12884901986 00000004:00080000:0.0:1788572400.155656:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db0a80, transno 12884901987 00000004:00080000:0.0:1788572400.155658:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b5880, transno 12884901988 00000004:00080000:0.0:1788572400.155661:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b7b80, transno 12884901989 00000004:00080000:0.0:1788572400.155663:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b6a00, transno 12884901990 00000004:00080000:0.0:1788572400.155666:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc8c700, transno 12884901991 00000004:00080000:0.0:1788572400.155669:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b6300, transno 12884901992 00000004:00080000:0.0:1788572400.155671:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b4000, transno 12884901993 00000004:00080000:0.0:1788572400.155674:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b7800, transno 12884901994 00000004:00080000:0.0:1788572400.155676:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db2680, transno 12884901995 00000004:00080000:0.0:1788572400.155679:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5032b7100, transno 12884901996 00000004:00080000:0.0:1788572400.155682:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db3480, transno 12884901997 00000004:00080000:0.0:1788572400.155684:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767e680, transno 12884901998 00000004:00080000:0.0:1788572400.155687:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767c000, transno 12884901999 00000004:00080000:0.0:1788572400.155689:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db2300, transno 12884902000 00000004:00080000:0.0:1788572400.155692:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767c380, transno 12884902001 00000004:00080000:0.0:1788572400.155695:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633db1180, transno 12884902002 00000004:00080000:0.0:1788572400.155698:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767f800, transno 12884902003 00000004:00080000:0.0:1788572400.155700:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47100, transno 12884902004 00000004:00080000:0.0:1788572400.155703:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc8ea00, transno 12884902005 00000004:00080000:0.0:1788572400.155705:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5038c3480, transno 12884902006 00000004:00080000:0.0:1788572400.155708:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63767df80, transno 12884902007 00000004:00080000:0.0:1788572400.155711:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e50384df80, transno 12884902008 00000004:00080000:0.0:1788572400.155714:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5033f1f80, transno 12884902009 00000004:00080000:0.0:1788572400.155717:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5033f2d80, transno 12884902010 00000004:00080000:0.0:1788572400.155719:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5033f2680, transno 12884902011 00000004:00080000:0.0:1788572400.155722:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb1f80, transno 12884902012 00000004:00080000:0.0:1788572400.155724:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb1c00, transno 12884902013 00000004:00080000:0.0:1788572400.155726:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb2300, transno 12884902014 00000004:00080000:0.0:1788572400.155729:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb0000, transno 12884902015 00000004:00080000:0.0:1788572400.155731:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb1180, transno 12884902016 00000004:00080000:0.0:1788572400.155735:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb2a00, transno 12884902017 00000004:00080000:0.0:1788572400.155737:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931f80, transno 12884902018 00000004:00080000:0.0:1788572400.155740:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e573b80, transno 12884902019 00000004:00080000:0.0:1788572400.155743:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e572a00, transno 12884902020 00000004:00080000:0.0:1788572400.155745:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637714000, transno 12884902021 00000004:00080000:0.0:1788572400.155748:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3df80, transno 12884902022 00000004:00080000:0.0:1788572400.155751:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d4000, transno 12884902023 00000004:00080000:0.0:1788572400.155753:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e573800, transno 12884902024 00000004:00080000:0.0:1788572400.155756:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d7480, transno 12884902025 00000004:00080000:0.0:1788572400.155758:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d5f80, transno 12884902026 00000004:00080000:0.0:1788572400.155761:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e635c00, transno 12884902027 00000004:00080000:0.0:1788572400.155764:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3f800, transno 12884902028 00000004:00080000:0.0:1788572400.155766:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e636680, transno 12884902029 00000004:00080000:0.0:1788572400.155768:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e570a80, transno 12884902030 00000004:00080000:0.0:1788572400.155771:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637717100, transno 12884902031 00000004:00080000:0.0:1788572400.155773:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6184d7100, transno 12884902032 00000004:00080000:0.0:1788572400.155775:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae69180, transno 12884902033 00000004:00080000:0.0:1788572400.155778:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6bb80, transno 12884902034 00000004:00080000:0.0:1788572400.155780:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a4a80, transno 12884902035 00000004:00080000:0.0:1788572400.155783:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6a680, transno 12884902036 00000004:00080000:0.0:1788572400.155785:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28e300, transno 12884902037 00000004:00080000:0.0:1788572400.155788:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28dc00, transno 12884902038 00000004:00080000:0.0:1788572400.155791:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28ea00, transno 12884902039 00000004:00080000:0.0:1788572400.155793:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a5500, transno 12884902040 00000004:00080000:0.0:1788572400.155795:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637591500, transno 12884902041 00000004:00080000:0.0:1788572400.155798:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6ad80, transno 12884902042 00000004:00080000:0.0:1788572400.155801:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28c700, transno 12884902043 00000004:00080000:0.0:1788572400.155803:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28e680, transno 12884902044 00000004:00080000:0.0:1788572400.155805:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28c000, transno 12884902045 00000004:00080000:0.0:1788572400.155808:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28d180, transno 12884902046 00000004:00080000:0.0:1788572400.155810:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d500, transno 12884902047 00000004:00080000:0.0:1788572400.155812:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2c380, transno 12884902048 00010000:00010000:1.0:1788572400.155919:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015d6ce1/0xdb7edb52b8339d04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.155931:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015d6ce1/0xdb7edb52b8339d04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.155938:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015d6ce1/0xdb7edb52b8339d04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.155969:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.156167:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3653:x1875449639171200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5417us (6742us total) trans 12884902063 rc 0/0 00000100:00100000:1.0:1788572400.156177:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4330 00010000:00010000:1.0:1788572400.156216:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572400.156222:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015d6ce1/0xdb7edb52b8339d04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.156230:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e525000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.156233:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015d6ce1/0xdb7edb52b8339d04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.156246:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015d6ce1/0xdb7edb52b8339d04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.156260:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015d6ce1/0xdb7edb52b8339d04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.156268:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015d6ce1/0xdb7edb52b8339d04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.156289:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.156291:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.156293:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.156299:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572400.156317:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639171968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.156357:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.156386:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639172480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.156412:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572400.156533:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e762a00, transno 12884902049 00000004:00080000:0.0:1788572400.156537:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f8380, transno 12884902050 00000004:00080000:0.0:1788572400.156539:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f9500, transno 12884902051 00000004:00080000:0.0:1788572400.156542:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f8e00, transno 12884902052 00000004:00080000:0.0:1788572400.156545:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f9180, transno 12884902053 00000004:00080000:0.0:1788572400.156547:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349fb480, transno 12884902054 00000004:00080000:0.0:1788572400.156550:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349fad80, transno 12884902055 00000100:00100000:0.0:1788572400.156558:0:3651:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e6414a4000 x1875449639171456/t12884902061(12884902061) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572416 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788572400.156570:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6414a4000/2, rc 0, transno 12884902061 00000100:00100000:0.0:1788572400.156576:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639171456:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.157113:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639171968 00000100:00100000:3.0:1788572400.157121:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639171968 00000100:00100000:3.0:1788572400.157165:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639172480 00000100:00100000:3.0:1788572400.157168:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639172480 00000100:00100000:3.0:1788572400.157186:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4332 00000100:00100000:3.0:1788572400.157194:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+149:3650:x1875449639171968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.157222:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2812 count 1 00002000:00010000:3.0:1788572400.157252:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xafc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.157258:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3b495f6/0xdb7edb52b8339d19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.157271:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xafc:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.157275:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xafc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.157282:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3b495f6/0xdb7edb52b8339d19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.157296:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3b495f6/0xdb7edb52b8339d19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.157305:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3b495f6/0xdb7edb52b8339d19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.157313:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3b495f6/0xdb7edb52b8339d19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.157330:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.157468:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+150:3650:x1875449639171968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 273us (1110us total) trans 4294968820 rc 0/0 00000100:00100000:3.0:1788572400.157474:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4332 00000100:00100000:3.0:1788572400.157502:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4333 00000100:00100000:3.0:1788572400.157508:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+149:3650:x1875449639172480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.157520:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2816 count 1 00002000:00010000:3.0:1788572400.157534:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb00:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.157539:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004478bfcc/0xdb7edb52b8339d20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.157547:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb00:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.157550:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb00:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.157555:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004478bfcc/0xdb7edb52b8339d20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.157563:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004478bfcc/0xdb7edb52b8339d20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.157571:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004478bfcc/0xdb7edb52b8339d20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.157578:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004478bfcc/0xdb7edb52b8339d20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788572400.157766:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6414a7800/2, rc 0, transno 12884902059 00000100:00100000:2.0:1788572400.157773:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639170688:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.157798:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6414a7480/2, rc 0, transno 12884902063 00000100:00100000:2.0:1788572400.157802:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639171200:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.157812:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6414a5c00/2, rc 0, transno 12884902062 00000100:00100000:2.0:1788572400.157826:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639170816:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.157837:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6414a6d80/2, rc 0, transno 12884902058 00000100:00100000:2.0:1788572400.157841:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639171328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.157859:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639171840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.157893:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.157919:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639172352:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.157939:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.157958:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788572400.157965:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639171712:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.157985:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.158001:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639172224:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.158034:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788572400.158064:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.158069:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3b495f6/0xdb7edb52b8339d19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158078:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a957000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.158082:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3b495f6/0xdb7edb52b8339d19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158091:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3b495f6/0xdb7edb52b8339d19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158106:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3b495f6/0xdb7edb52b8339d19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158114:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3b495f6/0xdb7edb52b8339d19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xafc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158134:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.158136:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.158137:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.158149:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639171840 00000100:00100000:2.0:1788572400.158153:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639171840 00000100:00100000:2.0:1788572400.158178:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639172352 00000100:00100000:2.0:1788572400.158180:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639172352 00000100:00100000:2.0:1788572400.158193:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639171712 00000100:00100000:2.0:1788572400.158195:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639171712 00000100:00100000:2.0:1788572400.158207:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639172224 00000100:00100000:2.0:1788572400.158209:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639172224 00000100:00100000:2.0:1788572400.158223:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4334 00000100:00100000:2.0:1788572400.158230:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+153:3653:x1875449639171840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.158244:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2811 count 1 00002000:00010000:2.0:1788572400.158262:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xafb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.158267:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2e13bcb/0xdb7edb52b8339d27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158276:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xafb:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.158280:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xafb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.158284:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2e13bcb/0xdb7edb52b8339d27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158294:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2e13bcb/0xdb7edb52b8339d27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158302:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2e13bcb/0xdb7edb52b8339d27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158310:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2e13bcb/0xdb7edb52b8339d27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158323:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572400.158415:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+154:3653:x1875449639171840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 184us (520us total) trans 4294968821 rc 0/0 00000100:00100000:2.0:1788572400.158422:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4334 00000100:00100000:2.0:1788572400.158436:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4335 00000100:00100000:2.0:1788572400.158443:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+153:3653:x1875449639172352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.158456:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2815 count 1 00002000:00010000:2.0:1788572400.158470:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xaff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.158475:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e45d95c1/0xdb7edb52b8339d2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158494:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaff:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.158497:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.158501:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e45d95c1/0xdb7edb52b8339d2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158509:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e45d95c1/0xdb7edb52b8339d2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158517:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e45d95c1/0xdb7edb52b8339d2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158524:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e45d95c1/0xdb7edb52b8339d2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158539:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572400.158615:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+154:3653:x1875449639172352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 172us (674us total) trans 4294968822 rc 0/0 00000100:00100000:2.0:1788572400.158622:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4335 00000100:00100000:2.0:1788572400.158634:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4336 00000100:00100000:2.0:1788572400.158640:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+153:3653:x1875449639171712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.158655:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2810 count 1 00002000:00010000:2.0:1788572400.158669:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xafa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.158674:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8339d35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158681:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xafa:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.158684:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xafa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.158688:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8339d35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158697:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8339d35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158705:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8339d35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158712:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8339d35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158727:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788572400.158788:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+154:3653:x1875449639171712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 148us (801us total) trans 4294968823 rc 0/0 00000100:00100000:2.0:1788572400.158795:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4336 00000100:00100000:2.0:1788572400.158808:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4337 00000100:00100000:2.0:1788572400.158814:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+153:3653:x1875449639172224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.158825:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2814 count 1 00002000:00010000:2.0:1788572400.158839:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xafe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.158844:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e68e5a/0xdb7edb52b8339d3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158853:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xafe:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.158856:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xafe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.158860:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e68e5a/0xdb7edb52b8339d3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158868:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079e68e5a/0xdb7edb52b8339d3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158876:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e68e5a/0xdb7edb52b8339d3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158884:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079e68e5a/0xdb7edb52b8339d3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158897:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1788572400.158952:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+154:3653:x1875449639172224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 138us (916us total) trans 4294968824 rc 0/0 00000100:00100000:2.0:1788572400.158959:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4337 00010000:00010000:2.0:1788572400.158975:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572400.158980:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2e13bcb/0xdb7edb52b8339d27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.158988:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.158993:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2e13bcb/0xdb7edb52b8339d27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159001:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2e13bcb/0xdb7edb52b8339d27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159041:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2e13bcb/0xdb7edb52b8339d27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159049:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2e13bcb/0xdb7edb52b8339d27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xafb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159067:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572400.159071:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e45d95c1/0xdb7edb52b8339d2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159078:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.159082:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e45d95c1/0xdb7edb52b8339d2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159090:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e45d95c1/0xdb7edb52b8339d2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159099:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e45d95c1/0xdb7edb52b8339d2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159107:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e45d95c1/0xdb7edb52b8339d2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xaff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159119:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572400.159123:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8339d35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159129:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.159133:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8339d35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159140:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8339d35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159148:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8339d35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159156:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a94370ec/0xdb7edb52b8339d35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xafa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159165:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.159168:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079e68e5a/0xdb7edb52b8339d3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159174:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.159176:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e68e5a/0xdb7edb52b8339d3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159189:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e68e5a/0xdb7edb52b8339d3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159197:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079e68e5a/0xdb7edb52b8339d3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159204:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079e68e5a/0xdb7edb52b8339d3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xafe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.159213:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.159215:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.159216:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.159222:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.159233:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572400.159264:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633de4a80/2, rc 0, transno 4294968823 00000100:00100000:2.0:1788572400.159278:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639171712:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572400.159286:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad50a80/2, rc 0, transno 4294968824 00000100:00100000:2.0:1788572400.159290:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639172224:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572400.159298:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633de4e00/2, rc 0, transno 4294968821 00000100:00100000:2.0:1788572400.159302:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639171840:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572400.159308:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad52300/2, rc 0, transno 4294968822 00000100:00100000:2.0:1788572400.159311:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639172352:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788572400.159827:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.159919:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639172736:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.159958:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.159984:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572400.159991:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639172864:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.160036:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.160062:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639172736 00000100:00100000:2.0:1788572400.160068:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639172736 00000100:00100000:2.0:1788572400.160102:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639172864 00000100:00100000:2.0:1788572400.160105:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639172864 00000100:00100000:2.0:1788572400.160120:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4338 00000100:00100000:2.0:1788572400.160126:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+155:3652:x1875449639172736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.160142:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2818 count 1 00002000:00010000:2.0:1788572400.160162:0:43974:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.160168:0:43974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8f7889/0xdb7edb52b8339d43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160178:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb02:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.160182:0:43974:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb02:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.160187:0:43974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e8f7889/0xdb7edb52b8339d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160198:0:43974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e8f7889/0xdb7edb52b8339d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160207:0:43974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8f7889/0xdb7edb52b8339d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160214:0:43974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e8f7889/0xdb7edb52b8339d43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160229:0:43974:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572400.160283:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.160288:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e8f7889/0xdb7edb52b8339d43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160295:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.160299:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8f7889/0xdb7edb52b8339d43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160306:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8f7889/0xdb7edb52b8339d43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160319:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e8f7889/0xdb7edb52b8339d43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160326:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e8f7889/0xdb7edb52b8339d43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160340:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.160342:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.160344:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.160381:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4339 00000100:00100000:2.0:1788572400.160389:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+155:3652:x1875449639172864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.160401:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2819 count 1 00002000:00010000:2.0:1788572400.160416:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.160422:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8339d4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160432:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb03:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.160435:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb03:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.160439:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8339d4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160448:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8339d4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160454:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8339d4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160461:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8339d4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160473:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788572400.160521:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.160526:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8339d4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160533:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.160536:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8339d4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160543:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8339d4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160554:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8339d4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160561:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071bc60cb/0xdb7edb52b8339d4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.160575:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.160577:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.160579:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.165835:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572400.165911:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.165920:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004478bfcc/0xdb7edb52b8339d20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.165931:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a957e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.165935:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004478bfcc/0xdb7edb52b8339d20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.165946:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004478bfcc/0xdb7edb52b8339d20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.165967:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004478bfcc/0xdb7edb52b8339d20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.165976:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004478bfcc/0xdb7edb52b8339d20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb00:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.166024:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.166026:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.166028:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572400.166311:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6414a6300/2, rc 0, transno 12884902057 00000100:00100000:1.0:1788572400.166323:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639170560:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572400.166350:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572400.166387:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6414a4380/2, rc 0, transno 12884902060 00000100:00100000:1.0:1788572400.166391:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639171072:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572400.166401:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6414a5f80/2, rc 0, transno 12884902056 00000100:00100000:1.0:1788572400.166404:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639170944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.166428:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639172992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.166512:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572400.166701:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad53b80/2, rc 0, transno 4294968820 00000100:00100000:1.0:1788572400.166714:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639171968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.166771:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788572400.166777:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639171584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.166803:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.171268:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639172992 00000100:00100000:3.0:1788572400.171285:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639172992 00000100:00100000:3.0:1788572400.171337:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639171584 00000100:00100000:3.0:1788572400.171341:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639171584 00000100:00100000:3.0:1788572400.171367:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4340 00000100:00100000:3.0:1788572400.171377:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+157:3650:x1875449639172992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.171418:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2820 count 1 00002000:00010000:3.0:1788572400.171460:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.171469:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d9f7c33/0xdb7edb52b8339d51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.171496:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb04:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.171502:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb04:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.171509:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d9f7c33/0xdb7edb52b8339d51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.171522:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d9f7c33/0xdb7edb52b8339d51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.171533:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d9f7c33/0xdb7edb52b8339d51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.171542:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d9f7c33/0xdb7edb52b8339d51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.171561:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.183145:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+158:3650:x1875449639172992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11761us (16625us total) trans 4294968825 rc 0/0 00000100:00100000:3.0:1788572400.183158:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4340 00000100:00100000:3.0:1788572400.183193:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4341 00000100:00100000:3.0:1788572400.183203:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+157:3650:x1875449639171584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.183235:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2809 count 1 00002000:00010000:3.0:1788572400.183263:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xaf9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.183270:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000542dac66/0xdb7edb52b8339d58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xaf9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183285:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaf9:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.183290:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xaf9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.183297:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000542dac66/0xdb7edb52b8339d58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183311:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000542dac66/0xdb7edb52b8339d58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183322:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000542dac66/0xdb7edb52b8339d58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183330:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000542dac66/0xdb7edb52b8339d58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183361:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572400.183434:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+158:3650:x1875449639171584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 234us (16630us total) trans 4294968826 rc 0/0 00000100:00100000:3.0:1788572400.183441:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4341 00010000:00010000:3.0:1788572400.183467:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572400.183474:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d9f7c33/0xdb7edb52b8339d51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183497:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a956c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.183501:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d9f7c33/0xdb7edb52b8339d51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183510:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d9f7c33/0xdb7edb52b8339d51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183530:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d9f7c33/0xdb7edb52b8339d51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183539:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d9f7c33/0xdb7edb52b8339d51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183563:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.183567:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000542dac66/0xdb7edb52b8339d58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183574:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a956600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.183578:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000542dac66/0xdb7edb52b8339d58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183586:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000542dac66/0xdb7edb52b8339d58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183596:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000542dac66/0xdb7edb52b8339d58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183605:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000542dac66/0xdb7edb52b8339d58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xaf9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.183616:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.183618:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.183620:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.183626:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572400.183694:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+158:3650:x1875449639172480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26185us (27280us total) trans 4294968827 rc 0/0 00000100:00100000:3.0:1788572400.183702:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4333 00000004:00080000:1.0:1788572400.183967:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633de4700/2, rc 0, transno 4294968826 00000100:00100000:1.0:1788572400.183990:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633de4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639171584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.184001:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639172096:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.184062:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.184092:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639172096 00000100:00100000:1.0:1788572400.184098:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639172096 00000100:00100000:1.0:1788572400.184131:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4342 00000100:00100000:1.0:1788572400.184137:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+158:3650:x1875449639172096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572400.184153:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2813 count 1 00002000:00010000:1.0:1788572400.184173:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xafd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.184179:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cad6893/0xdb7edb52b8339d5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184191:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xafd:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.184195:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xafd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.184200:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cad6893/0xdb7edb52b8339d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184217:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cad6893/0xdb7edb52b8339d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184226:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cad6893/0xdb7edb52b8339d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184235:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cad6893/0xdb7edb52b8339d5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184251:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.184326:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+159:3650:x1875449639172096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 189us (263us total) trans 4294968828 rc 0/0 00000100:00100000:1.0:1788572400.184334:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4342 00010000:00010000:1.0:1788572400.184353:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572400.184358:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cad6893/0xdb7edb52b8339d5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184367:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61e524600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.184371:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cad6893/0xdb7edb52b8339d5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184381:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cad6893/0xdb7edb52b8339d5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184394:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cad6893/0xdb7edb52b8339d5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184403:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cad6893/0xdb7edb52b8339d5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xafd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184423:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.184425:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.184427:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572400.184444:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad50700/2, rc 0, transno 4294968828 00000100:00100000:1.0:1788572400.184449:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639172096:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.184456:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639172608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.184496:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.184521:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639172608 00000100:00100000:1.0:1788572400.184525:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639172608 00000100:00100000:1.0:1788572400.184546:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4343 00000100:00100000:1.0:1788572400.184552:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+159:3650:x1875449639172608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572400.184564:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2817 count 1 00002000:00010000:1.0:1788572400.184579:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb01:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.184596:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c8efbf6/0xdb7edb52b8339d66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184606:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb01:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.184609:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb01:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.184614:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c8efbf6/0xdb7edb52b8339d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184624:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c8efbf6/0xdb7edb52b8339d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184634:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c8efbf6/0xdb7edb52b8339d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184642:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c8efbf6/0xdb7edb52b8339d66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.184654:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.184712:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+160:3650:x1875449639172608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 160us (216us total) trans 4294968829 rc 0/0 00000100:00100000:1.0:1788572400.184718:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4343 00000004:00080000:1.0:1788572400.184744:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f6300/2, rc 0, transno 4294968829 00000100:00100000:1.0:1788572400.184750:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639172608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.184756:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639173120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.184777:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.184795:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639173120 00000100:00100000:1.0:1788572400.184799:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639173120 00010000:00010000:3.0:1788572400.185959:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.185972:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c8efbf6/0xdb7edb52b8339d66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.185985:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.185989:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c8efbf6/0xdb7edb52b8339d66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.185999:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c8efbf6/0xdb7edb52b8339d66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.186031:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c8efbf6/0xdb7edb52b8339d66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.186039:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c8efbf6/0xdb7edb52b8339d66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb01:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.186070:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.186072:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.186074:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572400.186184:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639173248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.186231:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.186270:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572400.186275:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639173376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.186293:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.186318:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639173248 00000100:00100000:3.0:1788572400.186324:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639173248 00000100:00100000:2.0:1788572400.186416:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639173376 00000100:00100000:2.0:1788572400.186421:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639173376 00000100:00100000:1.0:1788572400.186475:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4344 00000100:00100000:1.0:1788572400.186499:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+162:3650:x1875449639173120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572400.186527:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2821 count 1 00002000:00010000:1.0:1788572400.186554:0:17011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.186560:0:17011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ebabd40/0xdb7edb52b8339d6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.186571:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb05:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.186577:0:17011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb05:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.186583:0:17011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ebabd40/0xdb7edb52b8339d6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.186595:0:17011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ebabd40/0xdb7edb52b8339d6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.186603:0:17011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ebabd40/0xdb7edb52b8339d6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.186610:0:17011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ebabd40/0xdb7edb52b8339d6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.186625:0:17011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.186754:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+163:3650:x1875449639173120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 258us (1974us total) trans 4294968830 rc 0/0 00000100:00100000:3.0:1788572400.186967:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4345 00000100:00100000:3.0:1788572400.186977:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+163:3652:x1875449639173248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.186992:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2822 count 1 00002000:00010000:3.0:1788572400.187029:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.187035:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aabda003/0xdb7edb52b8339d74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187044:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb06:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.187046:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb06:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.187051:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aabda003/0xdb7edb52b8339d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187061:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aabda003/0xdb7edb52b8339d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187076:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aabda003/0xdb7edb52b8339d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187083:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aabda003/0xdb7edb52b8339d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187099:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572400.187178:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+164:3652:x1875449639173248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 203us (946us total) trans 4294968831 rc 0/0 00000100:00100000:3.0:1788572400.187185:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4345 00010000:00010000:3.0:1788572400.187207:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572400.187212:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ebabd40/0xdb7edb52b8339d6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187219:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.187223:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ebabd40/0xdb7edb52b8339d6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187231:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ebabd40/0xdb7edb52b8339d6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187243:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ebabd40/0xdb7edb52b8339d6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187251:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ebabd40/0xdb7edb52b8339d6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187270:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.187273:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aabda003/0xdb7edb52b8339d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187280:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a957200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.187283:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aabda003/0xdb7edb52b8339d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187290:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aabda003/0xdb7edb52b8339d74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187300:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aabda003/0xdb7edb52b8339d74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187308:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aabda003/0xdb7edb52b8339d74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.187325:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.187327:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.187328:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572400.187368:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad51c00/2, rc 0, transno 4294968831 00000100:00100000:3.0:1788572400.187381:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639173248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.190511:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+164:3652:x1875449639172736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30372us (30540us total) trans 4294968832 rc 0/0 00000100:00100000:3.0:1788572400.190525:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4338 00000004:00080000:3.0:1788572400.190617:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f7800/2, rc 0, transno 4294968832 00000100:00100000:3.0:1788572400.190629:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639172736:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.190706:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639173760:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.190743:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.190787:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639173760 00000100:00100000:3.0:1788572400.190793:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639173760 00000100:00100000:3.0:1788572400.190843:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4346 00000100:00100000:3.0:1788572400.190852:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+164:3652:x1875449639173760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.190875:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2826 count 1 00002000:00010000:3.0:1788572400.190906:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.190915:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a43f04a7/0xdb7edb52b8339d7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.190931:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0a:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.190936:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.190943:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a43f04a7/0xdb7edb52b8339d7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.190959:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a43f04a7/0xdb7edb52b8339d7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.190969:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a43f04a7/0xdb7edb52b8339d7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.190976:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a43f04a7/0xdb7edb52b8339d7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.190999:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.191135:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+165:3652:x1875449639173760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 283us (391us total) trans 4294968833 rc 0/0 00000100:00100000:3.0:1788572400.191142:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4346 00010000:00010000:3.0:1788572400.191160:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.191166:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a43f04a7/0xdb7edb52b8339d7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.191174:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a956000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.191179:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a43f04a7/0xdb7edb52b8339d7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.191187:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a43f04a7/0xdb7edb52b8339d7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.191203:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a43f04a7/0xdb7edb52b8339d7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.191211:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a43f04a7/0xdb7edb52b8339d7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.191232:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.191233:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.191235:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572400.191253:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad50e00/2, rc 0, transno 4294968833 00000100:00100000:3.0:1788572400.191262:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639173760:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.191299:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572400.191307:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639173888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.191332:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572400.191979:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 49 changes, 8 in progress, 0 in flight, 143 done 00000100:00100000:3.0:1788572400.192079:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639174272:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.192113:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.192135:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639174784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.192153:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.192170:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572400.192175:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639174400:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.192192:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.192206:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639174912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.192221:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.192245:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639173888 00000100:00100000:3.0:1788572400.192250:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639173888 00000100:00100000:3.0:1788572400.192276:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639174272 00000100:00100000:3.0:1788572400.192278:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639174272 00000100:00100000:3.0:1788572400.192291:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639174784 00000100:00100000:3.0:1788572400.192294:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639174784 00000100:00100000:3.0:1788572400.192306:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639174400 00000100:00100000:3.0:1788572400.192308:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639174400 00000100:00100000:3.0:1788572400.192319:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639174912 00000100:00100000:3.0:1788572400.192321:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639174912 00000100:00100000:3.0:1788572400.192335:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4347 00000100:00100000:3.0:1788572400.192341:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+165:3652:x1875449639173888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.192362:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2827 count 1 00002000:00010000:3.0:1788572400.192386:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.192392:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008426fdfd/0xdb7edb52b8339d82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192404:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0b:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.192407:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.192413:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008426fdfd/0xdb7edb52b8339d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192424:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008426fdfd/0xdb7edb52b8339d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192434:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008426fdfd/0xdb7edb52b8339d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192442:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008426fdfd/0xdb7edb52b8339d82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192456:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.192561:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+166:3652:x1875449639173888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 218us (1227us total) trans 4294968834 rc 0/0 00000100:00100000:3.0:1788572400.192568:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4347 00000100:00100000:3.0:1788572400.192582:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4348 00000100:00100000:3.0:1788572400.192589:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3652:x1875449639174272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.192601:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2820 count 1 00002000:00010000:3.0:1788572400.192689:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb04:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.192694:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092edaee2/0xdb7edb52b8339d89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192704:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb04:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.192707:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb04:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.192712:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092edaee2/0xdb7edb52b8339d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192723:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092edaee2/0xdb7edb52b8339d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192731:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092edaee2/0xdb7edb52b8339d89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192739:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092edaee2/0xdb7edb52b8339d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192753:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572400.192827:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3652:x1875449639174272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 238us (712us total) trans 12884902064 rc 0/0 00000100:00100000:3.0:1788572400.192834:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4348 00000100:00100000:3.0:1788572400.192846:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4349 00000100:00100000:3.0:1788572400.192852:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3652:x1875449639174784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.192864:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2824 count 1 00002000:00010000:3.0:1788572400.192913:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.192918:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018739855/0xdb7edb52b8339d90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192931:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb08:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.192933:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb08:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.192937:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018739855/0xdb7edb52b8339d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192945:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018739855/0xdb7edb52b8339d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192952:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018739855/0xdb7edb52b8339d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192959:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018739855/0xdb7edb52b8339d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.192972:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788572400.193056:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3652:x1875449639174784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 203us (901us total) trans 12884902065 rc 0/0 00000100:00100000:3.0:1788572400.193062:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4349 00000100:00100000:3.0:1788572400.193075:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4350 00000100:00100000:3.0:1788572400.193080:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3652:x1875449639174400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.193092:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2821 count 1 00002000:00010000:3.0:1788572400.193137:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb05:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.193143:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b654a624/0xdb7edb52b8339d97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.193155:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb05:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.193157:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb05:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.193162:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b654a624/0xdb7edb52b8339d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.193171:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b654a624/0xdb7edb52b8339d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.193179:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b654a624/0xdb7edb52b8339d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.193186:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b654a624/0xdb7edb52b8339d97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.193200:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1788572400.193257:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3652:x1875449639174400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 176us (1063us total) trans 12884902066 rc 0/0 00000100:00100000:3.0:1788572400.193263:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4350 00000100:00100000:3.0:1788572400.193274:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4351 00000100:00100000:3.0:1788572400.193280:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3652:x1875449639174912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.193291:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2825 count 1 00002000:00010000:3.0:1788572400.193334:0:43967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.193339:0:43967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050e98e09/0xdb7edb52b8339d9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.193352:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb09:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.193356:0:43967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb09:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.193359:0:43967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050e98e09/0xdb7edb52b8339d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.193368:0:43967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050e98e09/0xdb7edb52b8339d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.193377:0:43967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050e98e09/0xdb7edb52b8339d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.193385:0:43967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050e98e09/0xdb7edb52b8339d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.193394:0:43967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1788572400.193451:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3652:x1875449639174912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 170us (1227us total) trans 12884902067 rc 0/0 00000100:00100000:3.0:1788572400.193457:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4351 00000100:00100000:2.0:1788572400.195814:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4352 00000100:00100000:2.0:1788572400.196094:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+165:3652:x1875449639173376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.196133:0:43973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2823 count 1 00002000:00010000:2.0:1788572400.196175:0:43973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.196184:0:43973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3b796ac/0xdb7edb52b8339da5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.196203:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb07:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.196207:0:43973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb07:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.196215:0:43973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3b796ac/0xdb7edb52b8339da5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.196232:0:43973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3b796ac/0xdb7edb52b8339da5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.196253:0:43973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3b796ac/0xdb7edb52b8339da5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.196262:0:43973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3b796ac/0xdb7edb52b8339da5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.196276:0:43973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1788572400.196456:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+166:3652:x1875449639173376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 379us (10160us total) trans 4294968835 rc 0/0 00000100:00100000:0.0:1788572400.197092:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639173632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.197145:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572400.197180:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639174144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572400.197201:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788572400.197246:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788572400.197255:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008426fdfd/0xdb7edb52b8339d82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197267:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a956800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.197272:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008426fdfd/0xdb7edb52b8339d82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197290:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008426fdfd/0xdb7edb52b8339d82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197310:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008426fdfd/0xdb7edb52b8339d82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197319:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008426fdfd/0xdb7edb52b8339d82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197347:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572400.197351:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092edaee2/0xdb7edb52b8339d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197358:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a956400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.197362:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092edaee2/0xdb7edb52b8339d89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197370:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092edaee2/0xdb7edb52b8339d89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197381:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092edaee2/0xdb7edb52b8339d89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197389:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092edaee2/0xdb7edb52b8339d89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb04:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197410:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572400.197414:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018739855/0xdb7edb52b8339d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197421:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a957800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.197425:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018739855/0xdb7edb52b8339d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197433:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018739855/0xdb7edb52b8339d90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197443:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018739855/0xdb7edb52b8339d90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197451:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018739855/0xdb7edb52b8339d90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197463:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572400.197466:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b654a624/0xdb7edb52b8339d97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197473:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a957400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.197477:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b654a624/0xdb7edb52b8339d97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197503:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b654a624/0xdb7edb52b8339d97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197514:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b654a624/0xdb7edb52b8339d97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197522:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b654a624/0xdb7edb52b8339d97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb05:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197536:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572400.197540:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050e98e09/0xdb7edb52b8339d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197547:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a957600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.197550:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050e98e09/0xdb7edb52b8339d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197559:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050e98e09/0xdb7edb52b8339d9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197568:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050e98e09/0xdb7edb52b8339d9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197577:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050e98e09/0xdb7edb52b8339d9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197607:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.197611:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3b796ac/0xdb7edb52b8339da5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197618:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.197622:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3b796ac/0xdb7edb52b8339da5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197631:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3b796ac/0xdb7edb52b8339da5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197640:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3b796ac/0xdb7edb52b8339da5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197648:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3b796ac/0xdb7edb52b8339da5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.197663:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.197664:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.197666:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.197675:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.197683:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572400.205726:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4344 00000100:00100000:0.0:1788572400.207558:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639174656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572400.207639:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.212311:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639173632 00000100:00100000:1.0:1788572400.212328:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639173632 00000100:00100000:1.0:1788572400.212399:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639174144 00000100:00100000:1.0:1788572400.212403:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639174144 00000100:00100000:1.0:1788572400.212424:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4353 00000100:00100000:1.0:1788572400.212433:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+166:3651:x1875449639173632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572400.212472:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2825 count 1 00002000:00010000:1.0:1788572400.212525:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb09:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.212534:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339dac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.212557:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb09:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.212562:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb09:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.212570:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339dac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.212598:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339dac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.212609:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339dac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.212617:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339dac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.212638:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.218995:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+167:3651:x1875449639173632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6551us (21839us total) trans 4294968836 rc 0/0 00000100:00100000:1.0:1788572400.219028:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4353 00000100:00100000:1.0:1788572400.219071:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4354 00000100:00100000:1.0:1788572400.219087:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+17:3651:x1875449639174144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.219122:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2819 count 1 00002000:00010000:1.0:1788572400.219250:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb03:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.219258:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339db3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219281:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb03:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.219286:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb03:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.219293:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219310:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219321:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219329:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219371:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572400.219533:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+18:3651:x1875449639174144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 453us (22329us total) trans 12884902068 rc 0/0 00000100:00100000:1.0:1788572400.219541:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4354 00010000:00010000:1.0:1788572400.219579:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572400.219891:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339dac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219903:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.219908:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339dac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219923:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339dac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219941:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339dac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219949:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339dac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb09:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219974:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572400.219977:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219984:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.219987:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.219994:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339db3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.220027:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339db3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.220035:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339db3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb03:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.220054:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.220056:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.220058:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.220072:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.220077:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572400.220115:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641104700/2, rc 0, transno 4294968830 00000100:00100000:1.0:1788572400.220132:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639173120:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572400.220192:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f5f80/2, rc 0, transno 4294968825 00000100:00100000:1.0:1788572400.220200:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639172992:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572400.220226:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad53800/2, rc 0, transno 4294968827 00000100:00100000:1.0:1788572400.220234:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639172480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.220267:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639173504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.220367:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639175296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.220737:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639175168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.220765:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572400.220792:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad51500/2, rc 0, transno 4294968836 00000100:00100000:0.0:1788572400.220800:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639173632:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572400.220811:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad52680/2, rc 0, transno 12884902068 00000100:00100000:0.0:1788572400.220831:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639174144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572400.220854:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639174656 00000100:00100000:0.0:1788572400.220860:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639174656 00000100:00100000:0.0:1788572400.220894:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639175168 00000100:00100000:0.0:1788572400.220912:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639175168 00000100:00100000:0.0:1788572400.220935:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4355 00000100:00100000:0.0:1788572400.220943:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+18:3651:x1875449639174656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572400.220967:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2823 count 1 00002000:00010000:0.0:1788572400.221074:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb07:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.221080:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a8a099e/0xdb7edb52b8339dba lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221092:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb07:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.221097:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb07:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.221102:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a8a099e/0xdb7edb52b8339dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221114:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a8a099e/0xdb7edb52b8339dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221123:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a8a099e/0xdb7edb52b8339dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221130:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a8a099e/0xdb7edb52b8339dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221146:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572400.221241:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+19:3651:x1875449639174656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 298us (13601us total) trans 12884902069 rc 0/0 00000100:00100000:0.0:1788572400.221248:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4355 00000100:00100000:0.0:1788572400.221264:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4356 00000100:00100000:0.0:1788572400.221270:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+167:3651:x1875449639175168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.221282:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2829 count 1 00002000:00010000:0.0:1788572400.221298:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.221303:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092faada8/0xdb7edb52b8339dc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221311:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0d:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.221314:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.221317:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092faada8/0xdb7edb52b8339dc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221326:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092faada8/0xdb7edb52b8339dc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221334:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092faada8/0xdb7edb52b8339dc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221341:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092faada8/0xdb7edb52b8339dc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221355:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572400.221429:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+168:3651:x1875449639175168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 159us (663us total) trans 4294968837 rc 0/0 00000100:00100000:0.0:1788572400.221436:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4356 00010000:00010000:0.0:1788572400.221556:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572400.221562:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a8a099e/0xdb7edb52b8339dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221570:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172e000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.221575:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a8a099e/0xdb7edb52b8339dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221594:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a8a099e/0xdb7edb52b8339dba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221610:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a8a099e/0xdb7edb52b8339dba lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221618:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a8a099e/0xdb7edb52b8339dba lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb07:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221638:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.221641:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092faada8/0xdb7edb52b8339dc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221647:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172ea00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.221651:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092faada8/0xdb7edb52b8339dc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221658:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092faada8/0xdb7edb52b8339dc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221667:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092faada8/0xdb7edb52b8339dc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221673:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092faada8/0xdb7edb52b8339dc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221685:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.221687:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.221689:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572400.221716:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641105880/2, rc 0, transno 4294968837 00000100:00100000:0.0:1788572400.221722:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639175168:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572400.221732:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6377c2d80/2, rc 0, transno 12884902069 00000100:00100000:0.0:1788572400.221736:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639174656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572400.221801:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572400.221809:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e503931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639175552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.221836:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572400.221863:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639175552 00000100:00100000:0.0:1788572400.221868:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639175552 00000100:00100000:0.0:1788572400.221892:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4357 00000100:00100000:0.0:1788572400.221898:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+168:3651:x1875449639175552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.221911:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2832 count 1 00002000:00010000:0.0:1788572400.221927:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.221933:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a77894b/0xdb7edb52b8339dc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221942:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb10:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.221945:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.221950:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a77894b/0xdb7edb52b8339dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221960:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a77894b/0xdb7edb52b8339dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221968:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a77894b/0xdb7edb52b8339dc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221975:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a77894b/0xdb7edb52b8339dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.221988:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572400.222079:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+169:3651:x1875449639175552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 180us (242us total) trans 4294968838 rc 0/0 00000100:00100000:0.0:1788572400.222086:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4357 00010000:00010000:0.0:1788572400.222102:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.222107:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a77894b/0xdb7edb52b8339dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222115:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172f000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.222118:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a77894b/0xdb7edb52b8339dc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222126:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a77894b/0xdb7edb52b8339dc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222138:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a77894b/0xdb7edb52b8339dc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222145:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a77894b/0xdb7edb52b8339dc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222160:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.222162:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.222164:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572400.222179:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e503931f80/2, rc 0, transno 4294968838 00000100:00100000:0.0:1788572400.222186:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e503931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639175552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.222235:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639175680:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.222256:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572400.222280:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572400.222306:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e634ad6d80/2, rc 0, transno 12884902066 00000100:00100000:0.0:1788572400.222310:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639174400:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572400.222319:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6377c1880/2, rc 0, transno 12884902067 00000100:00100000:0.0:1788572400.222322:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639174912:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572400.222330:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad52a00/2, rc 0, transno 12884902064 00000100:00100000:0.0:1788572400.222333:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639174272:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572400.222341:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6377c2a00/2, rc 0, transno 12884902065 00000100:00100000:0.0:1788572400.222345:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639174784:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572400.222354:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad50000/2, rc 0, transno 4294968834 00000100:00100000:0.0:1788572400.222360:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639173888:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572400.222370:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad51f80/2, rc 0, transno 4294968835 00000100:00100000:0.0:1788572400.222373:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639173376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.222381:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572400.222386:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639175424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.222410:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572400.222436:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639175680 00000100:00100000:0.0:1788572400.222440:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639175680 00000100:00100000:0.0:1788572400.222461:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639175296 00000100:00100000:0.0:1788572400.222463:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639175296 00000100:00100000:0.0:1788572400.222478:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639175424 00000100:00100000:0.0:1788572400.222492:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639175424 00000100:00100000:0.0:1788572400.222512:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4358 00000100:00100000:0.0:1788572400.222519:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+171:3651:x1875449639175680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.222532:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2833 count 1 00002000:00010000:0.0:1788572400.222552:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.222558:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b873140/0xdb7edb52b8339dcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222566:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb11:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.222569:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.222573:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b873140/0xdb7edb52b8339dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222583:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b873140/0xdb7edb52b8339dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222591:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b873140/0xdb7edb52b8339dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222597:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b873140/0xdb7edb52b8339dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222615:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572400.222694:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+172:3651:x1875449639175680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 175us (436us total) trans 4294968839 rc 0/0 00000100:00100000:0.0:1788572400.222700:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4358 00000100:00100000:0.0:1788572400.222714:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4359 00000100:00100000:0.0:1788572400.222720:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+171:3652:x1875449639175296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.222731:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2830 count 1 00002000:00010000:0.0:1788572400.222745:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.222750:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4a8f4b9/0xdb7edb52b8339dd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222759:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0e:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.222762:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.222766:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a8f4b9/0xdb7edb52b8339dd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222776:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4a8f4b9/0xdb7edb52b8339dd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222784:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4a8f4b9/0xdb7edb52b8339dd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222792:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4a8f4b9/0xdb7edb52b8339dd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222809:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572400.222872:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+172:3652:x1875449639175296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 152us (590us total) trans 4294968840 rc 0/0 00000100:00100000:0.0:1788572400.222879:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4359 00000100:00100000:0.0:1788572400.222894:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4360 00000100:00100000:0.0:1788572400.222900:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+171:3652:x1875449639175424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.222911:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2831 count 1 00002000:00010000:0.0:1788572400.222926:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.222931:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009de111e5/0xdb7edb52b8339ddd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222940:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0f:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.222943:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.222948:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009de111e5/0xdb7edb52b8339ddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222957:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009de111e5/0xdb7edb52b8339ddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222966:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009de111e5/0xdb7edb52b8339ddd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222975:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009de111e5/0xdb7edb52b8339ddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.222994:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788572400.223074:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+172:3652:x1875449639175424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 173us (662us total) trans 4294968841 rc 0/0 00000100:00100000:0.0:1788572400.223081:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4360 00010000:00010000:0.0:1788572400.223097:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572400.223101:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b873140/0xdb7edb52b8339dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223109:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172e800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.223113:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b873140/0xdb7edb52b8339dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223122:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b873140/0xdb7edb52b8339dcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223135:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b873140/0xdb7edb52b8339dcf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223144:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b873140/0xdb7edb52b8339dcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223164:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572400.223167:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4a8f4b9/0xdb7edb52b8339dd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223181:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e64172f200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.223184:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a8f4b9/0xdb7edb52b8339dd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223193:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4a8f4b9/0xdb7edb52b8339dd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223203:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4a8f4b9/0xdb7edb52b8339dd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223211:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4a8f4b9/0xdb7edb52b8339dd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223222:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.223226:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009de111e5/0xdb7edb52b8339ddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223232:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.223236:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009de111e5/0xdb7edb52b8339ddd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223244:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009de111e5/0xdb7edb52b8339ddd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223254:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009de111e5/0xdb7edb52b8339ddd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223262:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009de111e5/0xdb7edb52b8339ddd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.223275:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.223277:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.223278:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.223283:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572400.223304:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ae3f480/2, rc 0, transno 4294968839 00000100:00100000:0.0:1788572400.223309:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639175680:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.223359:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572400.223366:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639176064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.223390:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572400.223416:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639176064 00000100:00100000:0.0:1788572400.223420:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639176064 00000100:00100000:0.0:1788572400.223447:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4361 00000100:00100000:0.0:1788572400.223453:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+172:3651:x1875449639176064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.223466:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2836 count 1 00000100:00100000:2.0:1788572400.224724:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4352 00000100:00100000:2.0:1788572400.224873:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+172:3652:x1875449639172864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 64483us (64834us total) trans 4294968842 rc 0/0 00000100:00100000:2.0:1788572400.224881:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4339 00010000:00010000:2.0:1788572400.225096:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.225109:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639176192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.225135:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.225158:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639176704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.225175:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.225192:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572400.225197:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639176576:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.225214:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.225238:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639176192 00000100:00100000:2.0:1788572400.225243:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639176192 00000100:00100000:2.0:1788572400.225268:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639176704 00000100:00100000:2.0:1788572400.225271:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639176704 00000100:00100000:2.0:1788572400.225284:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639176576 00000100:00100000:2.0:1788572400.225287:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639176576 00000100:00100000:2.0:1788572400.225303:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4362 00000100:00100000:2.0:1788572400.225309:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3651:x1875449639176192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.225328:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2826 count 1 00002000:00010000:2.0:1788572400.225433:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb0a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.225441:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8339deb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225457:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0a:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.225461:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.225468:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8339deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225491:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8339deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225503:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8339deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225512:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8339deb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225530:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572400.225637:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+22:3651:x1875449639176192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 327us (500us total) trans 12884902070 rc 0/0 00000100:00100000:2.0:1788572400.225644:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4362 00000100:00100000:2.0:1788572400.225657:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4363 00000100:00100000:2.0:1788572400.225663:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3651:x1875449639176704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.225674:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2830 count 1 00002000:00010000:2.0:1788572400.225717:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb0e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.225722:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8339df2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225730:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0e:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.225733:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.225737:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8339df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225746:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8339df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225754:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8339df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225761:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8339df2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225774:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572400.225834:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+22:3651:x1875449639176704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 171us (657us total) trans 12884902071 rc 0/0 00000100:00100000:2.0:1788572400.225841:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4363 00000100:00100000:2.0:1788572400.225854:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4364 00000100:00100000:2.0:1788572400.225861:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+21:3651:x1875449639176576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.225871:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2829 count 1 00002000:00010000:2.0:1788572400.225911:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb0d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.225916:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339df9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225924:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0d:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.225927:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.225932:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339df9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225941:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339df9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225949:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339df9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225956:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339df9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.225969:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788572400.226044:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+22:3651:x1875449639176576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 184us (828us total) trans 12884902072 rc 0/0 00000100:00100000:2.0:1788572400.226050:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4364 00010000:00010000:2.0:1788572400.226075:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572400.226081:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8339deb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226093:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641095a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.226097:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8339deb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226105:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8339deb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226121:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8339deb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226128:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000037daf32/0xdb7edb52b8339deb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb0a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226149:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572400.226152:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8339df2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226158:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641094000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.226161:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8339df2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226169:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8339df2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226178:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8339df2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226185:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b3a6e5/0xdb7edb52b8339df2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb0e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226198:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.226201:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339df9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226208:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.226211:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339df9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226219:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339df9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226227:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339df9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226234:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339df9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb0d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226245:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.226247:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.226249:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.226264:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.226268:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572400.226298:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f7b80/2, rc 0, transno 12884902072 00000100:00100000:2.0:1788572400.226309:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639176576:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.226319:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f5880/2, rc 0, transno 12884902070 00000100:00100000:2.0:1788572400.226323:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639176192:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.226329:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f4700/2, rc 0, transno 12884902071 00000100:00100000:2.0:1788572400.226332:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639176704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.226420:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639177216:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.226449:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.226474:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572400.226479:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639177088:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.226514:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.226539:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639177216 00000100:00100000:2.0:1788572400.226544:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639177216 00000100:00100000:2.0:1788572400.226569:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639177088 00000100:00100000:2.0:1788572400.226573:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639177088 00000100:00100000:2.0:1788572400.226588:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4365 00000100:00100000:2.0:1788572400.226594:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3651:x1875449639177216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.226608:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2834 count 1 00002000:00010000:2.0:1788572400.226665:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.226672:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339e00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226681:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb12:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.226685:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.226688:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339e00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226702:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339e00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226709:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339e00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226717:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339e00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226729:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572400.226801:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3651:x1875449639177216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 206us (352us total) trans 12884902073 rc 0/0 00000100:00100000:2.0:1788572400.226807:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4365 00000100:00100000:2.0:1788572400.226820:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4366 00000100:00100000:2.0:1788572400.226826:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3651:x1875449639177088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.226838:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2833 count 1 00002000:00010000:2.0:1788572400.226881:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.226886:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e1f9d36/0xdb7edb52b8339e07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226895:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb11:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.226898:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.226902:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e1f9d36/0xdb7edb52b8339e07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226917:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e1f9d36/0xdb7edb52b8339e07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226926:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e1f9d36/0xdb7edb52b8339e07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226933:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e1f9d36/0xdb7edb52b8339e07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.226945:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572400.227001:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3651:x1875449639177088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 174us (485us total) trans 12884902074 rc 0/0 00000100:00100000:2.0:1788572400.227031:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4366 00010000:00010000:2.0:1788572400.227051:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572400.227055:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339e00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.227063:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.227066:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339e00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.227074:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339e00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.227086:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339e00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.227094:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339e00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.227108:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.227111:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e1f9d36/0xdb7edb52b8339e07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.227118:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1ae00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.227121:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e1f9d36/0xdb7edb52b8339e07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.227128:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e1f9d36/0xdb7edb52b8339e07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.227137:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e1f9d36/0xdb7edb52b8339e07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.227144:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e1f9d36/0xdb7edb52b8339e07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.227155:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.227156:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.227158:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.227165:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572400.227183:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f4e00/2, rc 0, transno 12884902074 00000100:00100000:2.0:1788572400.227192:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639177088:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.227202:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f5180/2, rc 0, transno 12884902073 00000100:00100000:2.0:1788572400.227205:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639177216:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572400.227264:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.227294:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639175936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.227320:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.227339:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639176448:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.227358:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.227373:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639176960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.227391:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.227404:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639177472:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.227420:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.227439:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788572400.227445:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639175808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.227469:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.231908:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639175936 00000100:00100000:1.0:1788572400.231924:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639175936 00000100:00100000:1.0:1788572400.232000:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639176448 00000100:00100000:1.0:1788572400.232022:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639176448 00000100:00100000:1.0:1788572400.232072:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639176960 00000100:00100000:1.0:1788572400.232076:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639176960 00000100:00100000:1.0:1788572400.232097:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639177472 00000100:00100000:1.0:1788572400.232101:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639177472 00000100:00100000:1.0:1788572400.232115:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639175808 00000100:00100000:1.0:1788572400.232118:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639175808 00000100:00100000:1.0:1788572400.232137:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4367 00000100:00100000:1.0:1788572400.232146:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+173:3653:x1875449639175936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572400.232180:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2835 count 1 00002000:00010000:1.0:1788572400.232215:0:43972:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.232223:0:43972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339e0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.232240:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb13:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.232244:0:43972:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.232251:0:43972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.232267:0:43972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.232277:0:43972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339e0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.232285:0:43972:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.232302:0:43972:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.232661:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4368 00000100:00100000:3.0:1788572400.232675:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+26:3653:x1875449639176448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.232694:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2828 count 1 00002000:00010000:3.0:1788572400.232783:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.232789:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006daead8a/0xdb7edb52b8339e15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.232799:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0c:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.232801:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.232806:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006daead8a/0xdb7edb52b8339e15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.232817:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006daead8a/0xdb7edb52b8339e15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.232839:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006daead8a/0xdb7edb52b8339e15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.232846:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006daead8a/0xdb7edb52b8339e15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.232862:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788572400.233018:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.233027:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076698c84/0xdb7edb52b8339de4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.233035:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb14:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.233038:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.233042:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076698c84/0xdb7edb52b8339de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.233059:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076698c84/0xdb7edb52b8339de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.233067:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076698c84/0xdb7edb52b8339de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.233074:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076698c84/0xdb7edb52b8339de4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.233090:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788572400.233250:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639176320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.236847:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+27:3653:x1875449639176448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4166us (9476us total) trans 12884902075 rc 0/0 00000100:00100000:3.0:1788572400.236863:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4368 00000100:00100000:3.0:1788572400.236902:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4369 00000100:00100000:3.0:1788572400.236916:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+26:3653:x1875449639176960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.236950:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2832 count 1 00002000:00010000:3.0:1788572400.237089:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.237097:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c554deb/0xdb7edb52b8339e1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237117:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb10:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.237121:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.237128:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c554deb/0xdb7edb52b8339e1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237142:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c554deb/0xdb7edb52b8339e1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237152:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c554deb/0xdb7edb52b8339e1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237159:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c554deb/0xdb7edb52b8339e1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237189:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1788572400.237312:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+27:3653:x1875449639176960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 401us (9918us total) trans 12884902076 rc 0/0 00000100:00100000:3.0:1788572400.237319:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4369 00000100:00100000:3.0:1788572400.237334:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4370 00000100:00100000:3.0:1788572400.237342:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+26:3653:x1875449639177472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.237354:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2836 count 1 00002000:00010000:3.0:1788572400.237400:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.237405:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b8339e23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237418:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb14:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.237422:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.237426:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b8339e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237436:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b8339e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237444:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b8339e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237451:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b8339e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237460:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1788572400.237532:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+27:3653:x1875449639177472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 191us (10110us total) trans 12884902077 rc 0/0 00000100:00100000:3.0:1788572400.237538:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4370 00000100:00100000:3.0:1788572400.237552:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4371 00000100:00100000:3.0:1788572400.237559:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+175:3653:x1875449639175808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.237572:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2834 count 1 00002000:00010000:3.0:1788572400.237592:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.237598:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8339e2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237610:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb12:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.237613:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.237616:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8339e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237626:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8339e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237633:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8339e2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237641:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8339e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237650:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1788572400.237729:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+176:3653:x1875449639175808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 170us (10258us total) trans 4294968845 rc 0/0 00000100:00100000:3.0:1788572400.237735:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4371 00010000:00010000:3.0:1788572400.237762:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788572400.237770:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237778:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.237782:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339e0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237798:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339e0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237814:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339e0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237821:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339e0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237844:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788572400.237849:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006daead8a/0xdb7edb52b8339e15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237856:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a956200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.237859:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006daead8a/0xdb7edb52b8339e15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237866:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006daead8a/0xdb7edb52b8339e15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237877:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006daead8a/0xdb7edb52b8339e15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237885:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006daead8a/0xdb7edb52b8339e15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237909:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572400.237914:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076698c84/0xdb7edb52b8339de4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237920:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9cc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.237923:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076698c84/0xdb7edb52b8339de4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237932:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076698c84/0xdb7edb52b8339de4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237942:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076698c84/0xdb7edb52b8339de4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237951:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076698c84/0xdb7edb52b8339de4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237966:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572400.237970:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c554deb/0xdb7edb52b8339e1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237976:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63a957c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.237980:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c554deb/0xdb7edb52b8339e1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.237993:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c554deb/0xdb7edb52b8339e1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238026:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c554deb/0xdb7edb52b8339e1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238035:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c554deb/0xdb7edb52b8339e1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238050:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572400.238054:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b8339e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238061:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.238065:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b8339e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238073:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b8339e23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238083:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b8339e23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238092:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003266332/0xdb7edb52b8339e23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238112:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.238115:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8339e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238122:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.238126:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8339e2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238134:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8339e2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238143:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8339e2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238151:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f2b789/0xdb7edb52b8339e2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238162:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.238164:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.238166:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.238172:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572400.238193:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.238230:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639173504 00000100:00100000:3.0:1788572400.238237:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639173504 00000100:00100000:3.0:1788572400.238268:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4372 00000100:00100000:3.0:1788572400.238275:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+176:3650:x1875449639173504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.238292:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2824 count 1 00002000:00010000:3.0:1788572400.238308:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb08:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.238314:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000006906e6/0xdb7edb52b8339e31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238324:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb08:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.238328:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb08:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.238333:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000006906e6/0xdb7edb52b8339e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238343:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000006906e6/0xdb7edb52b8339e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238352:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000006906e6/0xdb7edb52b8339e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238360:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000006906e6/0xdb7edb52b8339e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238373:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.238454:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+177:3650:x1875449639173504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 178us (260us total) trans 4294968846 rc 0/0 00000100:00100000:3.0:1788572400.238460:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4372 00010000:00010000:3.0:1788572400.238476:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.238493:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000006906e6/0xdb7edb52b8339e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238506:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.238508:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000006906e6/0xdb7edb52b8339e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238515:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000006906e6/0xdb7edb52b8339e31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238526:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000006906e6/0xdb7edb52b8339e31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238533:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000006906e6/0xdb7edb52b8339e31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb08:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238547:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.238549:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.238550:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572400.238585:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad50380/2, rc 0, transno 4294968846 00000100:00100000:3.0:1788572400.238600:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639173504:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.238670:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572400.238685:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639177600:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.238723:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.238746:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639177600 00000100:00100000:3.0:1788572400.238750:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639177600 00000100:00100000:3.0:1788572400.238771:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4373 00000100:00100000:3.0:1788572400.238776:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+177:3651:x1875449639177600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.238792:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2837 count 1 00002000:00010000:3.0:1788572400.238808:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.238814:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8339e38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238823:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb15:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.238826:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.238830:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8339e38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238840:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8339e38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238849:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8339e38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238855:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8339e38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238867:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.238939:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+178:3651:x1875449639177600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 161us (215us total) trans 4294968847 rc 0/0 00000100:00100000:3.0:1788572400.238946:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4373 00010000:00010000:3.0:1788572400.238960:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.238965:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8339e38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238977:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.238981:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8339e38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238988:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8339e38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.238999:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8339e38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239029:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003da7d80a/0xdb7edb52b8339e38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239043:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.239045:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.239046:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572400.239063:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6131cd880/2, rc 0, transno 4294968847 00000100:00100000:3.0:1788572400.239071:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639177600:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.239104:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639177728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.239127:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.239149:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639177728 00000100:00100000:3.0:1788572400.239152:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639177728 00000100:00100000:3.0:1788572400.239167:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4374 00000100:00100000:3.0:1788572400.239172:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+178:3651:x1875449639177728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.239183:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2838 count 1 00002000:00010000:3.0:1788572400.239197:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.239202:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005885758e/0xdb7edb52b8339e3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239210:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb16:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.239213:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.239217:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005885758e/0xdb7edb52b8339e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239225:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005885758e/0xdb7edb52b8339e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239233:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005885758e/0xdb7edb52b8339e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239240:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005885758e/0xdb7edb52b8339e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239251:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.239310:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+179:3651:x1875449639177728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 137us (182us total) trans 4294968848 rc 0/0 00000100:00100000:3.0:1788572400.239317:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4374 00010000:00010000:3.0:1788572400.239330:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.239335:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005885758e/0xdb7edb52b8339e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239342:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.239345:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005885758e/0xdb7edb52b8339e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239353:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005885758e/0xdb7edb52b8339e3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239364:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005885758e/0xdb7edb52b8339e3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239370:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005885758e/0xdb7edb52b8339e3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.239385:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.239386:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.239388:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572400.239405:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e634a80/2, rc 0, transno 4294968848 00000100:00100000:3.0:1788572400.239413:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639177728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.239450:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639174016:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.239476:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.239507:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639174016 00000100:00100000:3.0:1788572400.239510:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639174016 00000100:00100000:3.0:1788572400.239531:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4375 00000100:00100000:3.0:1788572400.239537:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+27:3650:x1875449639174016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.239549:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2818 count 1 00000100:00100000:0.0:1788572400.242057:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+178:3651:x1875449639176064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18592us (18655us total) trans 4294968844 rc 0/0 00000100:00100000:0.0:1788572400.242072:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4361 00010000:00010000:0.0:1788572400.242118:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.242157:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572400.242176:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639177856:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.242220:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572400.242267:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633ee9880/2, rc 0, transno 4294968841 00000100:00100000:0.0:1788572400.242278:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639175424:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572400.242289:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac5f80/2, rc 0, transno 4294968840 00000100:00100000:0.0:1788572400.242293:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639175296:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572400.242303:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f5c00/2, rc 0, transno 4294968842 00000100:00100000:0.0:1788572400.242305:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639172864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.242326:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639177856 00000100:00100000:0.0:1788572400.242332:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639177856 00000100:00100000:0.0:1788572400.242367:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4376 00000100:00100000:0.0:1788572400.242374:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+178:3652:x1875449639177856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.242402:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2839 count 1 00002000:00010000:0.0:1788572400.242432:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.242440:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000878aa98c/0xdb7edb52b8339e46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.242456:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb17:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.242461:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.242468:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000878aa98c/0xdb7edb52b8339e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.242492:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000878aa98c/0xdb7edb52b8339e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.242503:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000878aa98c/0xdb7edb52b8339e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.242510:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000878aa98c/0xdb7edb52b8339e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.242527:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572400.242666:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+179:3652:x1875449639177856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 292us (445us total) trans 4294968849 rc 0/0 00000100:00100000:0.0:1788572400.242673:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4376 00000004:00080000:0.0:1788572400.242701:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e637b80/2, rc 0, transno 4294968849 00000100:00100000:0.0:1788572400.242706:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639177856:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.242843:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+178:3653:x1875449639175936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10697us (15520us total) trans 4294968843 rc 0/0 00000100:00100000:1.0:1788572400.242851:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4367 00000100:00100000:2.0:1788572400.243794:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.243899:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e6f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639176832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.243927:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.243955:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639177344:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.243977:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572400.244030:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc3f480/2, rc 0, transno 4294968843 00000100:00100000:2.0:1788572400.244036:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639175936:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572400.244049:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f6a00/2, rc 0, transno 12884902075 00000100:00100000:2.0:1788572400.244060:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639176448:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.244069:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f5500/2, rc 0, transno 12884902076 00000100:00100000:2.0:1788572400.244072:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639176960:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.244081:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6414a6a00/2, rc 0, transno 12884902077 00000100:00100000:2.0:1788572400.244084:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639177472:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.244097:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc3d180/2, rc 0, transno 4294968845 00000100:00100000:2.0:1788572400.244101:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639175808:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.244124:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639176320 00000100:00100000:2.0:1788572400.244129:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639176320 00000100:00100000:2.0:1788572400.244164:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639176832 00000100:00100000:2.0:1788572400.244167:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639176832 00000100:00100000:2.0:1788572400.244180:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639177344 00000100:00100000:2.0:1788572400.244183:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639177344 00000100:00100000:2.0:1788572400.244200:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4377 00000100:00100000:2.0:1788572400.244207:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3653:x1875449639176320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.244233:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2827 count 1 00002000:00010000:2.0:1788572400.244334:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb0b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.244342:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006565b00/0xdb7edb52b8339e4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.244357:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0b:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.244361:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.244368:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006565b00/0xdb7edb52b8339e4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.244382:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006565b00/0xdb7edb52b8339e4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.244397:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006565b00/0xdb7edb52b8339e4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.244404:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006565b00/0xdb7edb52b8339e4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.244422:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572400.244551:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3653:x1875449639176320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 344us (761us total) trans 12884902078 rc 0/0 00000100:00100000:2.0:1788572400.244559:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4377 00000100:00100000:2.0:1788572400.244575:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4378 00000100:00100000:2.0:1788572400.244581:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3653:x1875449639176832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.244593:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2831 count 1 00002000:00010000:2.0:1788572400.244636:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb0f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.244641:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c817cc4/0xdb7edb52b8339e54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.244649:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0f:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.244652:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb0f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.244655:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c817cc4/0xdb7edb52b8339e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.244664:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c817cc4/0xdb7edb52b8339e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.244677:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c817cc4/0xdb7edb52b8339e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.244684:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c817cc4/0xdb7edb52b8339e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.244699:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788572400.244755:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3653:x1875449639176832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 174us (827us total) trans 12884902079 rc 0/0 00000100:00100000:2.0:1788572400.244762:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4378 00000100:00100000:2.0:1788572400.244775:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4379 00000100:00100000:2.0:1788572400.244781:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3653:x1875449639177344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.244793:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2835 count 1 00002000:00010000:2.0:1788572400.245996:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.246021:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339e5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246036:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb13:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.246040:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.246046:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339e5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246058:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339e5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246074:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339e5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246082:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339e5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246110:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1788572400.246239:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3653:x1875449639177344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1455us (2258us total) trans 12884902080 rc 0/0 00000100:00100000:2.0:1788572400.246248:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4379 00010000:00010000:2.0:1788572400.246306:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572400.246314:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000878aa98c/0xdb7edb52b8339e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246323:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9da00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.246328:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000878aa98c/0xdb7edb52b8339e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246337:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000878aa98c/0xdb7edb52b8339e46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246356:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000878aa98c/0xdb7edb52b8339e46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246364:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000878aa98c/0xdb7edb52b8339e46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246390:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572400.246394:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006565b00/0xdb7edb52b8339e4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246400:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.246403:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006565b00/0xdb7edb52b8339e4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246411:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006565b00/0xdb7edb52b8339e4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246420:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006565b00/0xdb7edb52b8339e4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246427:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006565b00/0xdb7edb52b8339e4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb0b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246441:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572400.246445:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c817cc4/0xdb7edb52b8339e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246451:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1aa00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.246454:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c817cc4/0xdb7edb52b8339e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246467:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c817cc4/0xdb7edb52b8339e54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246477:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c817cc4/0xdb7edb52b8339e54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246499:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c817cc4/0xdb7edb52b8339e54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb0f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246511:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.246514:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339e5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246521:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.246524:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339e5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246531:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339e5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246541:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339e5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246549:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339e5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.246566:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.246568:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.246570:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.246578:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.246586:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.246672:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572400.246688:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639177984:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.246732:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.246774:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639177984 00000100:00100000:2.0:1788572400.246781:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639177984 00000100:00100000:2.0:1788572400.246813:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4380 00000100:00100000:2.0:1788572400.248234:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3652:x1875449639177984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.248276:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2837 count 1 00002000:00010000:2.0:1788572400.248401:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.248409:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af79220/0xdb7edb52b8339e62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.248426:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb15:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.248431:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.248437:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005af79220/0xdb7edb52b8339e62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.248451:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005af79220/0xdb7edb52b8339e62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.248460:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005af79220/0xdb7edb52b8339e62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.248468:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005af79220/0xdb7edb52b8339e62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.248499:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572400.248667:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3652:x1875449639177984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1846us (1933us total) trans 12884902081 rc 0/0 00000100:00100000:2.0:1788572400.248675:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4380 00000004:00080000:2.0:1788572400.248744:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f6680/2, rc 0, transno 12884902078 00000100:00100000:2.0:1788572400.248760:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639176320:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.248774:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e6f4a80/2, rc 0, transno 12884902079 00000100:00100000:2.0:1788572400.248777:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e6f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639176832:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.248786:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6377c3480/2, rc 0, transno 12884902080 00000100:00100000:2.0:1788572400.248790:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639177344:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788572400.249254:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.249263:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005af79220/0xdb7edb52b8339e62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.249273:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1bc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.249277:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005af79220/0xdb7edb52b8339e62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.249287:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005af79220/0xdb7edb52b8339e62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.249304:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005af79220/0xdb7edb52b8339e62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.249312:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005af79220/0xdb7edb52b8339e62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.249334:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.249336:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.249338:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788572400.249614:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb02:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.249622:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339e69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.249632:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb02:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.249635:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb02:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.249640:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339e69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.249653:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339e69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.249661:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339e69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.249668:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339e69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.249692:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.249817:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+32:3650:x1875449639174016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10277us (10337us total) trans 12884902082 rc 0/0 00000100:00100000:3.0:1788572400.249893:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4375 00010000:00010000:3.0:1788572400.249919:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.249924:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339e69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.249931:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.249933:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339e69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.249946:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339e69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.249958:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339e69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.249966:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339e69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb02:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.249983:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.249984:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.249986:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.249992:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572400.250043:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639178240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.250087:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572400.250138:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fc3e300/2, rc 0, transno 4294968844 00000100:00100000:3.0:1788572400.250144:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639176064:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.250155:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572400.250161:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639178112:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.250181:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.250208:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639178240 00000100:00100000:3.0:1788572400.250214:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639178240 00000100:00100000:3.0:1788572400.250247:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639178112 00000100:00100000:3.0:1788572400.250250:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639178112 00000100:00100000:3.0:1788572400.250269:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4381 00000100:00100000:3.0:1788572400.250276:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3651:x1875449639178240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.250301:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2839 count 1 00002000:00010000:3.0:1788572400.250371:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.250377:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339e70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250387:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb17:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.250391:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.250396:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339e70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250407:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339e70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250416:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339e70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250424:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339e70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250439:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.250521:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3651:x1875449639178240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 244us (433us total) trans 12884902083 rc 0/0 00000100:00100000:3.0:1788572400.250528:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4381 00000100:00100000:3.0:1788572400.250542:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4382 00000100:00100000:3.0:1788572400.250548:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3651:x1875449639178112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.250559:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2838 count 1 00002000:00010000:3.0:1788572400.250604:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.250610:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339e77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250619:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb16:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.250622:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.250626:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339e77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250635:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339e77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250642:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339e77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250650:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339e77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250664:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572400.250719:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3651:x1875449639178112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 171us (537us total) trans 12884902084 rc 0/0 00000100:00100000:3.0:1788572400.250726:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4382 00010000:00010000:3.0:1788572400.250748:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572400.250753:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339e70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250760:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.250764:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339e70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250772:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339e70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250785:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339e70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250793:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339e70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250810:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.250813:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339e77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.250819:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8200 already unused, calling callback (ffffffffc0be44f0) 00000004:00080000:1.0:1788572400.251048:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641107b80/2, rc 0, transno 12884902081 00010000:00010000:0.0:1788572400.251166:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.251241:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339e77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.251250:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339e77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.251261:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339e77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.251269:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339e77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.251284:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.251286:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.251288:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572400.251306:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641104a80/2, rc 0, transno 12884902084 00000100:00100000:1.0:1788572400.251967:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639177984:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572400.252055:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788572400.254991:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968824 is committed 00000100:00100000:1.0:1788572400.256660:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639178368:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.256739:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572400.257045:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639178368 00000100:00100000:0.0:1788572400.257054:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639178368 00000100:00100000:0.0:1788572400.257107:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4383 00000100:00100000:0.0:1788572400.257117:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3652:x1875449639178368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572400.257145:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2840 count 1 00002000:00010000:0.0:1788572400.257259:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.257266:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000040c3848/0xdb7edb52b8339e7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.257283:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb18:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.257288:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.257294:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000040c3848/0xdb7edb52b8339e7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.257308:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000040c3848/0xdb7edb52b8339e7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.257318:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000040c3848/0xdb7edb52b8339e7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.257327:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000040c3848/0xdb7edb52b8339e7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.257343:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.257561:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639178112:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572400.257607:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641106300/2, rc 0, transno 12884902083 00000100:00100000:3.0:1788572400.257613:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639178240:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572400.257630:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.257636:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000040c3848/0xdb7edb52b8339e7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.257644:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9d800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.257649:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000040c3848/0xdb7edb52b8339e7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.257659:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000040c3848/0xdb7edb52b8339e7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.257676:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000040c3848/0xdb7edb52b8339e7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.257683:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000040c3848/0xdb7edb52b8339e7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.257704:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.257706:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.257708:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572400.257790:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639178752:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.261024:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.261094:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639179264:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.261147:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.261172:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788572400.261178:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639178624:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.261198:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.261213:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639179136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.261230:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.261269:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639178752 00000100:00100000:3.0:1788572400.261277:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639178752 00000100:00100000:3.0:1788572400.261318:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639179264 00000100:00100000:3.0:1788572400.261321:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639179264 00000100:00100000:3.0:1788572400.261335:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639178624 00000100:00100000:3.0:1788572400.261337:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639178624 00000100:00100000:3.0:1788572400.261350:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639179136 00000100:00100000:3.0:1788572400.261353:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639179136 00000100:00100000:3.0:1788572400.261372:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4384 00000100:00100000:3.0:1788572400.261381:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3651:x1875449639178752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.261415:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2841 count 1 00002000:00010000:3.0:1788572400.261449:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.261456:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c415a191/0xdb7edb52b8339e85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.261474:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb19:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.261478:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.261497:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c415a191/0xdb7edb52b8339e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.261514:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c415a191/0xdb7edb52b8339e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.261524:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c415a191/0xdb7edb52b8339e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.261532:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c415a191/0xdb7edb52b8339e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.261550:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.261716:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3651:x1875449639178752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 334us (699us total) trans 4294968850 rc 0/0 00000100:00100000:3.0:1788572400.261723:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4384 00000100:00100000:3.0:1788572400.261741:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4385 00000100:00100000:3.0:1788572400.261747:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3651:x1875449639179264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.261759:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2845 count 1 00002000:00010000:3.0:1788572400.261772:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.261777:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b8339e8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.261785:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1d:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.261788:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.261792:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b8339e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.261806:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b8339e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.261814:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b8339e8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.261886:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b8339e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.261904:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572400.261966:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3651:x1875449639179264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 219us (818us total) trans 4294968851 rc 0/0 00000100:00100000:3.0:1788572400.261973:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4385 00000100:00100000:3.0:1788572400.261986:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4386 00000100:00100000:3.0:1788572400.261992:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3651:x1875449639178624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.262029:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2840 count 1 00002000:00010000:3.0:1788572400.262045:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.262050:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b8339e93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262058:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb18:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.262061:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.262066:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b8339e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262080:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b8339e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262088:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b8339e93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262094:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b8339e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262108:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788572400.262171:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3651:x1875449639178624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 180us (971us total) trans 4294968852 rc 0/0 00000100:00100000:3.0:1788572400.262177:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4386 00000100:00100000:3.0:1788572400.262190:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4387 00000100:00100000:3.0:1788572400.262196:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3651:x1875449639179136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.262207:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2844 count 1 00002000:00010000:3.0:1788572400.262221:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.262225:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b8339e9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262234:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1c:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.262237:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.262241:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b8339e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262255:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b8339e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262263:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b8339e9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262270:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b8339e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262285:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1788572400.262348:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3651:x1875449639179136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 152us (1116us total) trans 4294968853 rc 0/0 00000100:00100000:3.0:1788572400.262353:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4387 00010000:00010000:3.0:1788572400.262380:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788572400.262387:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c415a191/0xdb7edb52b8339e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262394:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.262399:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c415a191/0xdb7edb52b8339e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262408:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c415a191/0xdb7edb52b8339e85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262424:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c415a191/0xdb7edb52b8339e85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262432:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c415a191/0xdb7edb52b8339e85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262457:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572400.262460:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b8339e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262466:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.262469:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b8339e8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262476:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b8339e8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262495:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b8339e8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262502:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7b2684d/0xdb7edb52b8339e8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262514:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572400.262517:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b8339e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262523:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.262527:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b8339e93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262535:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b8339e93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262544:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b8339e93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262551:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c40d0925/0xdb7edb52b8339e93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262565:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.262568:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b8339e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262575:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.262578:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b8339e9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262585:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b8339e9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262594:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b8339e9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262602:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097e08729/0xdb7edb52b8339e9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.262614:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.262615:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.262617:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.262623:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.262629:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572400.262662:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968824 gen 3 00000004:00080000:3.0:1788572400.262668:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3c380, transno 4294968677 00000004:00080000:3.0:1788572400.262679:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3ca80, transno 4294968678 00000004:00080000:3.0:1788572400.262683:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3c700, transno 4294968679 00000004:00080000:3.0:1788572400.262685:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3dc00, transno 4294968680 00000004:00080000:3.0:1788572400.262689:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff5180, transno 4294968681 00000004:00080000:3.0:1788572400.262692:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3f800, transno 4294968682 00000004:00080000:3.0:1788572400.262694:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff4700, transno 4294968683 00000004:00080000:3.0:1788572400.262697:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3e680, transno 4294968684 00000004:00080000:3.0:1788572400.262700:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6131cdc00, transno 4294968685 00000004:00080000:3.0:1788572400.262703:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6131cd180, transno 4294968686 00000004:00080000:3.0:1788572400.262705:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c1180, transno 4294968687 00000004:00080000:3.0:1788572400.262707:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c2a00, transno 4294968688 00000004:00080000:3.0:1788572400.262710:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c1880, transno 4294968689 00000004:00080000:3.0:1788572400.262713:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c1f80, transno 4294968690 00000004:00080000:3.0:1788572400.262716:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c1500, transno 4294968691 00000004:00080000:3.0:1788572400.262719:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0a80, transno 4294968692 00000004:00080000:3.0:1788572400.262722:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288e00, transno 4294968693 00000004:00080000:3.0:1788572400.262725:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289500, transno 4294968694 00000004:00080000:3.0:1788572400.262727:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289c00, transno 4294968695 00000004:00080000:3.0:1788572400.262729:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288a80, transno 4294968696 00000004:00080000:3.0:1788572400.262733:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28aa00, transno 4294968697 00000004:00080000:3.0:1788572400.262735:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28b800, transno 4294968698 00000004:00080000:3.0:1788572400.262738:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634beaa00, transno 4294968699 00000004:00080000:3.0:1788572400.262741:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289880, transno 4294968700 00000004:00080000:3.0:1788572400.262743:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634be8a80, transno 4294968701 00000004:00080000:3.0:1788572400.262746:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634be9c00, transno 4294968702 00000004:00080000:3.0:1788572400.262748:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634bea300, transno 4294968703 00000004:00080000:3.0:1788572400.262751:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a7480, transno 4294968704 00000004:00080000:3.0:1788572400.262754:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634bea680, transno 4294968705 00000004:00080000:3.0:1788572400.262756:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a7100, transno 4294968706 00000004:00080000:3.0:1788572400.262759:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a5c00, transno 4294968707 00000004:00080000:3.0:1788572400.262762:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6375a6300, transno 4294968708 00000004:00080000:3.0:1788572400.262765:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e636d80, transno 4294968709 00000004:00080000:3.0:1788572400.262768:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e634380, transno 4294968710 00000004:00080000:3.0:1788572400.262772:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e634e00, transno 4294968711 00000004:00080000:3.0:1788572400.262775:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e634700, transno 4294968712 00000004:00080000:3.0:1788572400.262777:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e635f80, transno 4294968713 00000004:00080000:3.0:1788572400.262781:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c3100, transno 4294968714 00000004:00080000:3.0:1788572400.262783:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c3800, transno 4294968715 00000004:00080000:3.0:1788572400.262785:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288380, transno 4294968716 00000004:00080000:3.0:1788572400.262787:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288000, transno 4294968717 00000004:00080000:3.0:1788572400.262790:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d2f1c00, transno 4294968718 00000004:00080000:3.0:1788572400.262793:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798a80, transno 4294968719 00000004:00080000:3.0:1788572400.262796:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b28380, transno 4294968720 00000004:00080000:3.0:1788572400.262798:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b29f80, transno 4294968721 00000004:00080000:3.0:1788572400.262801:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637597100, transno 4294968722 00000004:00080000:3.0:1788572400.262803:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28b100, transno 4294968723 00000004:00080000:3.0:1788572400.262805:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d2f3480, transno 4294968724 00000004:00080000:3.0:1788572400.262808:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e761880, transno 4294968725 00000004:00080000:3.0:1788572400.262811:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0380, transno 4294968726 00000004:00080000:3.0:1788572400.262813:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28a300, transno 4294968727 00000004:00080000:3.0:1788572400.262816:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634b2aa00, transno 4294968728 00000004:00080000:3.0:1788572400.262818:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798000, transno 4294968729 00000100:00100000:2.0:1788572400.265938:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639178496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.266047:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572400.266127:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173f800, transno 4294968730 00000004:00080000:3.0:1788572400.266131:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173c000, transno 4294968731 00000004:00080000:3.0:1788572400.266134:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173f480, transno 4294968732 00000004:00080000:3.0:1788572400.266136:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173f100, transno 4294968733 00000004:00080000:3.0:1788572400.266138:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63c504e00, transno 4294968734 00000004:00080000:3.0:1788572400.266140:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173d880, transno 4294968735 00000004:00080000:3.0:1788572400.266143:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e64173c700, transno 4294968736 00000004:00080000:3.0:1788572400.266145:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6b800, transno 4294968737 00000004:00080000:3.0:1788572400.266148:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5ca80, transno 4294968738 00000004:00080000:3.0:1788572400.266150:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae69500, transno 4294968739 00000004:00080000:3.0:1788572400.266153:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae68000, transno 4294968740 00000004:00080000:3.0:1788572400.266156:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae68700, transno 4294968741 00000004:00080000:3.0:1788572400.266158:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae6b480, transno 4294968742 00000004:00080000:3.0:1788572400.266160:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641355500, transno 4294968743 00000004:00080000:3.0:1788572400.266163:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44000, transno 4294968744 00000004:00080000:3.0:1788572400.266166:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47b80, transno 4294968745 00000004:00080000:3.0:1788572400.266168:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44e00, transno 4294968746 00000004:00080000:3.0:1788572400.266171:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46680, transno 4294968747 00000004:00080000:3.0:1788572400.266173:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe45c00, transno 4294968748 00000004:00080000:3.0:1788572400.266176:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44a80, transno 4294968749 00000004:00080000:3.0:1788572400.266178:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47480, transno 4294968750 00000004:00080000:3.0:1788572400.266181:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46a00, transno 4294968751 00000004:00080000:3.0:1788572400.266183:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46d80, transno 4294968752 00000004:00080000:3.0:1788572400.266186:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b1880, transno 4294968753 00000004:00080000:3.0:1788572400.266189:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0a80, transno 4294968754 00000004:00080000:3.0:1788572400.266191:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0000, transno 4294968755 00000004:00080000:3.0:1788572400.266193:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b3100, transno 4294968756 00000004:00080000:3.0:1788572400.266196:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b2680, transno 4294968757 00000004:00080000:3.0:1788572400.266198:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b2d80, transno 4294968758 00000004:00080000:3.0:1788572400.266202:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe45880, transno 4294968759 00000004:00080000:3.0:1788572400.266205:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493800, transno 4294968760 00000004:00080000:3.0:1788572400.266207:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b3800, transno 4294968761 00000004:00080000:3.0:1788572400.266210:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b1f80, transno 4294968762 00000004:00080000:3.0:1788572400.266212:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490380, transno 4294968763 00000004:00080000:3.0:1788572400.266215:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b3480, transno 4294968764 00000004:00080000:3.0:1788572400.266217:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618492300, transno 4294968765 00000004:00080000:3.0:1788572400.266220:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b3b80, transno 4294968766 00000004:00080000:3.0:1788572400.266222:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b1500, transno 4294968767 00000004:00080000:3.0:1788572400.266225:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a93b100, transno 4294968768 00000004:00080000:3.0:1788572400.266228:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a939500, transno 4294968769 00000004:00080000:3.0:1788572400.266230:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0380, transno 4294968770 00000004:00080000:3.0:1788572400.266232:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a939180, transno 4294968771 00000004:00080000:3.0:1788572400.266235:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6680, transno 4294968772 00000004:00080000:3.0:1788572400.266237:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63a93bb80, transno 4294968773 00000004:00080000:3.0:1788572400.266240:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a7480, transno 4294968774 00000004:00080000:3.0:1788572400.266242:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637795180, transno 4294968775 00000004:00080000:3.0:1788572400.266244:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637794000, transno 4294968776 00000004:00080000:3.0:1788572400.266247:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637794e00, transno 4294968777 00000004:00080000:3.0:1788572400.266249:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4000, transno 4294968778 00000004:00080000:3.0:1788572400.266252:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637795500, transno 4294968779 00000004:00080000:3.0:1788572400.266254:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe45f80, transno 4294968780 00000004:00080000:3.0:1788572400.266256:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb0700, transno 4294968781 00000004:00080000:3.0:1788572400.266258:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb0a80, transno 4294968782 00000004:00080000:3.0:1788572400.266261:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5880, transno 4294968783 00000004:00080000:3.0:1788572400.266263:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637795f80, transno 4294968784 00000004:00080000:3.0:1788572400.266266:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641106680, transno 4294968785 00000004:00080000:3.0:1788572400.266268:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104000, transno 4294968786 00000004:00080000:3.0:1788572400.266270:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5500, transno 4294968787 00000004:00080000:3.0:1788572400.266272:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637794a80, transno 4294968788 00000004:00080000:3.0:1788572400.266275:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637796a00, transno 4294968789 00000004:00080000:3.0:1788572400.266278:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641107100, transno 4294968790 00000004:00080000:3.0:1788572400.266280:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641107800, transno 4294968791 00000004:00080000:3.0:1788572400.266282:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb2d80, transno 4294968792 00000004:00080000:3.0:1788572400.266285:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641105f80, transno 4294968793 00000004:00080000:3.0:1788572400.266287:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb3800, transno 4294968794 00000004:00080000:3.0:1788572400.266289:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac7100, transno 4294968795 00000004:00080000:3.0:1788572400.266292:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5c00, transno 4294968796 00000004:00080000:3.0:1788572400.266294:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506550000, transno 4294968797 00000004:00080000:3.0:1788572400.266297:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506552a00, transno 4294968798 00000004:00080000:3.0:1788572400.266299:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506553b80, transno 4294968799 00000004:00080000:3.0:1788572400.266302:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506552680, transno 4294968800 00000004:00080000:3.0:1788572400.266304:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac6d80, transno 4294968801 00000004:00080000:3.0:1788572400.266306:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5180, transno 4294968802 00000004:00080000:3.0:1788572400.266309:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637715500, transno 4294968803 00000004:00080000:3.0:1788572400.266311:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4e00, transno 4294968804 00000004:00080000:3.0:1788572400.266314:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506551180, transno 4294968805 00000004:00080000:3.0:1788572400.266317:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412c0700, transno 4294968806 00000004:00080000:3.0:1788572400.266319:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506552d80, transno 4294968807 00000004:00080000:3.0:1788572400.266321:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5180, transno 4294968808 00000004:00080000:3.0:1788572400.266324:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4000, transno 4294968809 00000004:00080000:3.0:1788572400.266327:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a4e00, transno 4294968810 00000004:00080000:3.0:1788572400.266329:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641356300, transno 4294968811 00000004:00080000:3.0:1788572400.266331:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5880, transno 4294968812 00000004:00080000:3.0:1788572400.266333:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641357100, transno 4294968813 00000004:00080000:3.0:1788572400.266336:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a7100, transno 4294968814 00000004:00080000:3.0:1788572400.266338:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5c700, transno 4294968815 00000004:00080000:3.0:1788572400.266341:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a5c00, transno 4294968816 00000004:00080000:3.0:1788572400.266343:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad5e680, transno 4294968817 00000004:00080000:3.0:1788572400.266346:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e506553480, transno 4294968818 00000004:00080000:3.0:1788572400.266349:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e5058a6d80, transno 4294968819 00000004:00080000:3.0:1788572400.266352:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad53b80, transno 4294968820 00000004:00080000:3.0:1788572400.266354:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633de4e00, transno 4294968821 00000004:00080000:3.0:1788572400.266357:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad52300, transno 4294968822 00000004:00080000:3.0:1788572400.266359:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633de4a80, transno 4294968823 00000004:00080000:3.0:1788572400.266362:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad50a80, transno 4294968824 00000100:00100000:3.0:1788572400.266370:0:3651:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff94e61e6f5f80 x1875449639172992/t4294968825(4294968825) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788572416 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788572400.266383:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e573b80/2, rc 0, transno 4294968852 00000100:00100000:3.0:1788572400.266388:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639178624:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.266452:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3652:x1875449639178368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9334us (9711us total) trans 12884902085 rc 0/0 00000100:00100000:0.0:1788572400.266464:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4383 00000100:00100000:0.0:1788572400.266508:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639178496 00000100:00100000:0.0:1788572400.266515:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639178496 00000100:00100000:0.0:1788572400.266561:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4388 00000100:00100000:0.0:1788572400.266569:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3653:x1875449639178496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572400.266610:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2841 count 1 00002000:00010000:0.0:1788572400.266718:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.266725:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ae776f/0xdb7edb52b8339ea1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.266741:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb19:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.266746:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.266752:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020ae776f/0xdb7edb52b8339ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.266767:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020ae776f/0xdb7edb52b8339ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.266776:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020ae776f/0xdb7edb52b8339ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.266784:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020ae776f/0xdb7edb52b8339ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.266802:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572400.267070:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3653:x1875449639178496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 501us (1023us total) trans 12884902086 rc 0/0 00000100:00100000:0.0:1788572400.267077:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4388 00010000:00010000:0.0:1788572400.267100:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.267106:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020ae776f/0xdb7edb52b8339ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.267120:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9d600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.267124:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ae776f/0xdb7edb52b8339ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.267133:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020ae776f/0xdb7edb52b8339ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.267149:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020ae776f/0xdb7edb52b8339ea1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.267156:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020ae776f/0xdb7edb52b8339ea1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.267174:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.267176:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.267178:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572400.268711:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641106a00/2, rc 0, transno 12884902085 00000100:00100000:1.0:1788572400.268748:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639178368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.269551:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639179008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.269634:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.269675:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639179520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.269696:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.269722:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639180032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.269742:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572400.269775:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641105180/2, rc 0, transno 12884902086 00000100:00100000:2.0:1788572400.269786:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639178496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.269815:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639179008 00000100:00100000:2.0:1788572400.270140:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639179008 00000100:00100000:2.0:1788572400.270191:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639179520 00000100:00100000:2.0:1788572400.270195:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639179520 00000100:00100000:2.0:1788572400.270212:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639180032 00000100:00100000:2.0:1788572400.270214:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639180032 00000100:00100000:2.0:1788572400.270232:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4389 00000100:00100000:2.0:1788572400.270240:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+34:3653:x1875449639179008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.270268:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2843 count 1 00002000:00010000:2.0:1788572400.270298:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.270305:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1f9d36/0xdb7edb52b8339ea8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.270321:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1b:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.270325:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.270332:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e1f9d36/0xdb7edb52b8339ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.270346:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e1f9d36/0xdb7edb52b8339ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.270357:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1f9d36/0xdb7edb52b8339ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.270365:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e1f9d36/0xdb7edb52b8339ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.270382:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572400.270557:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+35:3653:x1875449639179008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 316us (923us total) trans 4294968854 rc 0/0 00000100:00100000:2.0:1788572400.270565:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4389 00000100:00100000:2.0:1788572400.270583:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4390 00000100:00100000:2.0:1788572400.270589:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+37:3653:x1875449639179520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.270601:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2842 count 1 00002000:00010000:2.0:1788572400.270685:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.270691:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339eaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.270700:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1a:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.270703:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.270707:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339eaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.270717:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339eaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.270725:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339eaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.270733:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339eaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.270748:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572400.270809:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+38:3653:x1875449639179520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 220us (1111us total) trans 12884902087 rc 0/0 00000100:00100000:2.0:1788572400.270818:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4390 00000004:00080000:3.0:1788572400.272790:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637591500/2, rc 0, transno 4294968853 00000100:00100000:3.0:1788572400.272808:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637591500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639179136:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572400.272832:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e572a00/2, rc 0, transno 4294968850 00000100:00100000:3.0:1788572400.272836:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639178752:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572400.272848:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d28ce00/2, rc 0, transno 4294968851 00000100:00100000:3.0:1788572400.272852:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639179264:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.272880:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639179776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.272953:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.272993:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572400.272999:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639179648:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.273037:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572400.273707:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 19 changes, 33 in progress, 4 in flight, 148 done 00000100:00100000:3.0:1788572400.273793:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639180288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.273824:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.273848:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572400.273855:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639180160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.273874:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.273904:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639179776 00000100:00100000:3.0:1788572400.273911:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639179776 00000100:00100000:0.0:1788572400.275104:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4391 00000100:00100000:0.0:1788572400.275127:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3653:x1875449639180032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572400.275162:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2846 count 1 00002000:00010000:0.0:1788572400.275277:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.275285:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339eb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275302:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1e:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.275307:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.275315:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275331:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275341:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275349:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275368:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788572400.275526:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3653:x1875449639180032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 409us (5782us total) trans 12884902088 rc 0/0 00000100:00100000:0.0:1788572400.275535:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4391 00000100:00100000:0.0:1788572400.275568:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639179648 00000100:00100000:0.0:1788572400.275575:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639179648 00000100:00100000:0.0:1788572400.275612:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639180288 00000100:00100000:0.0:1788572400.275616:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639180288 00000100:00100000:0.0:1788572400.275628:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4392 00000100:00100000:0.0:1788572400.275634:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3651:x1875449639179648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572400.275646:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2843 count 1 00002000:00010000:0.0:1788572400.275692:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.275698:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339ebd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275706:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1b:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.275710:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.275715:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339ebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275724:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339ebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275731:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339ebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275739:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275753:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788572400.275815:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3651:x1875449639179648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 181us (2777us total) trans 12884902089 rc 0/0 00000100:00100000:0.0:1788572400.275834:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4392 00000100:00100000:0.0:1788572400.275847:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639180160 00000100:00100000:0.0:1788572400.275850:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639180160 00000100:00100000:0.0:1788572400.275865:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4393 00000100:00100000:0.0:1788572400.275870:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3651:x1875449639180288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.275881:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2848 count 1 00002000:00010000:0.0:1788572400.275899:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.275903:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339ec4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275912:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb20:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.275916:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.275920:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339ec4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275930:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339ec4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275937:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339ec4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275943:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339ec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.275951:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1788572400.276052:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3651:x1875449639180288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 181us (2226us total) trans 4294968855 rc 0/0 00000100:00100000:0.0:1788572400.276059:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4393 00000100:00100000:0.0:1788572400.276072:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4394 00000100:00100000:0.0:1788572400.276078:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3651:x1875449639180160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.276089:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2847 count 1 00002000:00010000:0.0:1788572400.276103:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.276108:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339ecb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276115:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1f:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.276118:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.276122:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276131:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276139:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339ecb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276145:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276154:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:0.0:1788572400.276220:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3651:x1875449639180160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 141us (2343us total) trans 4294968856 rc 0/0 00000100:00100000:0.0:1788572400.276226:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4394 00010000:00010000:0.0:1788572400.276321:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788572400.276329:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e1f9d36/0xdb7edb52b8339ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276337:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1ae00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.276341:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1f9d36/0xdb7edb52b8339ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276351:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1f9d36/0xdb7edb52b8339ea8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276368:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e1f9d36/0xdb7edb52b8339ea8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276376:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e1f9d36/0xdb7edb52b8339ea8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276397:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572400.276401:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339eaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276408:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.276410:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339eaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276417:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339eaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276425:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339eaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276432:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c7ca5e/0xdb7edb52b8339eaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276443:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572400.276446:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276452:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.276455:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276463:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276472:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339eb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276478:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339eb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276501:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572400.276505:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276511:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9cc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.276515:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276521:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339ebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276531:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339ebd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276537:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339ebd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276549:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572400.276553:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339ec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276559:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.276562:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339ec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276570:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339ec4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276579:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339ec4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276586:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339ec4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276598:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.276604:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276610:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.276613:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339ecb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276625:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339ecb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276634:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339ecb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276640:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339ecb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.276651:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.276653:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.276654:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.277170:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.277177:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.277248:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639180544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.277295:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572400.277351:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637717100/2, rc 0, transno 12884902088 00000100:00100000:2.0:1788572400.277363:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639180032:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.277377:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e570a80/2, rc 0, transno 4294968854 00000100:00100000:2.0:1788572400.277387:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639179008:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572400.277397:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2e680/2, rc 0, transno 12884902087 00000100:00100000:2.0:1788572400.277401:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639179520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.277413:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572400.277419:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639180416:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.277445:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.277471:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639180544 00000100:00100000:2.0:1788572400.277476:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639180544 00000100:00100000:2.0:1788572400.277518:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639180416 00000100:00100000:2.0:1788572400.277521:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639180416 00000100:00100000:2.0:1788572400.277537:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4395 00000100:00100000:2.0:1788572400.277544:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3653:x1875449639180544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.277564:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2850 count 1 00002000:00010000:2.0:1788572400.277588:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.277606:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339ed2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.277619:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb22:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.277625:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.277631:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339ed2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.277643:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339ed2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.277652:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339ed2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.277661:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339ed2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.277676:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572400.277803:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3653:x1875449639180544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 259us (506us total) trans 4294968857 rc 0/0 00000100:00100000:2.0:1788572400.277811:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4395 00000100:00100000:2.0:1788572400.277962:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4396 00000100:00100000:2.0:1788572400.277971:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3653:x1875449639180416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.277984:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2849 count 1 00002000:00010000:2.0:1788572400.278000:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.278033:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339ed9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278041:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb21:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.278044:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.278049:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278058:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278067:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339ed9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278073:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339ed9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278086:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572400.278146:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3653:x1875449639180416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 177us (699us total) trans 4294968858 rc 0/0 00000100:00100000:2.0:1788572400.278153:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4396 00010000:00010000:2.0:1788572400.278172:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572400.278176:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339ed2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278184:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.278188:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339ed2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278197:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339ed2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278211:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339ed2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278219:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a4d0fa4/0xdb7edb52b8339ed2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278237:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.278240:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339ed9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278246:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.278249:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339ed9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278257:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339ed9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278266:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339ed9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278273:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339ed9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.278285:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.278286:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.278288:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.278292:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.278355:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639181056:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.278383:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572400.278411:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d28d180/2, rc 0, transno 4294968858 00000100:00100000:2.0:1788572400.278420:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639180416:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572400.278431:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e501ff5180/2, rc 0, transno 4294968857 00000100:00100000:2.0:1788572400.278434:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639180544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.278443:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572400.278448:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639180928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.278468:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.278505:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639181056 00000100:00100000:2.0:1788572400.278510:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639181056 00000100:00100000:2.0:1788572400.278536:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639180928 00000100:00100000:2.0:1788572400.278539:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639180928 00000100:00100000:2.0:1788572400.278555:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4397 00000100:00100000:2.0:1788572400.278561:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3653:x1875449639181056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.278574:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2849 count 1 00000100:00100000:1.0:1788572400.278729:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639178880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.278759:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.278785:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639178880 00000100:00100000:1.0:1788572400.278788:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639178880 00000100:00100000:1.0:1788572400.278814:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4398 00000100:00100000:0.0:1788572400.278937:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4399 00000100:00100000:0.0:1788572400.278947:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3652:x1875449639178880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.278960:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2842 count 1 00002000:00010000:0.0:1788572400.278980:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.278986:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339ee0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.278998:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1a:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.279022:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.279028:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339ee0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279038:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339ee0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279048:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339ee0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279054:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339ee0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279070:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572400.279165:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3652:x1875449639178880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 221us (405us total) trans 4294968859 rc 0/0 00000100:00100000:0.0:1788572400.279172:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4399 00010000:00010000:0.0:1788572400.279192:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.279197:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339ee0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279204:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9ce00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.279208:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339ee0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279217:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339ee0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279229:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339ee0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279237:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339ee0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279257:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.279258:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.279260:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788572400.279397:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.279404:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ff7c968/0xdb7edb52b8339ee7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.279414:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb21:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.279417:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.279421:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ff7c968/0xdb7edb52b8339ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.279433:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ff7c968/0xdb7edb52b8339ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.279448:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ff7c968/0xdb7edb52b8339ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.279456:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ff7c968/0xdb7edb52b8339ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.279480:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572400.279566:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3653:x1875449639181056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1003us (1180us total) trans 12884902090 rc 0/0 00000100:00100000:2.0:1788572400.279573:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4397 00000100:00100000:1.0:1788572400.279709:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3653:x1875449639180928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.279728:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2848 count 1 00002000:00010000:1.0:1788572400.279781:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.279786:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339eee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.279795:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb20:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.279798:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.279802:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339eee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.279811:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339eee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.279818:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339eee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279913:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.279918:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ff7c968/0xdb7edb52b8339ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279927:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.279931:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ff7c968/0xdb7edb52b8339ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279940:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ff7c968/0xdb7edb52b8339ee7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279953:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ff7c968/0xdb7edb52b8339ee7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279960:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ff7c968/0xdb7edb52b8339ee7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.279978:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.279980:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.279982:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572400.280131:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4400 00000100:00100000:3.0:1788572400.280145:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3651:x1875449639179776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.280159:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2844 count 1 00002000:00010000:3.0:1788572400.280214:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.280219:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339ef5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.280227:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1c:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.280229:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.280233:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.280242:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.280250:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.280257:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.280272:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.280351:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3651:x1875449639179776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 211us (7398us total) trans 12884902091 rc 0/0 00000100:00100000:3.0:1788572400.280359:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4400 00010000:00010000:3.0:1788572400.280383:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.280388:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.280395:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.280399:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.280407:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339ef5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.280418:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339ef5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.280426:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339ef5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.280439:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.280440:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.280442:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572400.280459:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639180800:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.280505:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572400.280550:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d28e680/2, rc 0, transno 4294968856 00000100:00100000:3.0:1788572400.280557:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639180160:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572400.280568:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d28c000/2, rc 0, transno 4294968855 00000100:00100000:3.0:1788572400.280572:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639180288:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788572400.280735:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339eee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.280751:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572400.280935:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639180800 00000100:00100000:2.0:1788572400.280942:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639180800 00000100:00100000:2.0:1788572400.280976:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4401 00000100:00100000:2.0:1788572400.280983:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3651:x1875449639180800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.281019:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2851 count 1 00002000:00010000:2.0:1788572400.281039:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.281044:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356d6c28/0xdb7edb52b8339efc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281053:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb23:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.281056:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.281060:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000356d6c28/0xdb7edb52b8339efc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281070:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000356d6c28/0xdb7edb52b8339efc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281079:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000356d6c28/0xdb7edb52b8339efc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281086:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000356d6c28/0xdb7edb52b8339efc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281101:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572400.281179:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3651:x1875449639180800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 196us (672us total) trans 4294968860 rc 0/0 00000100:00100000:2.0:1788572400.281185:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4401 00010000:00010000:2.0:1788572400.281211:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572400.281217:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339eee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281223:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.281226:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339eee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281235:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339eee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281248:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339eee lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281256:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b8339eee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281272:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.281275:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000356d6c28/0xdb7edb52b8339efc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281282:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.281285:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000356d6c28/0xdb7edb52b8339efc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281293:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000356d6c28/0xdb7edb52b8339efc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281304:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000356d6c28/0xdb7edb52b8339efc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281312:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000356d6c28/0xdb7edb52b8339efc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.281322:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.281323:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.281325:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.281337:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.281417:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639181568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.281445:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572400.281476:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f8000/2, rc 0, transno 12884902092 00000100:00100000:2.0:1788572400.281499:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639180928:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.281512:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349fb100/2, rc 0, transno 12884902090 00000100:00100000:2.0:1788572400.281515:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639181056:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.281526:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572400.281532:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639181440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.281553:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.281576:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639181568 00000100:00100000:2.0:1788572400.281580:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639181568 00000100:00100000:1.0:1788572400.281710:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3653:x1875449639180928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2000us (2350us total) trans 12884902092 rc 0/0 00000100:00100000:1.0:1788572400.281720:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4398 00000100:00100000:1.0:1788572400.281807:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639181440 00000100:00100000:1.0:1788572400.281811:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639181440 00000100:00100000:1.0:1788572400.281917:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4402 00000100:00100000:1.0:1788572400.281925:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3653:x1875449639181440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572400.281942:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2854 count 1 00002000:00010000:1.0:1788572400.281960:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.281966:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339f03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.281976:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb26:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.281979:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.281983:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339f03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.281994:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339f03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282017:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339f03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282027:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339f03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282042:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.282151:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3653:x1875449639181440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 227us (597us total) trans 4294968861 rc 0/0 00000100:00100000:1.0:1788572400.282158:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4402 00010000:00010000:1.0:1788572400.282179:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572400.282184:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339f03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282191:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.282194:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339f03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282203:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339f03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282215:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339f03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282222:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e256bc4/0xdb7edb52b8339f03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282235:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.282237:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.282239:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.282244:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572400.282266:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e573800/2, rc 0, transno 4294968859 00000100:00100000:1.0:1788572400.282277:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639178880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.282307:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639179392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.282328:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.282347:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639179392 00000100:00100000:1.0:1788572400.282351:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639179392 00000100:00100000:1.0:1788572400.282373:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4403 00000100:00100000:1.0:1788572400.282378:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3652:x1875449639179392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572400.282390:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2846 count 1 00002000:00010000:1.0:1788572400.282406:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.282411:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a5eff2a/0xdb7edb52b8339f0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282419:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1e:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.282422:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.282427:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a5eff2a/0xdb7edb52b8339f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282435:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a5eff2a/0xdb7edb52b8339f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282442:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a5eff2a/0xdb7edb52b8339f0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282453:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a5eff2a/0xdb7edb52b8339f0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.282465:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788572400.282712:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2df80/2, rc 0, transno 12884902089 00000100:00100000:3.0:1788572400.282721:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639179648:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572400.282741:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2ed80/2, rc 0, transno 12884902091 00000100:00100000:3.0:1788572400.282745:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639179776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.282759:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639181312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.282786:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572400.282812:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e61e762a00/2, rc 0, transno 4294968860 00000100:00100000:0.0:1788572400.282948:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639181312 00000100:00100000:0.0:1788572400.282953:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639181312 00000100:00100000:0.0:1788572400.282984:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4404 00000100:00100000:0.0:1788572400.282992:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+44:3651:x1875449639181312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.283029:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2853 count 1 00002000:00010000:0.0:1788572400.283048:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.283054:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020ae776f/0xdb7edb52b8339f11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.283063:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb25:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.283066:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.283071:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020ae776f/0xdb7edb52b8339f11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.283081:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020ae776f/0xdb7edb52b8339f11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.283090:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020ae776f/0xdb7edb52b8339f11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.283097:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020ae776f/0xdb7edb52b8339f11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.283111:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572400.283193:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+45:3651:x1875449639181312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 201us (405us total) trans 4294968862 rc 0/0 00000100:00100000:0.0:1788572400.283200:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4404 00000100:00100000:3.0:1788572400.285939:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639180800:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788572400.286020:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f9500/2, rc 0, transno 4294968862 00000100:00100000:3.0:1788572400.286028:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639181312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.286036:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788572400.286048:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639180672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.286108:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.286151:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639181184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.286172:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.286197:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639181696:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788572400.286219:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.286328:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639180672 00000100:00100000:3.0:1788572400.286335:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639180672 00000100:00100000:3.0:1788572400.286372:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639181184 00000100:00100000:3.0:1788572400.286375:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639181184 00000100:00100000:3.0:1788572400.286387:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4405 00000100:00100000:3.0:1788572400.286394:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+42:3651:x1875449639180672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.286425:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2847 count 1 00002000:00010000:3.0:1788572400.286547:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.286555:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339f18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.286571:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1f:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.286575:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.286581:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339f18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.286607:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339f18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.286617:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339f18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.286624:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339f18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.286643:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788572400.286759:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+43:3651:x1875449639180672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 363us (649us total) trans 12884902093 rc 0/0 00000100:00100000:3.0:1788572400.286766:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4405 00000100:00100000:3.0:1788572400.286782:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639181696 00000100:00100000:3.0:1788572400.286785:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639181696 00000100:00100000:3.0:1788572400.286800:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4406 00000100:00100000:3.0:1788572400.286805:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+46:3651:x1875449639181184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788572400.286818:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2852 count 1 00000100:00100000:0.0:1788572400.286959:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4407 00000100:00100000:0.0:1788572400.286970:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3651:x1875449639181696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.286986:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2856 count 1 00002000:00010000:0.0:1788572400.287032:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.287038:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642baed1/0xdb7edb52b8339f1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.287047:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb28:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.287050:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.287054:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000642baed1/0xdb7edb52b8339f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.287064:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000642baed1/0xdb7edb52b8339f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.287072:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642baed1/0xdb7edb52b8339f1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.287079:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000642baed1/0xdb7edb52b8339f1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.287093:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788572400.287177:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3651:x1875449639181696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 210us (956us total) trans 4294968863 rc 0/0 00000100:00100000:0.0:1788572400.287184:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4407 00000100:00100000:2.0:1788572400.287988:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4408 00000100:00100000:2.0:1788572400.287999:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3653:x1875449639181568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.288036:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2855 count 1 00002000:00010000:2.0:1788572400.288056:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.288062:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c817cc4/0xdb7edb52b8339f26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288074:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb27:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.288078:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.288083:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c817cc4/0xdb7edb52b8339f26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288094:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c817cc4/0xdb7edb52b8339f26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288103:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c817cc4/0xdb7edb52b8339f26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288110:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c817cc4/0xdb7edb52b8339f26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288120:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1788572400.288221:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3653:x1875449639181568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 225us (6775us total) trans 4294968864 rc 0/0 00000100:00100000:2.0:1788572400.288228:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4408 00010000:00010000:2.0:1788572400.288262:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788572400.288269:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a5eff2a/0xdb7edb52b8339f0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288277:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.288281:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a5eff2a/0xdb7edb52b8339f0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288290:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a5eff2a/0xdb7edb52b8339f0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288306:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a5eff2a/0xdb7edb52b8339f0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288313:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a5eff2a/0xdb7edb52b8339f0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288332:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572400.288335:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020ae776f/0xdb7edb52b8339f11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288346:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9d600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.288349:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020ae776f/0xdb7edb52b8339f11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288356:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020ae776f/0xdb7edb52b8339f11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288366:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020ae776f/0xdb7edb52b8339f11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288372:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020ae776f/0xdb7edb52b8339f11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288387:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572400.288391:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339f18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288397:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.288401:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339f18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288408:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339f18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288418:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339f18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288425:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6c4b67d/0xdb7edb52b8339f18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288442:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572400.288446:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000642baed1/0xdb7edb52b8339f1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288452:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9d400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.288454:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000642baed1/0xdb7edb52b8339f1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288461:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000642baed1/0xdb7edb52b8339f1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288470:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000642baed1/0xdb7edb52b8339f1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.288477:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000642baed1/0xdb7edb52b8339f1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572400.288604:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3652:x1875449639179392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6223us (6272us total) trans 4294968865 rc 0/0 00000100:00100000:1.0:1788572400.288611:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4403 00010000:00010000:1.0:1788572400.288632:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572400.288637:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c817cc4/0xdb7edb52b8339f26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.288644:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1aa00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.288647:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c817cc4/0xdb7edb52b8339f26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.288655:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c817cc4/0xdb7edb52b8339f26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.288666:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c817cc4/0xdb7edb52b8339f26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.288672:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c817cc4/0xdb7edb52b8339f26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.288689:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.288691:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.288693:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.288703:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.288708:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572400.288799:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d28fb80/2, rc 0, transno 4294968865 00000100:00100000:1.0:1788572400.288814:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639179392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.289105:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639179904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.289141:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.289171:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639179904 00000100:00100000:1.0:1788572400.289176:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639179904 00000100:00100000:1.0:1788572400.289204:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4409 00000100:00100000:1.0:1788572400.289211:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+43:3652:x1875449639179904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.289229:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2845 count 1 00002000:00010000:1.0:1788572400.289316:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.289323:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b8339f2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.289334:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1d:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.289338:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.289343:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b8339f2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.289354:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b8339f2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.289363:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b8339f2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.289375:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b8339f2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.289389:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.289468:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3652:x1875449639179904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 257us (326us total) trans 12884902094 rc 0/0 00000100:00100000:1.0:1788572400.289476:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4409 00010000:00010000:1.0:1788572400.289505:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572400.289509:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b8339f2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.289516:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.289519:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b8339f2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.289527:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b8339f2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.289540:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b8339f2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.289547:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b8339f2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.289561:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.289563:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.289565:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572400.289771:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d880/2, rc 0, transno 12884902094 00000100:00100000:1.0:1788572400.289779:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639179904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.289795:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639181952:0@lo:6:osp-syn-1-0.0 00002000:00010000:3.0:1788572400.289930:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.289937:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8339f34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.289946:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb24:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.289949:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.289954:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8339f34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.289964:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8339f34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.289973:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8339f34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.289980:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8339f34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.290000:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.290096:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+47:3651:x1875449639181184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3290us (3922us total) trans 4294968866 rc 0/0 00000100:00100000:3.0:1788572400.290104:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4406 00000100:00100000:3.0:1788572400.290129:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639181824:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788572400.290160:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.290165:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8339f34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.290174:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.290177:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8339f34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.290185:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8339f34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.290196:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8339f34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.290204:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe0407c1/0xdb7edb52b8339f34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.290222:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.290224:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.290226:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788572400.290253:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63ad51880/2, rc 0, transno 12884902082 00000100:00100000:3.0:1788572400.290258:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639174016:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572400.290265:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639174528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.290350:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572400.290386:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572400.290394:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572400.290419:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e633e2d500/2, rc 0, transno 12884902093 00000100:00100000:1.0:1788572400.290425:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639180672:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572400.290434:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f8380/2, rc 0, transno 4294968866 00000100:00100000:1.0:1788572400.290442:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639181184:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572400.290452:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac7b80/2, rc 0, transno 4294968863 00000100:00100000:1.0:1788572400.290456:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639181696:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.290527:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639182336:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.290551:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.290570:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572400.290575:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639182208:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.290610:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.290635:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639181952 00000100:00100000:1.0:1788572400.290640:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639181952 00000100:00100000:1.0:1788572400.290670:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639181824 00000100:00100000:1.0:1788572400.290673:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639181824 00000100:00100000:1.0:1788572400.290688:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639182336 00000100:00100000:1.0:1788572400.290690:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639182336 00000100:00100000:1.0:1788572400.290703:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639182208 00000100:00100000:1.0:1788572400.290705:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639182208 00000100:00100000:1.0:1788572400.290721:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4410 00000100:00100000:1.0:1788572400.290728:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3652:x1875449639181952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572400.290750:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2858 count 1 00002000:00010000:1.0:1788572400.290771:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.290777:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339f3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.290787:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2a:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.290790:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.290795:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339f3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.290805:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339f3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.290814:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339f3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572400.290949:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4411 00000100:00100000:0.0:1788572400.290959:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3651:x1875449639181824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.290971:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2857 count 1 00002000:00010000:0.0:1788572400.290987:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.290992:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007274d8ec/0xdb7edb52b8339f42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291000:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb29:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.291029:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.291034:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007274d8ec/0xdb7edb52b8339f42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291045:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007274d8ec/0xdb7edb52b8339f42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291053:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007274d8ec/0xdb7edb52b8339f42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291059:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007274d8ec/0xdb7edb52b8339f42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291074:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572400.291175:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3651:x1875449639181824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 219us (780us total) trans 4294968867 rc 0/0 00000100:00100000:0.0:1788572400.291182:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4411 00000100:00100000:0.0:1788572400.291198:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4412 00000100:00100000:0.0:1788572400.291205:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3651:x1875449639182336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.291215:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2861 count 1 00002000:00010000:0.0:1788572400.291230:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.291234:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e34163c2/0xdb7edb52b8339f49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291243:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2d:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.291246:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.291249:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e34163c2/0xdb7edb52b8339f49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291257:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e34163c2/0xdb7edb52b8339f49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291264:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e34163c2/0xdb7edb52b8339f49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291270:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e34163c2/0xdb7edb52b8339f49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291284:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572400.291341:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3651:x1875449639182336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 136us (788us total) trans 4294968868 rc 0/0 00000100:00100000:0.0:1788572400.291347:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4412 00000100:00100000:0.0:1788572400.291359:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4413 00000100:00100000:0.0:1788572400.291366:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3651:x1875449639182208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.291377:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2860 count 1 00002000:00010000:0.0:1788572400.291391:0:43966:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.291396:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000be83d91/0xdb7edb52b8339f50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291409:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2c:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.291412:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.291416:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000be83d91/0xdb7edb52b8339f50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291424:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000be83d91/0xdb7edb52b8339f50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291432:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000be83d91/0xdb7edb52b8339f50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291439:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000be83d91/0xdb7edb52b8339f50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.291452:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788572400.291526:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3651:x1875449639182208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 160us (915us total) trans 4294968869 rc 0/0 00000100:00100000:0.0:1788572400.291533:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4413 00010000:00010000:3.0:1788572400.291652:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788572400.291658:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007274d8ec/0xdb7edb52b8339f42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291667:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.291672:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007274d8ec/0xdb7edb52b8339f42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291682:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007274d8ec/0xdb7edb52b8339f42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291697:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007274d8ec/0xdb7edb52b8339f42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291706:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007274d8ec/0xdb7edb52b8339f42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291723:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572400.291726:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e34163c2/0xdb7edb52b8339f49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291733:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9ca00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.291736:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e34163c2/0xdb7edb52b8339f49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291744:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e34163c2/0xdb7edb52b8339f49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291753:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e34163c2/0xdb7edb52b8339f49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291761:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e34163c2/0xdb7edb52b8339f49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291772:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.291776:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000be83d91/0xdb7edb52b8339f50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291782:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9de00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.291785:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000be83d91/0xdb7edb52b8339f50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291792:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000be83d91/0xdb7edb52b8339f50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291802:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000be83d91/0xdb7edb52b8339f50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.291809:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000be83d91/0xdb7edb52b8339f50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.291988:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.291990:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.291992:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.292120:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639182080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.292158:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.292189:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639182592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.292207:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.292223:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639183104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.292240:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572400.292268:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f8e00/2, rc 0, transno 4294968861 00000100:00100000:2.0:1788572400.292279:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639181440:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572400.292288:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f9180/2, rc 0, transno 4294968864 00000100:00100000:2.0:1788572400.292292:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639181568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.292302:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788572400.292307:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639182464:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.292325:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.292341:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639182976:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.292361:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.292416:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639182080 00000100:00100000:2.0:1788572400.292421:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639182080 00000100:00100000:2.0:1788572400.292450:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639182592 00000100:00100000:2.0:1788572400.292453:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639182592 00000100:00100000:2.0:1788572400.292471:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639183104 00000100:00100000:2.0:1788572400.292474:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639183104 00000100:00100000:2.0:1788572400.292498:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639182464 00000100:00100000:2.0:1788572400.292501:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639182464 00000100:00100000:2.0:1788572400.292518:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639182976 00000100:00100000:2.0:1788572400.292520:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639182976 00000100:00100000:2.0:1788572400.292536:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4414 00000100:00100000:2.0:1788572400.292543:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+51:3653:x1875449639182080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.292561:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2859 count 1 00002000:00010000:2.0:1788572400.292581:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.292598:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006565b00/0xdb7edb52b8339f57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.292609:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2b:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.292613:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.292617:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006565b00/0xdb7edb52b8339f57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.292626:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006565b00/0xdb7edb52b8339f57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.292634:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006565b00/0xdb7edb52b8339f57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.292641:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006565b00/0xdb7edb52b8339f57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.292658:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572400.292744:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+52:3653:x1875449639182080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 200us (585us total) trans 4294968870 rc 0/0 00000100:00100000:2.0:1788572400.292751:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4414 00000100:00100000:2.0:1788572400.292767:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4415 00000100:00100000:2.0:1788572400.292773:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+47:3653:x1875449639182592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.292784:0:43976:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2851 count 1 00010000:00010000:3.0:1788572400.292957:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.292962:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.292966:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006565b00/0xdb7edb52b8339f57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.292974:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.292978:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006565b00/0xdb7edb52b8339f57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.292993:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006565b00/0xdb7edb52b8339f57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293020:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006565b00/0xdb7edb52b8339f57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293029:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006565b00/0xdb7edb52b8339f57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293049:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.293051:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.293053:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572400.293066:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4416 00000100:00100000:3.0:1788572400.293075:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3653:x1875449639183104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.293088:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2855 count 1 00002000:00010000:3.0:1788572400.293162:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.293168:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8339f5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293176:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb27:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.293179:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.293184:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8339f5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293194:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8339f5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293202:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8339f5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293209:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8339f5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293224:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.293302:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3653:x1875449639183104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 229us (1060us total) trans 12884902095 rc 0/0 00000100:00100000:3.0:1788572400.293308:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4416 00000100:00100000:3.0:1788572400.293323:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4417 00000100:00100000:3.0:1788572400.293329:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3653:x1875449639182464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.293339:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2850 count 1 00002000:00010000:3.0:1788572400.293384:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.293389:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40d0925/0xdb7edb52b8339f65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293398:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb22:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.293401:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.293405:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40d0925/0xdb7edb52b8339f65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293415:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c40d0925/0xdb7edb52b8339f65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293428:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c40d0925/0xdb7edb52b8339f65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293435:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c40d0925/0xdb7edb52b8339f65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.293449:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572400.293531:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339f3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.293544:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788572400.293683:0:43976:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.293689:0:43976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c64f96ad/0xdb7edb52b8339f6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.293702:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb23:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.293705:0:43976:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.293709:0:43976:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c64f96ad/0xdb7edb52b8339f6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.293719:0:43976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c64f96ad/0xdb7edb52b8339f6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.293726:0:43976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c64f96ad/0xdb7edb52b8339f6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.293734:0:43976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c64f96ad/0xdb7edb52b8339f6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.293743:0:43976:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1788572400.293806:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+49:3653:x1875449639182592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1033us (1597us total) trans 12884902097 rc 0/0 00000100:00100000:2.0:1788572400.293813:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4415 00000100:00100000:1.0:1788572400.293931:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3652:x1875449639181952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3203us (3580us total) trans 4294968871 rc 0/0 00000100:00100000:1.0:1788572400.293937:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4410 00000100:00100000:1.0:1788572400.293955:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4418 00000100:00100000:1.0:1788572400.293963:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3653:x1875449639182976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.293978:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2854 count 1 00002000:00010000:1.0:1788572400.294043:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.294048:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ebabd40/0xdb7edb52b8339f73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294056:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb26:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.294059:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.294063:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ebabd40/0xdb7edb52b8339f73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294073:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ebabd40/0xdb7edb52b8339f73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294080:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ebabd40/0xdb7edb52b8339f73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294086:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ebabd40/0xdb7edb52b8339f73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294093:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1788572400.294155:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3653:x1875449639182976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 192us (1790us total) trans 12884902098 rc 0/0 00000100:00100000:1.0:1788572400.294161:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4418 00010000:00010000:1.0:1788572400.294188:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788572400.294193:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8339f5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294207:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.294210:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8339f5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294218:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8339f5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294232:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8339f5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294239:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097e08729/0xdb7edb52b8339f5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294257:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788572400.294261:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c40d0925/0xdb7edb52b8339f65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294266:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.294269:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40d0925/0xdb7edb52b8339f65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294276:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c40d0925/0xdb7edb52b8339f65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294286:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c40d0925/0xdb7edb52b8339f65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294293:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c40d0925/0xdb7edb52b8339f65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294308:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572400.294312:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339f3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294318:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.294321:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339f3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294328:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339f3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294338:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339f3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294345:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006b04dac/0xdb7edb52b8339f3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294360:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572400.294363:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c64f96ad/0xdb7edb52b8339f6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294369:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1b200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.294372:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c64f96ad/0xdb7edb52b8339f6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294379:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c64f96ad/0xdb7edb52b8339f6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294387:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c64f96ad/0xdb7edb52b8339f6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294393:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c64f96ad/0xdb7edb52b8339f6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294405:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572400.294408:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ebabd40/0xdb7edb52b8339f73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294414:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.294417:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ebabd40/0xdb7edb52b8339f73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294423:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ebabd40/0xdb7edb52b8339f73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294431:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ebabd40/0xdb7edb52b8339f73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294437:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ebabd40/0xdb7edb52b8339f73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.294447:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.294449:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.294451:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.294462:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.294468:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.294650:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572400.294686:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637798a80/2, rc 0, transno 12884902098 00000100:00100000:2.0:1788572400.294700:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639182976:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.294713:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac6300/2, rc 0, transno 4294968870 00000100:00100000:2.0:1788572400.294720:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639182080:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572400.294728:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349faa00/2, rc 0, transno 12884902097 00000100:00100000:2.0:1788572400.294732:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639182592:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.294741:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637798000/2, rc 0, transno 12884902095 00000100:00100000:2.0:1788572400.294744:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639183104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.294751:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572400.294763:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639183488:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.294799:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572400.295059:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639183488 00000100:00100000:0.0:1788572400.295067:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639183488 00000100:00100000:0.0:1788572400.295117:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4419 00000100:00100000:0.0:1788572400.295124:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+52:3653:x1875449639183488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.295142:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2863 count 1 00002000:00010000:0.0:1788572400.295161:0:43970:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.295167:0:43970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339f7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.295179:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2f:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.295182:0:43970:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.295187:0:43970:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339f7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.295197:0:43970:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339f7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.295205:0:43970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339f7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.295212:0:43970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339f7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.295224:0:43970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572400.295308:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+53:3653:x1875449639183488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 184us (508us total) trans 4294968872 rc 0/0 00000100:00100000:0.0:1788572400.295314:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4419 00000100:00100000:2.0:1788572400.295495:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639183616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.295521:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788572400.295545:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637799180/2, rc 0, transno 4294968872 00000100:00100000:2.0:1788572400.295554:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639183488:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.295563:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572400.295569:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639184000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572400.295846:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639183616 00000100:00100000:0.0:1788572400.295851:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639183616 00000100:00100000:0.0:1788572400.295877:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4420 00000100:00100000:0.0:1788572400.295883:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3653:x1875449639183616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.295896:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2864 count 1 00002000:00010000:0.0:1788572400.295913:0:43968:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.295919:0:43968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339f81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.295929:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb30:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.295932:0:43968:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.295936:0:43968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339f81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.295948:0:43968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339f81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.295956:0:43968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339f81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.295964:0:43968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339f81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.295978:0:43968:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572400.296167:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639182848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572400.298411:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+54:3653:x1875449639183616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2517us (2878us total) trans 4294968873 rc 0/0 00000100:00100000:0.0:1788572400.298427:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4420 00010000:00010000:0.0:1788572400.302162:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572400.302179:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339f7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.302194:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9ce00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.302199:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339f7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.302217:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339f7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.302240:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339f7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.302248:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000254fb3e3/0xdb7edb52b8339f7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.302276:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.302280:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339f81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.302286:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.302290:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339f81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.302297:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339f81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.302307:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339f81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.302314:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000368dc0a5/0xdb7edb52b8339f81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.302331:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.302333:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.302335:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572400.303181:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.303240:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639183360:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.303278:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788572400.303321:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac5880/2, rc 0, transno 4294968869 00000100:00100000:1.0:1788572400.303328:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639182208:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572400.303339:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac5500/2, rc 0, transno 4294968868 00000100:00100000:1.0:1788572400.303343:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639182336:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788572400.303354:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac4a80/2, rc 0, transno 4294968867 00000100:00100000:1.0:1788572400.303358:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639181824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.303374:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639183872:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.303395:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.303419:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788572400.303426:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d4b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639182720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.303448:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.303467:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639183232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.303494:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.303509:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639183744:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.303530:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.303564:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639182848 00000100:00100000:1.0:1788572400.303570:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639182848 00000100:00100000:1.0:1788572400.303610:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639183360 00000100:00100000:1.0:1788572400.303613:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639183360 00000100:00100000:1.0:1788572400.303628:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639183872 00000100:00100000:1.0:1788572400.303631:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639183872 00000100:00100000:1.0:1788572400.303645:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639182720 00000100:00100000:1.0:1788572400.303647:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639182720 00000100:00100000:1.0:1788572400.303656:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639183232 00000100:00100000:1.0:1788572400.303658:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639183232 00000100:00100000:1.0:1788572400.303665:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639183744 00000100:00100000:1.0:1788572400.303667:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639183744 00000100:00100000:1.0:1788572400.303678:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4421 00000100:00100000:1.0:1788572400.303686:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+53:3651:x1875449639182848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.303717:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2853 count 1 00000100:00100000:0.0:1788572400.304869:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4422 00000100:00100000:0.0:1788572400.304887:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3651:x1875449639183360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788572400.304911:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2862 count 1 00002000:00010000:0.0:1788572400.304946:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.304954:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339f88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.304972:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2e:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.304977:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.304983:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339f88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.304998:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339f88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305027:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339f88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305036:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339f88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305058:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788572400.305213:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3651:x1875449639183360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 333us (1932us total) trans 4294968874 rc 0/0 00000100:00100000:0.0:1788572400.305220:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4422 00000100:00100000:0.0:1788572400.305245:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4423 00000100:00100000:0.0:1788572400.305253:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3651:x1875449639183872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572400.305268:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2858 count 1 00002000:00010000:0.0:1788572400.305339:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.305344:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339f8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305353:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2a:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.305356:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.305359:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305369:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305377:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305383:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305398:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788572400.305458:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3651:x1875449639183872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 207us (2061us total) trans 12884902099 rc 0/0 00000100:00100000:0.0:1788572400.305467:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4423 00000100:00100000:0.0:1788572400.305479:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4424 00000100:00100000:0.0:1788572400.305497:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3651:x1875449639182720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572400.305508:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2852 count 1 00002000:00010000:0.0:1788572400.305552:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.305557:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339f96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305565:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb24:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.305568:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.305572:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339f96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305580:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339f96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305596:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339f96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305604:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339f96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305619:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788572400.305672:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3651:x1875449639182720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 187us (2222us total) trans 12884902100 rc 0/0 00000100:00100000:0.0:1788572400.305678:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4424 00000100:00100000:0.0:1788572400.305690:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4425 00000100:00100000:0.0:1788572400.305696:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3651:x1875449639183232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572400.305706:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2856 count 1 00002000:00010000:0.0:1788572400.305744:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.305750:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae42ebf2/0xdb7edb52b8339f9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305758:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb28:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.305761:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.305765:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae42ebf2/0xdb7edb52b8339f9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305774:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae42ebf2/0xdb7edb52b8339f9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305781:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae42ebf2/0xdb7edb52b8339f9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305790:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae42ebf2/0xdb7edb52b8339f9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305798:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788572400.305843:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3651:x1875449639183232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 147us (2348us total) trans 12884902101 rc 0/0 00000100:00100000:0.0:1788572400.305848:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4425 00000100:00100000:0.0:1788572400.305859:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4426 00000100:00100000:0.0:1788572400.305865:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3651:x1875449639183744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572400.305876:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2857 count 1 00002000:00010000:0.0:1788572400.305914:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572400.305919:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f79f95e2/0xdb7edb52b8339fa4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305926:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb29:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:0.0:1788572400.305929:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572400.305932:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f79f95e2/0xdb7edb52b8339fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305940:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f79f95e2/0xdb7edb52b8339fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305948:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f79f95e2/0xdb7edb52b8339fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305955:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f79f95e2/0xdb7edb52b8339fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.305961:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:0.0:1788572400.306030:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3651:x1875449639183744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 165us (2499us total) trans 12884902102 rc 0/0 00000100:00100000:0.0:1788572400.306036:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4426 00010000:00010000:0.0:1788572400.306059:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572400.306065:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339f88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306078:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.306083:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339f88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306093:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339f88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306110:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339f88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306118:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048142a9a/0xdb7edb52b8339f88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306138:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572400.306141:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306147:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9cc00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.306151:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306158:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339f8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306166:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339f8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306173:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076698c84/0xdb7edb52b8339f8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306182:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572400.306185:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339f96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306191:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.306193:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339f96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306200:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339f96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306208:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339f96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306214:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009de111e5/0xdb7edb52b8339f96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306223:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572400.306226:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae42ebf2/0xdb7edb52b8339f9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306232:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.306235:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae42ebf2/0xdb7edb52b8339f9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306242:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae42ebf2/0xdb7edb52b8339f9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306250:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae42ebf2/0xdb7edb52b8339f9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306257:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae42ebf2/0xdb7edb52b8339f9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306266:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.306268:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f79f95e2/0xdb7edb52b8339fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306275:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9d000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.306278:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f79f95e2/0xdb7edb52b8339fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306285:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f79f95e2/0xdb7edb52b8339fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306292:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f79f95e2/0xdb7edb52b8339fa4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306298:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f79f95e2/0xdb7edb52b8339fa4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.306310:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.306312:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.306314:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572400.306768:0:43975:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.306776:0:43975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e256bc4/0xdb7edb52b8339fab lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.306785:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb25:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.306788:0:43975:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.306792:0:43975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e256bc4/0xdb7edb52b8339fab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.306802:0:43975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e256bc4/0xdb7edb52b8339fab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.306810:0:43975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e256bc4/0xdb7edb52b8339fab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.306817:0:43975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e256bc4/0xdb7edb52b8339fab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.306897:0:43975:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.310646:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+54:3651:x1875449639182848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3315us (3827us total) trans 12884902103 rc 0/0 00000100:00100000:1.0:1788572400.310674:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4421 00010000:00010000:1.0:1788572400.310730:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572400.310738:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e256bc4/0xdb7edb52b8339fab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.310751:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.310757:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e256bc4/0xdb7edb52b8339fab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.310768:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e256bc4/0xdb7edb52b8339fab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.310791:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e256bc4/0xdb7edb52b8339fab lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.310800:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e256bc4/0xdb7edb52b8339fab lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.310885:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.310888:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.310890:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.310896:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788572400.310951:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d4b1500/2, rc 0, transno 12884902100 00000100:00100000:1.0:1788572400.310977:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d4b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639182720:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572400.310991:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63779b100/2, rc 0, transno 12884902101 00000100:00100000:1.0:1788572400.310995:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639183232:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572400.311023:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d289500/2, rc 0, transno 12884902102 00000100:00100000:1.0:1788572400.311027:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639183744:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572400.311036:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d289c00/2, rc 0, transno 12884902099 00000100:00100000:1.0:1788572400.311039:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639183872:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572400.311048:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d4b0380/2, rc 0, transno 12884902103 00000100:00100000:1.0:1788572400.311052:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d4b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639182848:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572400.311064:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637799f80/2, rc 0, transno 4294968874 00000100:00100000:1.0:1788572400.311068:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639183360:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.311101:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.311152:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639175040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788572400.311201:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.311235:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639174528 00000100:00100000:1.0:1788572400.311242:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639174528 00000100:00100000:1.0:1788572400.311272:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639175040 00000100:00100000:1.0:1788572400.311275:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639175040 00000100:00100000:1.0:1788572400.311290:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4427 00000100:00100000:1.0:1788572400.311298:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3650:x1875449639174528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.311327:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2822 count 1 00002000:00010000:1.0:1788572400.311438:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb06:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.311445:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b8339fb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.311457:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb06:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.311462:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb06:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.311468:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b8339fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.311481:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b8339fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.311501:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b8339fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.311508:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b8339fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.311525:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.311641:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3650:x1875449639174528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 342us (538us total) trans 12884902104 rc 0/0 00000100:00100000:1.0:1788572400.311647:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4427 00000100:00100000:1.0:1788572400.311662:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4428 00000100:00100000:1.0:1788572400.311669:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3650:x1875449639175040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788572400.311685:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2828 count 1 00002000:00010000:1.0:1788572400.311704:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.311710:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b06ad6/0xdb7edb52b8339fb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.311719:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0c:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.311722:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb0c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.311726:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039b06ad6/0xdb7edb52b8339fb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.311737:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039b06ad6/0xdb7edb52b8339fb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.311744:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b06ad6/0xdb7edb52b8339fb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.311752:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039b06ad6/0xdb7edb52b8339fb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.311766:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572400.312170:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572400.312177:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b8339fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.312186:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.312189:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b8339fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.312198:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b8339fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.312213:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b8339fb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.312221:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b8339fb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb06:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.312239:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.312243:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039b06ad6/0xdb7edb52b8339fb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.312249:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.312253:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b06ad6/0xdb7edb52b8339fb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.312260:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b06ad6/0xdb7edb52b8339fb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.312270:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039b06ad6/0xdb7edb52b8339fb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.312276:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039b06ad6/0xdb7edb52b8339fb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.312287:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.312289:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.312291:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.312367:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.312415:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639184000 00000100:00100000:2.0:1788572400.312420:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639184000 00000100:00100000:2.0:1788572400.312450:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4429 00000100:00100000:2.0:1788572400.312458:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3653:x1875449639184000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572400.312475:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2859 count 1 00002000:00010000:2.0:1788572400.312557:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.312563:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339fc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.312572:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2b:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.312575:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.312580:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.312612:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.312621:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.312628:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.312640:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788572400.312722:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+56:3653:x1875449639184000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 264us (354us total) trans 12884902105 rc 0/0 00000100:00100000:2.0:1788572400.312730:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4429 00010000:00010000:2.0:1788572400.312749:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.312754:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.312762:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.312765:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.312775:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.312786:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339fc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.312794:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000356d6c28/0xdb7edb52b8339fc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.312809:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.312811:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.312813:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572400.313317:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d288a80/2, rc 0, transno 12884902105 00000100:00100000:2.0:1788572400.313329:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639184000:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572400.313342:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d288e00/2, rc 0, transno 4294968873 00000100:00100000:2.0:1788572400.313346:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639183616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.313361:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639184128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788572400.313400:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.313419:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639184640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.313440:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.313457:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572400.313462:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639184512:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.313480:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572400.313540:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639184128 00000100:00100000:2.0:1788572400.313545:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639184128 00000100:00100000:2.0:1788572400.313568:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639184640 00000100:00100000:2.0:1788572400.313571:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639184640 00000100:00100000:2.0:1788572400.313582:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639184512 00000100:00100000:2.0:1788572400.313641:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639184512 00000100:00100000:2.0:1788572400.313667:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4430 00000100:00100000:2.0:1788572400.313674:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3653:x1875449639184128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788572400.313693:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2865 count 1 00002000:00010000:2.0:1788572400.313713:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788572400.313720:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339fc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.313730:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb31:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:2.0:1788572400.313735:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572400.313740:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339fc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.313752:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339fc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.313761:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339fc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.313769:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339fc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.313782:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.313953:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3650:x1875449639175040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2283us (2750us total) trans 4294968875 rc 0/0 00000100:00100000:1.0:1788572400.313961:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4428 00000100:00100000:1.0:1788572400.313980:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4431 00000100:00100000:1.0:1788572400.313987:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3653:x1875449639184640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.313999:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2863 count 1 00002000:00010000:1.0:1788572400.314089:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.314094:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b8339fce lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314108:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2f:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.314111:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.314115:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b8339fce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314125:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b8339fce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314134:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b8339fce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314141:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b8339fce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314149:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788572400.314233:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3653:x1875449639184640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 246us (791us total) trans 12884902106 rc 0/0 00000100:00100000:1.0:1788572400.314239:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4431 00000100:00100000:1.0:1788572400.314252:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4432 00000100:00100000:1.0:1788572400.314258:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3653:x1875449639184512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.314269:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2862 count 1 00002000:00010000:1.0:1788572400.314311:0:8663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.314316:0:8663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b8339fd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314329:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2e:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.314332:0:8663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.314336:0:8663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b8339fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314345:0:8663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b8339fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314353:0:8663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b8339fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314360:0:8663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b8339fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314368:0:8663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788572400.314418:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3653:x1875449639184512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 160us (935us total) trans 12884902107 rc 0/0 00000100:00100000:1.0:1788572400.314424:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4432 00010000:00010000:1.0:1788572400.314444:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788572400.314449:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339fc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314458:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572400.314462:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339fc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.314475:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339fc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.314557:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572400.314563:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b8339fce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.314571:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.314574:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b8339fce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.314582:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b8339fce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.314605:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b8339fce lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.314614:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b8339fce lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.314633:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572400.314636:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b8339fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.314643:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572400.314646:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b8339fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.314654:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b8339fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.314664:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b8339fd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.314671:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b8339fd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572400.314681:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.314682:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572400.314684:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572400.314934:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3653:x1875449639184128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1259us (1531us total) trans 4294968876 rc 0/0 00000100:00100000:2.0:1788572400.314941:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4430 00010000:00010000:2.0:1788572400.314957:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572400.314984:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d28b100/2, rc 0, transno 12884902107 00010000:00010000:1.0:1788572400.315069:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339fc7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315078:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075220434/0xdb7edb52b8339fc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315095:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.315097:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.315099:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572400.315105:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572400.315120:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639184384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.315153:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.315175:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639184896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.315194:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.315213:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572400.315219:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639184256:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.315238:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.315254:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639184768:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572400.315271:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572400.315291:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639184384 00000100:00100000:1.0:1788572400.315297:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639184384 00000100:00100000:1.0:1788572400.315323:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639184896 00000100:00100000:1.0:1788572400.315327:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639184896 00000100:00100000:1.0:1788572400.315342:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639184256 00000100:00100000:1.0:1788572400.315345:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639184256 00000100:00100000:1.0:1788572400.315358:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639184768 00000100:00100000:1.0:1788572400.315360:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639184768 00000100:00100000:1.0:1788572400.315375:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4433 00000100:00100000:1.0:1788572400.315381:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3651:x1875449639184384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.315397:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2861 count 1 00002000:00010000:1.0:1788572400.315460:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.315466:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b8339fdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315475:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2d:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.315479:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.315494:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b8339fdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315505:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b8339fdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315514:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b8339fdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315521:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b8339fdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315539:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788572400.315630:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+62:3651:x1875449639184384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 248us (475us total) trans 12884902108 rc 0/0 00000100:00100000:1.0:1788572400.315638:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4433 00000100:00100000:1.0:1788572400.315652:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4434 00000100:00100000:1.0:1788572400.315659:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3651:x1875449639184896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572400.315671:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2865 count 1 00002000:00010000:1.0:1788572400.315716:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572400.315721:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b077ff9/0xdb7edb52b8339fe3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315729:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb31:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:1.0:1788572400.315732:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572400.315736:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b077ff9/0xdb7edb52b8339fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315746:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b077ff9/0xdb7edb52b8339fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315753:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b077ff9/0xdb7edb52b8339fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315760:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b077ff9/0xdb7edb52b8339fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572400.315779:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788572400.315927:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639184512:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572400.315940:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572400.315944:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b8339fdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.315952:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.315955:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b8339fdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.315962:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b8339fdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.315974:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b8339fdc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.315981:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b8339fdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.315999:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.316018:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b077ff9/0xdb7edb52b8339fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.316025:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.316028:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b077ff9/0xdb7edb52b8339fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.316035:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b077ff9/0xdb7edb52b8339fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.316046:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b077ff9/0xdb7edb52b8339fe3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.316053:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b077ff9/0xdb7edb52b8339fe3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.316067:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.316069:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.316071:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572400.316096:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d289880/2, rc 0, transno 4294968876 00000100:00100000:2.0:1788572400.316101:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639184128:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788572400.316111:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d28a300/2, rc 0, transno 12884902106 00000100:00100000:3.0:1788572400.316181:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3653:x1875449639182464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22851us (23853us total) trans 12884902096 rc 0/0 00000100:00100000:3.0:1788572400.316189:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4417 00000100:00100000:3.0:1788572400.316275:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4435 00000100:00100000:3.0:1788572400.316283:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3651:x1875449639184256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.316295:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2860 count 1 00002000:00010000:3.0:1788572400.316349:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.316354:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339fea lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316363:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2c:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.316365:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.316370:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339fea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316380:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339fea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316394:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339fea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316402:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339fea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316419:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.316481:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3651:x1875449639184256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 199us (1241us total) trans 12884902110 rc 0/0 00000100:00100000:3.0:1788572400.316500:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4435 00000100:00100000:3.0:1788572400.316514:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4436 00000100:00100000:3.0:1788572400.316521:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3651:x1875449639184768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.316532:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2864 count 1 00002000:00010000:3.0:1788572400.316576:0:43965:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.316582:0:43965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b2684d/0xdb7edb52b8339ff1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316590:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb30:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.316593:0:43965:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.316597:0:43965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b2684d/0xdb7edb52b8339ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316607:0:43965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7b2684d/0xdb7edb52b8339ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316619:0:43965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b2684d/0xdb7edb52b8339ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316626:0:43965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b2684d/0xdb7edb52b8339ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316641:0:43965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788572400.316696:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3651:x1875449639184768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 175us (1424us total) trans 12884902111 rc 0/0 00000100:00100000:3.0:1788572400.316703:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4436 00010000:00010000:3.0:1788572400.316722:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788572400.316727:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339fea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316735:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.316738:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339fea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316746:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339fea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316757:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339fea lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316764:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009da54d7e/0xdb7edb52b8339fea lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316784:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572400.316787:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7b2684d/0xdb7edb52b8339ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316794:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572400.316797:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b2684d/0xdb7edb52b8339ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316805:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b2684d/0xdb7edb52b8339ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.316814:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7b2684d/0xdb7edb52b8339ff1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.319981:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7b2684d/0xdb7edb52b8339ff1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.320050:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.320053:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.320056:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.320071:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572400.320078:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572400.320252:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3651:x1875449639184896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4589us (5051us total) trans 12884902109 rc 0/0 00000100:00100000:1.0:1788572400.320264:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4434 00000004:00080000:1.0:1788572400.320332:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d288380/2, rc 0, transno 12884902110 00010000:00010000:0.0:1788572400.320434:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788572400.321818:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6377c0000/2, rc 0, transno 12884902104 00000100:00100000:0.0:1788572400.321841:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639174528:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572400.321861:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e641104e00/2, rc 0, transno 4294968875 00000100:00100000:0.0:1788572400.321867:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639175040:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788572400.321901:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62dac4700/2, rc 0, transno 4294968871 00000100:00100000:0.0:1788572400.321905:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639181952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788572400.321919:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639185024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572400.321982:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572400.322156:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639185024 00000100:00100000:3.0:1788572400.322163:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639185024 00000100:00100000:3.0:1788572400.322218:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4437 00000100:00100000:3.0:1788572400.322228:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3652:x1875449639185024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572400.322255:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2866 count 1 00002000:00010000:3.0:1788572400.322368:0:43969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572400.322377:0:43969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339ff8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.322395:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb32:0x0].0x0 since=4317s v=(0 0) 00010000:00010000:3.0:1788572400.322400:0:43969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788572400.322406:0:43969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.322422:0:43969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.322433:0:43969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.322442:0:43969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572400.322466:0:43969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788572400.322598:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3652:x1875449639185024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 372us (616us total) trans 12884902112 rc 0/0 00000100:00100000:3.0:1788572400.322606:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4437 00000004:00080000:0.0:1788572400.322794:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e637714000/2, rc 0, transno 12884902112 00000100:00100000:0.0:1788572400.322800:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639185024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572400.322972:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639184640:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788572400.322984:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572400.322990:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.323000:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572400.323031:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.323042:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.323060:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339ff8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.323069:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe0407c1/0xdb7edb52b8339ff8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572400.323089:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.323091:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572400.323093:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572400.323112:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6349f9880/2, rc 0, transno 12884902096 00000100:00100000:2.0:1788572400.323116:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639182464:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572400.325241:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572400.327263:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639184256:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572400.327313:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d28bb80/2, rc 0, transno 12884902111 00000100:00100000:1.0:1788572400.327319:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639184768:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572400.327330:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d288000/2, rc 0, transno 12884902108 00000100:00100000:1.0:1788572400.327333:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639184384:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572400.327343:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e62d289180/2, rc 0, transno 12884902109 00000100:00100000:1.0:1788572400.327345:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639184896:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788572401.354965:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572401.667270:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572401.667297:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639185152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572401.667370:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572401.667425:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639185152 00000100:00100000:0.0:1788572401.667433:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639185152 00000100:00100000:0.0:1788572401.667480:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:0.0:1788572401.667490:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639185152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572401.667544:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445904384 avail 1299664896 00000100:00100000:0.0:1788572401.667591:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639185152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572401.667598:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:0.0:1788572401.667640:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639185152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572402.181155:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572402.181181:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639185280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572402.181253:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572402.182729:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639185280 00000100:00100000:1.0:1788572402.182744:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639185280 00000100:00100000:1.0:1788572402.182830:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:1.0:1788572402.182842:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+57:3651:x1875449639185280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572402.182877:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572402.182960:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+57:3651:x1875449639185280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572402.182968:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00000100:00100000:0.0:1788572402.183095:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639185280:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788572402.183716:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572402.377473:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572403.204677:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572403.204699:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639185408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572403.204764:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572403.204826:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639185408 00000100:00100000:1.0:1788572403.204834:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639185408 00000100:00100000:1.0:1788572403.204882:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909 00000100:00100000:1.0:1788572403.204892:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639185408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572403.204922:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572403.204962:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639185408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572403.204969:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909 00000100:00080000:1.0:1788572403.204987:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572403.205042:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639185408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572403.211150:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639185664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572403.211228:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572403.211277:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572403.211283:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639185536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572403.211309:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572403.211400:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639185664 00000100:00100000:2.0:1788572403.211409:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639185664 00000100:00100000:2.0:1788572403.211469:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1788572403.211479:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+62:3653:x1875449639185664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572403.211499:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572403.211556:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+62:3653:x1875449639185664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572403.211563:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000100:00100000:3.0:1788572403.211627:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639185536 00000100:00100000:3.0:1788572403.211632:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639185536 00000100:00100000:3.0:1788572403.211670:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00100000:3.0:1788572403.211676:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639185536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572403.211700:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572403.211733:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639185536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572403.211739:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00000100:00080000:1.0:1788572403.211835:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572403.211870:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639185536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572403.211885:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639185664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572403.397269:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572403.618918:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572403.619076:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616252928 00000100:00100000:0.0:1788572403.619087:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616252928 00000100:00100000:0.0:1788572403.619164:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4654 00000100:00100000:0.0:1788572403.619184:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2386:x1875449616252928:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572403.619269:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+10:2386:x1875449616252928:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 88us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572403.619276:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4654 00000100:00080000:1.0:1788572403.619401:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572403.621955:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572403.622000:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572403.622129:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616253056 00000100:00100000:2.0:1788572403.622139:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616253056 00000100:00100000:2.0:1788572403.622224:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4655 00000100:00100000:2.0:1788572403.622235:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616253056:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572403.622314:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616253056:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572403.622322:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4655 00000100:00100000:1.0:1788572403.622574:0:111984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616252800 00000100:00100000:1.0:1788572403.622579:0:111984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616252800 00000100:00100000:1.0:1788572403.622619:0:111984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 171 00000100:00100000:1.0:1788572403.622626:0:111984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616252800:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572403.622653:0:111984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616252800:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572403.622659:0:111984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 171 00000100:00080000:3.0:1788572403.622858:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572403.718669:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639185792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572403.718772:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572403.719048:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639185792 00000100:00100000:3.0:1788572403.719057:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639185792 00000100:00100000:3.0:1788572403.719119:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:3.0:1788572403.719130:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639185792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572403.719154:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572403.719220:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639185792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572403.719228:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00080000:3.0:1788572403.719252:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572403.719626:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639185792:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572404.419365:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572405.253766:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639186176:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.253855:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572405.253912:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639186688:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.253939:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572405.253958:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639187200:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.253979:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572405.254028:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788572405.254035:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639186048:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254066:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572405.254092:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639186560:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254112:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572405.254129:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d2f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639187072:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254148:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572405.254182:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639186176 00000100:00100000:3.0:1788572405.254190:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639186176 00000100:00100000:3.0:1788572405.254235:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639187200 00000100:00100000:3.0:1788572405.254238:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639187200 00000100:00100000:3.0:1788572405.254251:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639186560 00000100:00100000:3.0:1788572405.254253:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639186560 00000100:00100000:3.0:1788572405.254279:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4656 00000100:00100000:3.0:1788572405.254308:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639186176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254362:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639186176:12345-0@lo:400:kworker.0 Request processed in 56us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.254370:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4656 00000100:00100000:3.0:1788572405.254386:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4657 00000100:00100000:3.0:1788572405.254392:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639187200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254419:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639187200:12345-0@lo:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.254424:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4657 00000100:00100000:3.0:1788572405.254435:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4658 00000100:00100000:3.0:1788572405.254441:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639186560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254466:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639186560:12345-0@lo:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.254474:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4658 00000100:00100000:3.0:1788572405.254491:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639186688 00000100:00100000:3.0:1788572405.254494:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639186688 00000100:00100000:3.0:1788572405.254519:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639187072 00000100:00100000:3.0:1788572405.254521:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639187072 00000100:00100000:3.0:1788572405.254540:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:3.0:1788572405.254546:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639186688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254576:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639186688:12345-0@lo:400:kworker.0 Request processed in 30us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.254594:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00100000:3.0:1788572405.254606:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:3.0:1788572405.254611:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3653:x1875449639187072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254640:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3653:x1875449639187072:12345-0@lo:400:kworker.0 Request processed in 29us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.254652:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:3.0:1788572405.254673:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639186048 00000100:00100000:3.0:1788572405.254676:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639186048 00000100:00100000:3.0:1788572405.254699:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00100000:3.0:1788572405.254705:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639186048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254734:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639186048:12345-0@lo:400:kworker.0 Request processed in 30us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.254740:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00000100:00080000:3.0:1788572405.254766:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572405.254770:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572405.254800:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639186048:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254810:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639186560:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254819:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d2f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639187072:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254827:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639186176:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254835:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639186688:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.254842:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639187200:0@lo:400:kworker.0 00000100:00100000:2.0:1788572405.255245:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639185920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572405.255300:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572405.255339:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639186432:0@lo:400:kworker.0 00000100:00100000:2.0:1788572405.255361:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572405.255374:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d2f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639186944:0@lo:400:kworker.0 00000100:00100000:2.0:1788572405.255391:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572405.255402:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639187456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572405.255420:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572405.255662:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639185920 00000100:00100000:3.0:1788572405.255668:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639185920 00000100:00100000:3.0:1788572405.255708:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788572405.255715:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639185920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.255758:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639185920:12345-0@lo:400:kworker.0 Request processed in 44us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.255764:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788572405.255793:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639186432 00000100:00100000:3.0:1788572405.255796:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639186432 00000100:00100000:3.0:1788572405.255822:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639187456 00000100:00100000:3.0:1788572405.255824:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639187456 00000100:00100000:3.0:1788572405.255841:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4659 00000100:00100000:3.0:1788572405.255847:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639186432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.255875:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639186432:12345-0@lo:400:kworker.0 Request processed in 29us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.255881:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4659 00000100:00100000:3.0:1788572405.255892:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4660 00000100:00100000:3.0:1788572405.255897:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639187456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.255923:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639187456:12345-0@lo:400:kworker.0 Request processed in 26us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.255932:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4660 00000100:00100000:3.0:1788572405.255948:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639186944 00000100:00100000:3.0:1788572405.255951:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639186944 00000100:00100000:3.0:1788572405.255983:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:3.0:1788572405.255990:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+62:3651:x1875449639186944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.256048:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+62:3651:x1875449639186944:12345-0@lo:400:kworker.0 Request processed in 59us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.256054:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00080000:3.0:1788572405.256070:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572405.256074:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572405.256076:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572405.256099:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639185920:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.256112:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639186432:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.256122:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d2f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639186944:0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.256130:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639187456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572405.256470:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639186304:0@lo:400:kworker.0 00000100:00100000:0.0:1788572405.256501:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572405.256528:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6184d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639186816:0@lo:400:kworker.0 00000100:00100000:0.0:1788572405.256549:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572405.256562:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639187328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572405.256579:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572405.262982:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639186304 00000100:00100000:3.0:1788572405.262999:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639186304 00000100:00100000:3.0:1788572405.263090:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:3.0:1788572405.263100:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639186304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.263189:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639186304:12345-0@lo:400:kworker.0 Request processed in 90us (6687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.263197:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00100000:3.0:1788572405.263218:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639186816 00000100:00100000:3.0:1788572405.263233:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639186816 00000100:00100000:3.0:1788572405.263264:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796 00000100:00100000:3.0:1788572405.263271:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639186816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.263318:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639186816:12345-0@lo:400:kworker.0 Request processed in 47us (6767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.263324:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796 00000100:00100000:3.0:1788572405.263343:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639187328 00000100:00100000:3.0:1788572405.263347:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639187328 00000100:00100000:3.0:1788572405.263378:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4661 00000100:00100000:3.0:1788572405.263385:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639187328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572405.263416:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639187328:12345-0@lo:400:kworker.0 Request processed in 32us (6836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572405.263422:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4661 00000100:00080000:0.0:1788572405.263606:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572405.263612:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572405.263667:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639186304:0@lo:400:kworker.0 00000100:00100000:0.0:1788572405.263680:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6184d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639186816:0@lo:400:kworker.0 00000100:00100000:0.0:1788572405.263689:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639187328:0@lo:400:kworker.0 00010000:00010000:3.0:1788572405.443320:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788572405.781507:0:114775:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884902112 is committed 00000001:00080000:2.0:1788572405.782298:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968876 is committed 00000001:02000400:3.0:1788572406.131881:0:115650:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 43: mds osc import failure during recovery; don't LBUG ========================================================== 21:40:04 (1788572404) 00010000:00010000:1.0:1788572406.467478:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572406.787249:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572406.787274:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639187584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572406.787355:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572406.787557:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639187584 00000100:00100000:3.0:1788572406.787565:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639187584 00000100:00100000:3.0:1788572406.787633:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:3.0:1788572406.787642:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639187584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572406.787676:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445904384 avail 1299664896 00000100:00100000:3.0:1788572406.787731:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639187584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572406.787738:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00100000:1.0:1788572406.787926:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639187584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572407.300246:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639187712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572407.300347:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572407.300472:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639187712 00000100:00100000:0.0:1788572407.300482:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639187712 00000100:00100000:0.0:1788572407.300558:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1788572407.300571:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639187712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572407.300640:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572407.300707:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639187712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572407.300715:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00080000:3.0:1788572407.300896:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572407.300939:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968876 gen 3 00000004:00080000:3.0:1788572407.300946:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f5f80, transno 4294968825 00000004:00080000:3.0:1788572407.300964:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633de4700, transno 4294968826 00000004:00080000:3.0:1788572407.300967:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad53800, transno 4294968827 00000004:00080000:3.0:1788572407.300971:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad50700, transno 4294968828 00000004:00080000:3.0:1788572407.300974:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f6300, transno 4294968829 00000004:00080000:3.0:1788572407.300977:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104700, transno 4294968830 00000004:00080000:3.0:1788572407.300980:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad51c00, transno 4294968831 00000004:00080000:3.0:1788572407.300983:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f7800, transno 4294968832 00000004:00080000:3.0:1788572407.300986:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad50e00, transno 4294968833 00000004:00080000:3.0:1788572407.300989:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad50000, transno 4294968834 00000004:00080000:3.0:1788572407.300992:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad51f80, transno 4294968835 00000004:00080000:3.0:1788572407.300995:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad51500, transno 4294968836 00000004:00080000:3.0:1788572407.300998:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641105880, transno 4294968837 00000004:00080000:3.0:1788572407.301031:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e503931f80, transno 4294968838 00000004:00080000:3.0:1788572407.301035:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ae3f480, transno 4294968839 00000004:00080000:3.0:1788572407.301038:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5f80, transno 4294968840 00000004:00080000:3.0:1788572407.301041:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633ee9880, transno 4294968841 00000004:00080000:3.0:1788572407.301043:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f5c00, transno 4294968842 00000004:00080000:3.0:1788572407.301046:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3f480, transno 4294968843 00000004:00080000:3.0:1788572407.301048:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3e300, transno 4294968844 00000004:00080000:3.0:1788572407.301051:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fc3d180, transno 4294968845 00000004:00080000:3.0:1788572407.301054:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad50380, transno 4294968846 00000004:00080000:3.0:1788572407.301057:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6131cd880, transno 4294968847 00000004:00080000:3.0:1788572407.301060:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e634a80, transno 4294968848 00000004:00080000:3.0:1788572407.301063:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e637b80, transno 4294968849 00000004:00080000:3.0:1788572407.301066:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e572a00, transno 4294968850 00000004:00080000:3.0:1788572407.301069:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28ce00, transno 4294968851 00000004:00080000:3.0:1788572407.301071:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e573b80, transno 4294968852 00000004:00080000:3.0:1788572407.301074:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637591500, transno 4294968853 00000004:00080000:3.0:1788572407.301077:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e570a80, transno 4294968854 00000004:00080000:3.0:1788572407.301079:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28c000, transno 4294968855 00000004:00080000:3.0:1788572407.301083:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28e680, transno 4294968856 00000004:00080000:3.0:1788572407.301086:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e501ff5180, transno 4294968857 00000004:00080000:3.0:1788572407.301088:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28d180, transno 4294968858 00000004:00080000:3.0:1788572407.301091:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e573800, transno 4294968859 00000004:00080000:3.0:1788572407.301094:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e762a00, transno 4294968860 00000004:00080000:3.0:1788572407.301098:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f8e00, transno 4294968861 00000004:00080000:3.0:1788572407.301100:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f9500, transno 4294968862 00000004:00080000:3.0:1788572407.301104:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac7b80, transno 4294968863 00000004:00080000:3.0:1788572407.301107:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f9180, transno 4294968864 00000004:00080000:3.0:1788572407.301110:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28fb80, transno 4294968865 00000004:00080000:3.0:1788572407.301113:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f8380, transno 4294968866 00000004:00080000:3.0:1788572407.301117:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4a80, transno 4294968867 00000004:00080000:3.0:1788572407.301120:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5500, transno 4294968868 00000004:00080000:3.0:1788572407.301122:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac5880, transno 4294968869 00000004:00080000:3.0:1788572407.301125:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac6300, transno 4294968870 00000004:00080000:3.0:1788572407.301127:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62dac4700, transno 4294968871 00000004:00080000:3.0:1788572407.301130:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799180, transno 4294968872 00000004:00080000:3.0:1788572407.301133:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288e00, transno 4294968873 00000004:00080000:3.0:1788572407.301136:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637799f80, transno 4294968874 00000004:00080000:3.0:1788572407.301140:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104e00, transno 4294968875 00000004:00080000:3.0:1788572407.301143:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289880, transno 4294968876 00000100:00100000:3.0:1788572407.301160:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639187712:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788572407.302111:0:112000:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 52 done 00010000:00010000:3.0:1788572407.493522:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572407.988688:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572407.988795:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616253184 00000100:00100000:0.0:1788572407.988810:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616253184 00000100:00100000:0.0:1788572407.988928:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15483 00000100:00100000:0.0:1788572407.988942:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+10:89897:x1875449616253184:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572407.988996:0:6552:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445904384 avail 1299664896 00000100:00080000:3.0:1788572407.989429:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572407.989510:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+10:89897:x1875449616253184:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 571us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572407.989519:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15483 00000100:00100000:3.0:1788572407.992523:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572407.993374:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616253312 00000100:00100000:0.0:1788572407.993389:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616253312 00000100:00100000:0.0:1788572407.993473:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15484 00000100:00100000:0.0:1788572407.993483:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:89897:x1875449616253312:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572407.993528:0:95742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572407.993605:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:89897:x1875449616253312:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 123us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572407.993613:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15484 00000100:00080000:2.0:1788572407.993676:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572408.007719:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572408.007845:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616253440 00000100:00100000:0.0:1788572408.007858:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616253440 00000100:00100000:0.0:1788572408.007919:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4438 00000100:00100000:0.0:1788572408.007930:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2382:x1875449616253440:12345-192.168.202.13@tcp:8:lfs.0 00010000:00080000:0.0:1788572408.007974:0:43968:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t0 exp 0000000000000000 cur 4325 last 0 00000020:00000080:0.0:1788572408.008051:0:43968:0:(genops.c:1385:class_connect()) connect: client 35eb2d60-2de0-4b00-9815-d5153edd0057, cookie 0xdb7edb52b8339fff 00002000:00100000:0.0:1788572408.008068:0:43968:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35eb2d60-2de0-4b00-9815-d5153edd0057/ffff94e63c537000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788572408.008091:0:43968:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788572408.008191:0:43968:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788572408.008232:0:43968:0:(import.c:65:import_set_state_nolock()) ffff94e63c533800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572408.008311:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2382:x1875449616253440:12345-192.168.202.13@tcp:8:lfs.0 Request processed in 381us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572408.008321:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4438 00000100:00100000:3.0:1788572408.012644:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572408.018902:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616253568 00000100:00100000:0.0:1788572408.018924:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616253568 00000100:00100000:0.0:1788572408.019059:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2913 00000100:00100000:0.0:1788572408.019073:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:89897:x1875449616253568:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:0.0:1788572408.019109:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572408.019250:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:89897:x1875449616253568:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 179us (6630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572408.019259:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2913 00000100:00080000:0.0:1788572408.019288:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572408.025917:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572408.026762:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616253696 00000100:00100000:1.0:1788572408.026776:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616253696 00000100:00100000:1.0:1788572408.026841:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4439 00000100:00100000:1.0:1788572408.026849:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2382:x1875449616253696:12345-192.168.202.13@tcp:8:lfs.0 00010000:00080000:1.0:1788572408.026893:0:43964:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t0 exp 0000000000000000 cur 4325 last 0 00000020:00000080:1.0:1788572408.026943:0:43964:0:(genops.c:1385:class_connect()) connect: client 35eb2d60-2de0-4b00-9815-d5153edd0057, cookie 0xdb7edb52b833a006 00002000:00100000:1.0:1788572408.026957:0:43964:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35eb2d60-2de0-4b00-9815-d5153edd0057/ffff94e64155a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788572408.026970:0:43964:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788572408.027084:0:43964:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788572408.027122:0:43964:0:(import.c:65:import_set_state_nolock()) ffff94e641559800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572408.027210:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2382:x1875449616253696:12345-192.168.202.13@tcp:8:lfs.0 Request processed in 359us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572408.027219:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4439 00000100:00100000:3.0:1788572408.042507:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572408.045819:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616253824 00000100:00100000:0.0:1788572408.045845:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616253824 00000100:00100000:0.0:1788572408.045947:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2914 00000100:00100000:0.0:1788572408.045961:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:89897:x1875449616253824:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:0.0:1788572408.046018:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572408.046121:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:89897:x1875449616253824:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 163us (3634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572408.046130:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2914 00000100:00080000:0.0:1788572408.046160:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572408.120406:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572408.120588:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616254080 00000100:00100000:1.0:1788572408.120603:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616254080 00000100:00100000:1.0:1788572408.120694:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15485 00000100:00100000:1.0:1788572408.120707:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+10:89904:x1875449616254080:12345-192.168.202.13@tcp:36:mcreate.0 00010000:00010000:1.0:1788572408.120785:0:6551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572408.120824:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61e524e00/0xdb7edb52b8339cc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b245 expref: 10 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.120847:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e63c570c00) 00010000:00010000:1.0:1788572408.120862:0:6551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788572408.120965:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b833a00d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.120985:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b833a00d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.120997:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b833a00d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121038:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121046:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121054:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121583:0:6551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b833a00d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121593:0:6551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b833a00d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121601:0:6551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b833a00d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121608:0:6551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588800 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572408.121613:0:6551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b833a00d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121622:0:6551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b833a00d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121633:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e6d1800) 00010000:00010000:1.0:1788572408.121649:0:6551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572408.121655:0:6551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b833a00d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121661:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641588800/0xdb7edb52b833a00d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572408.121679:0:6551:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007e42ef7 reply state 00000000fe455377 transno 219043334909 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121691:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572408.121698:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e61e6d1c00) 00010000:00010000:1.0:1788572408.121701:0:6551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572408.121704:0:6551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788572408.121817:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+11:89904:x1875449616254080:12345-192.168.202.13@tcp:36:mcreate.0 Request processed in 1112us (1425us total) trans 219043334909 rc 0/0 00000100:00100000:1.0:1788572408.121825:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15485 00000100:00100000:0.0:1788572408.163588:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572408.163677:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616254208 00000100:00100000:2.0:1788572408.163691:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616254208 00000100:00100000:2.0:1788572408.163801:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15486 00000100:00100000:2.0:1788572408.163816:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e503931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+11:89907:x1875449616254208:12345-192.168.202.13@tcp:101:rm.0 00010000:00010000:2.0:1788572408.163847:0:9276:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572408.163878:0:9276:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b400/0xdb7edb52b833a01b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4b253 expref: -99 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.163984:0:9276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b833a022 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.164036:0:9276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b833a022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.164051:0:9276:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b833a022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572408.164116:0:9276:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1788572408.164120:0:9276:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572408.164153:0:9276:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b833a022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9276 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.164186:0:9276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b400/0xdb7edb52b833a01b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b253 expref: 13 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.164210:0:9276:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b833a022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b253 expref: 12 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.164219:0:9276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641540500) 00010000:00010000:2.0:1788572408.164222:0:9276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572408.164227:0:9276:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1ba00, rc 0) 00000100:00100000:2.0:1788572408.164302:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e503931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+12:89907:x1875449616254208:12345-192.168.202.13@tcp:101:rm.0 Request processed in 489us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572408.164310:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15486 00000100:00100000:0.0:1788572408.172383:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572408.174990:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616254336 00000100:00100000:2.0:1788572408.175028:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616254336 00000100:00100000:2.0:1788572408.175130:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15487 00000100:00100000:2.0:1788572408.175143:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+12:89907:x1875449616254336:12345-192.168.202.13@tcp:101:rm.0 00010000:00010000:2.0:1788572408.175170:0:95742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572408.175204:0:95742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1be00/0xdb7edb52b833a029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4b25a expref: -99 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175296:0:95742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b833a030 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175320:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b833a030 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175335:0:95742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b833a030 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175348:0:95742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a600/0xdb7edb52b833a037 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175356:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a600/0xdb7edb52b833a037 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175362:0:95742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a600/0xdb7edb52b833a037 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175492:0:95742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b833a03e lrc: 3/1,0 mode: --/PR res: [0x2000182d1:0x966:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175501:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b833a03e lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x966:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175508:0:95742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b833a03e lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x966:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572408.175561:0:95742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000182d1:0x966:0x0]: returning size 0 00000004:00200000:2.0:1788572408.175565:0:95742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572408.175586:0:95742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b833a03e lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x966:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175600:0:95742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b833a03e lrc: 3/1,0 mode: PR/PR res: [0x2000182d1:0x966:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175613:0:95742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b833a030 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175620:0:95742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b833a030 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175628:0:95742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b833a030 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175634:0:95742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1ac00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572408.175651:0:95742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b833a030 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175660:0:95742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b833a030 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175674:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641540500) 00010000:00010000:2.0:1788572408.175678:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572408.175685:0:95742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b833a030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175692:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ac00/0xdb7edb52b833a030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175713:0:95742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a600/0xdb7edb52b833a037 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175719:0:95742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a600/0xdb7edb52b833a037 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175724:0:95742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a600/0xdb7edb52b833a037 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175730:0:95742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ad1a600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:2.0:1788572408.175733:0:95742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a600/0xdb7edb52b833a037 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175739:0:95742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a600/0xdb7edb52b833a037 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175745:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e61e6d1c00) 00010000:00010000:2.0:1788572408.175748:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788572408.175750:0:95742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a600/0xdb7edb52b833a037 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175756:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1a600/0xdb7edb52b833a037 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 95742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175788:0:95742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1be00/0xdb7edb52b833a029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b25a expref: 14 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175802:0:95742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b833a03e lrc: 3/0,0 mode: PR/PR res: [0x2000182d1:0x966:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b25a expref: 13 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572408.175809:0:95742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x966:0x0].0x0 (ffff94e641540c00) 00010000:00010000:2.0:1788572408.175811:0:95742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788572408.175813:0:95742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1b600, rc 0) 00000100:00100000:2.0:1788572408.175908:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+13:89907:x1875449616254336:12345-192.168.202.13@tcp:101:rm.0 Request processed in 768us (3539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572408.175916:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15487 00000100:00100000:3.0:1788572408.197675:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572408.197724:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616254592 00000100:00100000:3.0:1788572408.197737:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616254592 00000100:00100000:3.0:1788572408.197804:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15488 00000100:00100000:3.0:1788572408.197816:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+13:89907:x1875449616254592:12345-192.168.202.13@tcp:36:rm.0 00010000:00010000:3.0:1788572408.197899:0:6551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788572408.199193:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1b600/0xdb7edb52b833a03e lrc: 0/0,0 mode: --/PR res: [0x2000182d1:0x966:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b25a expref: 13 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199228:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x966:0x0].0x0 (ffff94e641540c00) 00010000:00010000:3.0:1788572408.199253:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ba00/0xdb7edb52b833a022 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b253 expref: 12 pid: 9276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199263:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e641540500) 00010000:00010000:3.0:1788572408.199270:0:6551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788572408.199306:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b833a045 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199321:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b833a045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199332:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b833a045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199344:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199352:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199363:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199497:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b833a053 lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199506:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b833a053 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199514:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b833a053 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199805:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b833a05a lrc: 3/0,1 mode: --/PW res: [0x2000182d1:0x966:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199815:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b833a05a lrc: 3/0,1 mode: PW/PW res: [0x2000182d1:0x966:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199823:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b833a05a lrc: 3/0,1 mode: PW/PW res: [0x2000182d1:0x966:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199832:0:6551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b833a05a lrc: 4/0,1 mode: PW/PW res: [0x2000182d1:0x966:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199840:0:6551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b833a05a lrc: 4/0,1 mode: PW/PW res: [0x2000182d1:0x966:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199848:0:6551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b833a05a lrc: 3/0,0 mode: PW/PW res: [0x2000182d1:0x966:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.199880:0:6551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572408.199910:0:6551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b833a053 lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201337:0:6551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b833a053 lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201348:0:6551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b833a053 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201355:0:6551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572408.201361:0:6551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b833a053 lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201371:0:6551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b833a053 lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201390:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x966:0x0].0x0 (ffff94e620235400) 00010000:00010000:3.0:1788572408.201393:0:6551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788572408.201399:0:6551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b833a053 lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201406:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9200/0xdb7edb52b833a053 lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201434:0:6551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b833a045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201440:0:6551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b833a045 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201447:0:6551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b833a045 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201452:0:6551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572408.201456:0:6551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b833a045 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201462:0:6551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b833a045 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201469:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e620235c00) 00010000:00010000:3.0:1788572408.201472:0:6551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572408.201475:0:6551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b833a045 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201480:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8200/0xdb7edb52b833a045 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788572408.201502:0:6551:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090d6404e reply state 0000000099490f8f transno 219043334910 ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201516:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201524:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e61e6d1c00) 00010000:00010000:3.0:1788572408.201527:0:6551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788572408.201530:0:6551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788572408.201712:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+13:89907:x1875449616254592:12345-192.168.202.13@tcp:36:rm.0 Request processed in 3892us (4048us total) trans 219043334910 rc 0/0 00000100:00100000:3.0:1788572408.201723:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15488 00010000:00010000:3.0:1788572408.201767:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572408.201774:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b833a05a lrc: 2/0,0 mode: PW/PW res: [0x2000182d1:0x966:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201781:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572408.201785:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b833a05a lrc: 2/0,0 mode: PW/PW res: [0x2000182d1:0x966:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201793:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b833a05a lrc: 3/0,0 mode: PW/PW res: [0x2000182d1:0x966:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201803:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x966:0x0].0x0 (ffff94e620235400) 00010000:00010000:3.0:1788572408.201806:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788572408.201809:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b833a05a lrc: 1/0,0 mode: --/PW res: [0x2000182d1:0x966:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201815:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f8600/0xdb7edb52b833a05a lrc: 0/0,0 mode: --/PW res: [0x2000182d1:0x966:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572408.201828:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572408.201830:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572408.201831:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572408.323331:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572408.323366:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639187840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572408.323455:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572408.323552:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639187840 00000100:00100000:1.0:1788572408.323562:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639187840 00000100:00100000:1.0:1788572408.323635:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:1.0:1788572408.323680:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639187840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572408.323713:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00080000:2.0:1788572408.323754:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572408.323762:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639187840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572408.323769:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000100:00100000:1.0:1788572408.323797:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639187968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572408.323824:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572408.323888:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639187840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572408.323955:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639187968 00000100:00100000:2.0:1788572408.323960:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639187968 00000100:00100000:2.0:1788572408.324028:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:2.0:1788572408.324037:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639187968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572408.324049:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572408.324087:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639187968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572408.324094:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000100:00100000:3.0:1788572408.324298:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572408.324310:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d2f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639188096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572408.324349:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572408.324505:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572408.324524:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884902112 gen 2 00000004:00080000:1.0:1788572408.324530:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6414a5f80, transno 12884902056 00000004:00080000:1.0:1788572408.324548:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6414a6300, transno 12884902057 00000004:00080000:1.0:1788572408.324551:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6414a6d80, transno 12884902058 00000004:00080000:1.0:1788572408.324555:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6414a7800, transno 12884902059 00000004:00080000:1.0:1788572408.324557:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6414a4380, transno 12884902060 00000004:00080000:1.0:1788572408.324560:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6414a4000, transno 12884902061 00000004:00080000:1.0:1788572408.324562:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6414a5c00, transno 12884902062 00000004:00080000:1.0:1788572408.324565:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6414a7480, transno 12884902063 00000004:00080000:1.0:1788572408.324568:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad52a00, transno 12884902064 00000004:00080000:1.0:1788572408.324572:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c2a00, transno 12884902065 00000004:00080000:1.0:1788572408.324575:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e634ad6d80, transno 12884902066 00000004:00080000:1.0:1788572408.324577:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c1880, transno 12884902067 00000004:00080000:1.0:1788572408.324580:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad52680, transno 12884902068 00000004:00080000:1.0:1788572408.324583:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c2d80, transno 12884902069 00000004:00080000:1.0:1788572408.324586:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f5880, transno 12884902070 00000004:00080000:1.0:1788572408.324589:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f4700, transno 12884902071 00000004:00080000:1.0:1788572408.324592:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f7b80, transno 12884902072 00000004:00080000:1.0:1788572408.324595:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f5180, transno 12884902073 00000004:00080000:1.0:1788572408.324598:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f4e00, transno 12884902074 00000004:00080000:1.0:1788572408.324601:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f6a00, transno 12884902075 00000004:00080000:1.0:1788572408.324604:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f5500, transno 12884902076 00000004:00080000:1.0:1788572408.324607:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6414a6a00, transno 12884902077 00000004:00080000:1.0:1788572408.324610:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f6680, transno 12884902078 00000004:00080000:1.0:1788572408.324613:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e61e6f4a80, transno 12884902079 00000004:00080000:1.0:1788572408.324616:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c3480, transno 12884902080 00000004:00080000:1.0:1788572408.324619:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641107b80, transno 12884902081 00000004:00080000:1.0:1788572408.324621:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63ad51880, transno 12884902082 00000004:00080000:1.0:1788572408.324624:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641106300, transno 12884902083 00000004:00080000:1.0:1788572408.324627:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641104a80, transno 12884902084 00000004:00080000:1.0:1788572408.324629:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641106a00, transno 12884902085 00000004:00080000:1.0:1788572408.324632:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e641105180, transno 12884902086 00000004:00080000:1.0:1788572408.324636:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2e680, transno 12884902087 00000004:00080000:1.0:1788572408.324639:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637717100, transno 12884902088 00000004:00080000:1.0:1788572408.324653:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2df80, transno 12884902089 00000004:00080000:1.0:1788572408.324657:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349fb100, transno 12884902090 00000004:00080000:1.0:1788572408.324660:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2ed80, transno 12884902091 00000004:00080000:1.0:1788572408.324663:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f8000, transno 12884902092 00000004:00080000:1.0:1788572408.324665:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d500, transno 12884902093 00000004:00080000:1.0:1788572408.324668:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e633e2d880, transno 12884902094 00000004:00080000:1.0:1788572408.324672:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798000, transno 12884902095 00000004:00080000:1.0:1788572408.324674:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349f9880, transno 12884902096 00000004:00080000:1.0:1788572408.324678:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6349faa00, transno 12884902097 00000004:00080000:1.0:1788572408.324681:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637798a80, transno 12884902098 00000100:00100000:2.0:1788572408.324682:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639188096 00000004:00080000:1.0:1788572408.324684:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289c00, transno 12884902099 00000004:00080000:1.0:1788572408.324687:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d4b1500, transno 12884902100 00000100:00100000:2.0:1788572408.324688:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639188096 00000004:00080000:1.0:1788572408.324690:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63779b100, transno 12884902101 00000004:00080000:1.0:1788572408.324692:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289500, transno 12884902102 00000004:00080000:1.0:1788572408.324695:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d4b0380, transno 12884902103 00000004:00080000:1.0:1788572408.324698:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6377c0000, transno 12884902104 00000004:00080000:1.0:1788572408.324700:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288a80, transno 12884902105 00000004:00080000:1.0:1788572408.324703:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28a300, transno 12884902106 00000004:00080000:1.0:1788572408.324706:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28b100, transno 12884902107 00000004:00080000:1.0:1788572408.324709:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288000, transno 12884902108 00000004:00080000:1.0:1788572408.324713:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d289180, transno 12884902109 00000004:00080000:1.0:1788572408.324716:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d288380, transno 12884902110 00000004:00080000:1.0:1788572408.324718:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e62d28bb80, transno 12884902111 00000100:00100000:2.0:1788572408.324719:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000004:00080000:1.0:1788572408.324721:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e637714000, transno 12884902112 00000100:00100000:2.0:1788572408.324725:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639188096:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572408.324730:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639187968:0@lo:13:osp-pre-0-0.0 00000004:00000024:2.0:1788572408.324748:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572408.324799:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639188096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572408.324806:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:1.0:1788572408.325111:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d2f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639188096:0@lo:41:osp-pre-1-0.0 00000004:00080000:3.0:1788572408.325683:0:111998:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 57 done 00010000:00010000:3.0:1788572408.521617:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572408.753721:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572408.759686:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616254720 00000100:00100000:3.0:1788572408.759712:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616254720 00000100:00100000:3.0:1788572408.759815:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 173 00000100:00100000:3.0:1788572408.759828:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616254720:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572408.761279:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616254720:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 1441us (7561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572408.761293:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 173 00000100:00100000:0.0:1788572408.837190:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572408.837220:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639188224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572408.837316:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572408.837403:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639188224 00000100:00100000:0.0:1788572408.837413:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639188224 00000100:00100000:0.0:1788572408.837500:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:0.0:1788572408.837511:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639188224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572408.837538:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572408.837606:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639188224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572408.837614:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00100000:0.0:1788572408.837677:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639188224:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788572408.838092:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788572409.549236:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572410.371248:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639188352:0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.371368:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572410.371505:0:111991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639188352 00000100:00100000:3.0:1788572410.371517:0:111991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639188352 00000100:00100000:3.0:1788572410.371585:0:111991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788572410.371596:0:111991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639188352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572410.374027:0:111991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639188352:12345-0@lo:400:kworker.0 Request processed in 2406us (2633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572410.374047:0:111991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788572410.377456:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639188480:0@lo:400:kworker.0 00000100:00100000:1.0:1788572410.377566:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572410.378073:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639188480 00000100:00100000:3.0:1788572410.378085:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639188480 00000100:00100000:3.0:1788572410.378185:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:3.0:1788572410.378198:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639188480:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572410.378546:0:42013:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e62d28ce00 x1875449639188480/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788572421 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572410.378630:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639188480:12345-0@lo:400:kworker.0 Request processed in 435us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572410.378639:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00100000:2.0:1788572410.378775:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639188352:0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.380513:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572410.380542:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639188608:0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.380626:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572410.380759:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639188608 00000100:00100000:3.0:1788572410.380770:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639188608 00000100:00100000:3.0:1788572410.380840:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4662 00000100:00100000:3.0:1788572410.380852:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639188608:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572410.380882:0:6552:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e63ad5e680 x1875449639188608/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788572421 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572410.381027:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639188608:12345-0@lo:400:kworker.0 Request processed in 177us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572410.381035:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4662 00000100:00100000:2.0:1788572410.381403:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639188736:0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.381443:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572410.381489:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639188608:0@lo:400:kworker.0 00000100:00100000:3.0:1788572410.381777:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639188736 00000100:00100000:3.0:1788572410.381783:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639188736 00000100:00100000:3.0:1788572410.381841:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:3.0:1788572410.381850:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639188736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572410.381900:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639188736:12345-0@lo:400:kworker.0 Request processed in 53us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572410.381907:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00080000:0.0:1788572410.382055:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572410.382126:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639189120:0@lo:400:kworker.0 00000100:00100000:3.0:1788572410.383074:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639188992:0@lo:400:kworker.0 00000100:00100000:3.0:1788572410.383127:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572410.383399:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572410.383478:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572410.383485:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639189248:0@lo:400:kworker.0 00000100:00100000:0.0:1788572410.383517:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572410.383569:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639189632:0@lo:400:kworker.0 00000100:00100000:0.0:1788572410.383590:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572410.383621:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639188992 00000100:00100000:0.0:1788572410.383629:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639188992 00000100:00100000:0.0:1788572410.383679:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639189632 00000100:00100000:0.0:1788572410.383694:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639189632 00000100:00100000:0.0:1788572410.383722:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4663 00000100:00100000:0.0:1788572410.383730:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639188992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572410.383782:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639188992:12345-0@lo:400:kworker.0 Request processed in 52us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572410.383789:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4663 00000100:00100000:0.0:1788572410.383805:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4664 00000100:00100000:0.0:1788572410.383811:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639189632:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572410.383824:0:6550:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e62d288380 x1875449639189632/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788572421 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572410.383851:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639189632:12345-0@lo:400:kworker.0 Request processed in 41us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572410.383857:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4664 00000100:00080000:0.0:1788572410.383872:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572410.383904:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639189632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572410.384034:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639188480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572410.384056:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639189504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572410.384086:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572410.384113:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639188992:0@lo:400:kworker.0 00000100:00100000:3.0:1788572410.384124:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788572410.384131:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639188864:0@lo:400:kworker.0 00000100:00100000:3.0:1788572410.384155:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572410.385056:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639189376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572410.385101:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572410.385146:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639188864 00000100:00100000:3.0:1788572410.385152:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639188864 00000100:00100000:3.0:1788572410.385228:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4665 00000100:00100000:3.0:1788572410.385421:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639188864:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788572410.385446:0:6552:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e61e762a00 x1875449639188864/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788572421 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572410.385490:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639188864:12345-0@lo:400:kworker.0 Request processed in 76us (1334us total) trans 0 rc 0/0 00000100:00080000:0.0:1788572410.385558:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572410.385573:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572410.385588:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639189760:0@lo:400:kworker.0 00000100:00100000:0.0:1788572410.385621:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572410.385649:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639189760 00000100:00100000:0.0:1788572410.385654:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639189760 00000100:00100000:2.0:1788572410.387271:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639189120 00000100:00100000:2.0:1788572410.387286:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639189120 00000100:00100000:3.0:1788572410.387528:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4665 00000100:00100000:3.0:1788572410.387759:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639188864:0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.390420:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639189504 00000100:00100000:2.0:1788572410.390438:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639189504 00000100:00100000:2.0:1788572410.390476:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639189376 00000100:00100000:2.0:1788572410.390479:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639189376 00000100:00100000:2.0:1788572410.390511:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1788572410.390522:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639189120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.390657:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639189120:12345-0@lo:400:kworker.0 Request processed in 138us (7258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572410.390666:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1788572410.390695:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:2.0:1788572410.390702:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639189504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.390743:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639189504:12345-0@lo:400:kworker.0 Request processed in 42us (6656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572410.390750:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00100000:2.0:1788572410.390760:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:2.0:1788572410.390766:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639189376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.390799:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639189376:12345-0@lo:400:kworker.0 Request processed in 34us (5698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572410.390805:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00100000:2.0:1788572410.390836:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639189248 00000100:00100000:2.0:1788572410.390840:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639189248 00000100:00100000:2.0:1788572410.390872:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800 00000100:00100000:2.0:1788572410.390879:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639189248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.390915:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639189248:12345-0@lo:400:kworker.0 Request processed in 37us (7397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572410.390920:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800 00000100:00100000:2.0:1788572410.390999:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639189376:0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.391037:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639189504:0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.391096:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639188736:0@lo:400:kworker.0 00000100:00080000:2.0:1788572410.392074:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572410.392083:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572410.392086:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572410.392156:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639189888:0@lo:400:kworker.0 00000100:00100000:2.0:1788572410.392430:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572410.393480:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639189248:0@lo:400:kworker.0 00000100:00100000:1.0:1788572410.393504:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639189120:0@lo:400:kworker.0 00000100:00100000:0.0:1788572410.393650:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639189888 00000100:00100000:0.0:1788572410.393659:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639189888 00000100:00100000:0.0:1788572410.393743:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4666 00000100:00100000:0.0:1788572410.393755:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639189760:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572410.393795:0:6550:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e62d28bb80 x1875449639189760/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:71/0 lens 224/224 e 0 to 0 dl 1788572421 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572410.393873:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639189760:12345-0@lo:400:kworker.0 Request processed in 120us (8249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572410.393881:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4666 00000100:00100000:0.0:1788572410.393904:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4667 00000100:00100000:0.0:1788572410.393912:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639189888:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788572410.395056:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572410.395441:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639189888:0@lo:400:kworker.0 00000100:00100000:0.0:1788572410.395523:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639189888:12345-0@lo:400:kworker.0 Request processed in 1610us (3093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572410.395535:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4667 00000100:00100000:0.0:1788572410.395599:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639189760:0@lo:400:kworker.0 00010000:00010000:1.0:1788572410.565420:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572411.590460:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572411.907417:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572411.908053:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639190016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572411.908153:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572411.908242:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639190016 00000100:00100000:3.0:1788572411.908251:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639190016 00000100:00100000:3.0:1788572411.908306:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:3.0:1788572411.908314:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639190016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572411.908362:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445904384 avail 1299664896 00010000:00000080:3.0:1788572411.908380:0:42013:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e62d28fb80 x1875449639190016/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:72/0 lens 224/368 e 0 to 0 dl 1788572422 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572411.908427:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639190016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572411.908432:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00100000:1.0:1788572411.908660:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639190016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572412.422236:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572412.422269:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639190144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572412.422364:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572412.422579:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639190144 00000100:00100000:0.0:1788572412.422590:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639190144 00000100:00100000:0.0:1788572412.422672:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:0.0:1788572412.422684:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639190144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572412.422735:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572412.422796:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639190144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572412.422803:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00080000:2.0:1788572412.423177:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572412.423241:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639190144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572412.612193:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572413.446174:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639190272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572413.446278:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572413.446380:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639190400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572413.446408:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572413.446445:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639190272 00000100:00100000:1.0:1788572413.446456:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639190272 00000100:00100000:1.0:1788572413.446517:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639190400 00000100:00100000:1.0:1788572413.446521:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639190400 00000100:00100000:1.0:1788572413.446549:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:1.0:1788572413.446559:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639190272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572413.446597:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572413.446646:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639190272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572413.446654:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:1.0:1788572413.446673:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:1.0:1788572413.446679:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639190400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572413.446690:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572413.446715:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639190400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572413.446721:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00080000:1.0:1788572413.446740:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572413.446804:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639190272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572413.446836:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639190400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572413.447037:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572413.447047:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639190528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572413.447084:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572413.447116:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639190528 00000100:00100000:0.0:1788572413.447120:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639190528 00000100:00100000:0.0:1788572413.447154:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802 00000100:00100000:0.0:1788572413.447161:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639190528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572413.447190:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572413.447225:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639190528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572413.447232:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802 00000100:00100000:0.0:1788572413.447264:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639190528:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788572413.635258:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572413.862407:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572413.862454:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572413.862489:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572413.862575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572413.862606:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572413.862665:0:111985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616254848 00000100:00100000:3.0:1788572413.862680:0:111985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616254848 00000100:00100000:3.0:1788572413.862765:0:111985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 175 00000100:00100000:3.0:1788572413.862778:0:111985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616254848:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572413.862872:0:111985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616254848:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 96us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572413.862881:0:111985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 175 00000100:00100000:0.0:1788572413.864098:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616255104 00000100:00100000:0.0:1788572413.864115:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616255104 00000100:00100000:0.0:1788572413.864206:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616254976 00000100:00100000:0.0:1788572413.864210:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616254976 00000100:00100000:0.0:1788572413.864246:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4668 00000100:00100000:0.0:1788572413.864258:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616255104:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572413.864347:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616255104:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 92us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572413.864354:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4668 00000100:00100000:0.0:1788572413.864385:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4669 00000100:00100000:0.0:1788572413.864393:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+13:2383:x1875449616254976:12345-192.168.202.13@tcp:400:kworker.0 00010000:00000080:0.0:1788572413.864414:0:9276:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e63ad5fb80 x1875449616254976/t0(0) o400->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:74/0 lens 224/224 e 0 to 0 dl 1788572424 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572413.864440:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+13:2383:x1875449616254976:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 49us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572413.864445:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4669 00000100:00080000:3.0:1788572413.865715:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572413.865726:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572413.867497:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616255360 00000100:00100000:1.0:1788572413.867519:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616255360 00000100:00100000:1.0:1788572413.867631:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616255232 00000100:00100000:1.0:1788572413.867635:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616255232 00000100:00100000:0.0:1788572413.867747:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3765 00000100:00100000:0.0:1788572413.867772:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616255360:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572413.867882:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616255360:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 114us (5391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572413.867890:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3765 00000100:00100000:1.0:1788572413.867984:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3766 00000100:00100000:1.0:1788572413.867993:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616255232:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572413.868054:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616255232:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 63us (5447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572413.868060:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3766 00000100:00080000:2.0:1788572413.869687:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572413.869701:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572413.956561:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572413.956594:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639190656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572413.956702:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572413.956946:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639190656 00000100:00100000:0.0:1788572413.956957:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639190656 00000100:00100000:0.0:1788572413.957076:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00100000:0.0:1788572413.957088:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639190656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572413.957120:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572413.957192:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639190656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572413.957201:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00000100:00100000:3.0:1788572413.957618:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639190656:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572413.957675:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788572413.965066:0:114775:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000001:00100000:1.0:1788572413.965763:0:9546:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00010000:00010000:0.0:1788572414.665347:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788572414.782509:0:111978:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 219043334910 is committed 00010000:00010000:3.0:1788572414.782574:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782587:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782595:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782601:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572414.782606:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782614:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782631:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e61e6d1c00) 00010000:00010000:3.0:1788572414.782634:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572414.782638:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782644:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a014 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782663:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782669:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782675:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782680:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9c00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572414.782683:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782700:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782710:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e61e6d1c00) 00010000:00010000:3.0:1788572414.782712:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572414.782715:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572414.782719:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e61a3f9c00/0xdb7edb52b833a04c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572415.494286:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639190784:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.494369:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572415.494420:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639191296:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.494446:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572415.494465:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639191808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.494487:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572415.494503:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639192320:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.494523:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572415.494547:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572415.494553:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639191168:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.494574:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572415.494589:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639191680:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.494615:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572415.494634:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639192192:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.494658:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572415.494695:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639190912:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.494718:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572415.494738:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639191424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.494760:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572415.494775:0:111983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639190784 00000100:00100000:0.0:1788572415.494794:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639191936:0@lo:400:kworker.0 00000100:00100000:3.0:1788572415.494805:0:111983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639190784 00000100:00100000:0.0:1788572415.494828:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572415.494855:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572415.494863:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639191040:0@lo:400:kworker.0 00000100:00100000:3.0:1788572415.494889:0:111983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788572415.494904:0:111983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639190784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.494910:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572415.494937:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639191552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.494995:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572415.495046:0:111983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639190784:12345-0@lo:400:kworker.0 Request processed in 143us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572415.495054:0:111983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788572415.495058:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639192064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.495091:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572415.495130:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639191296 00000100:00100000:0.0:1788572415.495138:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639191296 00000100:00100000:0.0:1788572415.495188:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639192320 00000100:00100000:0.0:1788572415.495191:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639192320 00000100:00100000:0.0:1788572415.495202:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639192192 00000100:00100000:0.0:1788572415.495205:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639192192 00000100:00100000:0.0:1788572415.495216:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639191424 00000100:00100000:0.0:1788572415.495218:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639191424 00000100:00100000:0.0:1788572415.495230:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4670 00000100:00100000:0.0:1788572415.495238:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639191296:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572415.495263:0:6551:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e633db0000 x1875449639191296/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:76/0 lens 224/224 e 0 to 0 dl 1788572426 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572415.495301:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639191296:12345-0@lo:400:kworker.0 Request processed in 63us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.495308:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4670 00000100:00100000:0.0:1788572415.495321:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639191040 00000100:00100000:0.0:1788572415.495324:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639191040 00000100:00100000:0.0:1788572415.495336:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639192064 00000100:00100000:0.0:1788572415.495338:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639192064 00000100:00100000:0.0:1788572415.495351:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4671 00000100:00100000:0.0:1788572415.495356:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639192320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.495384:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639192320:12345-0@lo:400:kworker.0 Request processed in 27us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.495390:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4671 00000100:00100000:0.0:1788572415.495400:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4672 00000100:00100000:0.0:1788572415.495406:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639192192:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572415.495416:0:6551:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e633db2300 x1875449639192192/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:76/0 lens 224/224 e 0 to 0 dl 1788572426 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572415.495441:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639192192:12345-0@lo:400:kworker.0 Request processed in 35us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.495446:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4672 00000100:00100000:0.0:1788572415.495457:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4673 00000100:00100000:0.0:1788572415.495462:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639191424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.495491:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639191424:12345-0@lo:400:kworker.0 Request processed in 29us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.495500:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4673 00000100:00100000:0.0:1788572415.495511:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4674 00000100:00100000:0.0:1788572415.495517:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639191040:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572415.495528:0:6551:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e60fc8ea00 x1875449639191040/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:76/0 lens 224/224 e 0 to 0 dl 1788572426 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572415.495552:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639191040:12345-0@lo:400:kworker.0 Request processed in 36us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.495557:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4674 00000100:00100000:0.0:1788572415.495567:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4675 00000100:00100000:0.0:1788572415.495573:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639192064:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572415.495582:0:6551:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e5033f1f80 x1875449639192064/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:76/0 lens 224/224 e 0 to 0 dl 1788572426 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572415.495622:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639192064:12345-0@lo:400:kworker.0 Request processed in 49us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.495628:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4675 00000100:00100000:0.0:1788572415.495659:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639191808 00000100:00100000:0.0:1788572415.495663:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639191808 00000100:00100000:0.0:1788572415.495688:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639191168 00000100:00100000:0.0:1788572415.495690:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639191168 00000100:00100000:0.0:1788572415.495707:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639191936 00000100:00100000:0.0:1788572415.495710:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639191936 00000100:00100000:0.0:1788572415.495725:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639191552 00000100:00100000:0.0:1788572415.495727:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639191552 00000100:00100000:0.0:1788572415.495743:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:0.0:1788572415.495750:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639191808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.495779:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639191808:12345-0@lo:400:kworker.0 Request processed in 29us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.495798:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00100000:0.0:1788572415.495810:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:0.0:1788572415.495816:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639191168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.495842:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639191168:12345-0@lo:400:kworker.0 Request processed in 27us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.495847:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00100000:0.0:1788572415.495858:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:0.0:1788572415.495863:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639191936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.495892:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639191936:12345-0@lo:400:kworker.0 Request processed in 28us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.495898:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:0.0:1788572415.495908:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:0.0:1788572415.495914:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639191552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.495941:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639191552:12345-0@lo:400:kworker.0 Request processed in 27us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.495948:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00100000:0.0:1788572415.495969:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639191680 00000100:00100000:0.0:1788572415.495972:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639191680 00000100:00100000:0.0:1788572415.495998:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639190912 00000100:00100000:0.0:1788572415.496001:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639190912 00000100:00100000:0.0:1788572415.496040:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:0.0:1788572415.496046:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639191680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496080:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639191680:12345-0@lo:400:kworker.0 Request processed in 35us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.496086:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:0.0:1788572415.496098:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804 00000100:00100000:0.0:1788572415.496104:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639190912:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788572415.496115:0:42013:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e633db1180 x1875449639190912/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:76/0 lens 224/224 e 0 to 0 dl 1788572426 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572415.496139:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639190912:12345-0@lo:400:kworker.0 Request processed in 36us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572415.496144:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804 00000100:00080000:0.0:1788572415.496190:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572415.496194:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572415.496198:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572415.496200:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572415.496263:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639191040:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496278:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639191552:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496294:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639192064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496307:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639190912:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496346:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639191424:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496364:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639191936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496509:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639191168:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496521:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639191680:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496531:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639192192:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496540:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639190784:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496550:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639191296:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496560:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639191808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572415.496571:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639192320:0@lo:400:kworker.0 00010000:00010000:1.0:1788572415.688159:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788572416.062721:0:116047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:2.0:1788572416.707539:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572417.028326:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572417.028358:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639192448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572417.028477:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572417.028677:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639192448 00000100:00100000:2.0:1788572417.028690:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639192448 00000100:00100000:2.0:1788572417.028761:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:2.0:1788572417.028773:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639192448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572417.028829:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445904384 avail 1299664896 00010000:00000080:2.0:1788572417.028854:0:42013:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e6377c3480 x1875449639192448/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:78/0 lens 224/368 e 0 to 0 dl 1788572428 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788572417.028905:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639192448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572417.028913:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00100000:1.0:1788572417.029125:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639192448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572417.540553:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572417.540587:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639192576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572417.540685:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572417.544137:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639192576 00000100:00100000:0.0:1788572417.544160:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639192576 00000100:00100000:0.0:1788572417.544289:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:0.0:1788572417.544307:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639192576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572417.544354:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572417.544462:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639192576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (3776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572417.544470:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00000100:00080000:3.0:1788572417.545375:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572417.545458:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639192576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788572417.744480:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572418.570176:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572418.570200:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639192704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572418.570265:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572418.570323:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639192704 00000100:00100000:2.0:1788572418.570329:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639192704 00000100:00100000:2.0:1788572418.570384:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:2.0:1788572418.570395:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639192704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572418.570423:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572418.570591:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639192704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572418.570599:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00080000:2.0:1788572418.570619:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572418.570655:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639192704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572418.570865:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639192832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572418.570907:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572418.571059:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639192832 00000100:00100000:1.0:1788572418.571064:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639192832 00000100:00100000:1.0:1788572418.571112:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924 00000100:00100000:1.0:1788572418.571119:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639192832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572418.571131:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572418.572506:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572418.572526:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639192960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572418.572578:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572418.572623:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639192960 00000100:00100000:2.0:1788572418.572630:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639192960 00000100:00100000:2.0:1788572418.572668:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:2.0:1788572418.572675:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639192960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572418.572703:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572418.572743:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639192960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572418.572749:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00000100:00100000:2.0:1788572418.572789:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639192960:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788572418.572811:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572418.573539:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639192832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2417us (2627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572418.573550:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924 00000100:00100000:2.0:1788572418.578841:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639192832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572418.755672:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572418.975684:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572418.975729:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572418.975767:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572418.975795:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572418.975826:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572418.975887:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616255744 00000100:00100000:0.0:1788572418.975899:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616255744 00000100:00100000:0.0:1788572418.975963:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616255616 00000100:00100000:0.0:1788572418.975966:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616255616 00000100:00100000:0.0:1788572418.975992:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4676 00000100:00100000:0.0:1788572418.976039:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616255744:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572418.976188:0:111989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616255488 00000100:00100000:3.0:1788572418.976192:0:111989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616255488 00000100:00100000:3.0:1788572418.976236:0:111989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 177 00000100:00100000:3.0:1788572418.976244:0:111989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ac90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616255488:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572418.976281:0:111989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ac90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616255488:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 38us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572418.976288:0:111989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 177 00000100:00100000:0.0:1788572418.976421:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616255744:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 419us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572418.976428:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4676 00000100:00100000:0.0:1788572418.976445:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4677 00000100:00100000:0.0:1788572418.976454:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2384:x1875449616255616:12345-192.168.202.13@tcp:400:kworker.0 00010000:00000080:0.0:1788572418.976468:0:6552:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e5032b7100 x1875449616255616/t0(0) o400->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:79/0 lens 224/224 e 0 to 0 dl 1788572429 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572418.976494:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2384:x1875449616255616:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 42us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572418.976500:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4677 00000100:00100000:0.0:1788572418.976518:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616256000 00000100:00100000:0.0:1788572418.976521:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616256000 00000100:00100000:0.0:1788572418.976593:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616255872 00000100:00100000:0.0:1788572418.976597:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616255872 00000100:00080000:1.0:1788572418.976679:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572418.976684:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572418.976687:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572418.976689:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572418.981389:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3771 00000100:00100000:1.0:1788572418.981503:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616256000:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572418.981604:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616256000:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 201us (5835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572418.981627:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3771 00000100:00100000:1.0:1788572418.981654:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3772 00000100:00100000:1.0:1788572418.981661:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616255872:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572418.981690:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616255872:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 30us (5863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572418.981697:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3772 00000100:00100000:2.0:1788572419.076746:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572419.076769:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639193088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572419.076849:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572419.077195:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639193088 00000100:00100000:0.0:1788572419.077204:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639193088 00000100:00100000:0.0:1788572419.077292:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00100000:0.0:1788572419.077305:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639193088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572419.077344:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788572419.077406:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572419.077431:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639193088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572419.077440:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00000100:00100000:2.0:1788572419.077486:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639193088:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1788572419.631912:0:116192:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788572419.631974:0:116192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637697600/0xdb7edb52b831ca57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b831ca5e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.631992:0:116192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637697600/0xdb7edb52b831ca57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b831ca5e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.631998:0:116192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637697600/0xdb7edb52b831ca57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831ca5e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.632032:0:116192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff94e637697600/0xdb7edb52b831ca57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831ca5e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.632059:0:116192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788572419.632065:0:116192:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788572419.632095:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572419.632100:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788572419.632106:0:116192:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788572419.632131:0:116192:0:(import.c:65:import_set_state_nolock()) ffff94e6349bc800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788572419.635330:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572419.635347:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff94e637697600/0xdb7edb52b831ca57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831ca5e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.635368:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637697600 already unused, calling callback (ffffffffc11ccc20) 10000000:00010000:2.0:1788572419.635373:0:6539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff94e637697600/0xdb7edb52b831ca57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831ca5e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.635384:0:6539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e637697600/0xdb7edb52b831ca57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb7edb52b831ca5e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572419.635397:0:6539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e637697600/0xdb7edb52b831ca57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb7edb52b831ca5e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572419.635413:0:6539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788572419.635415:0:6539:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788572419.635419:0:6539:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788572419.635462:0:6539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff94e637697600/0xdb7edb52b831ca57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831ca5e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.635468:0:6539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788572419.635512:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff94e637697600/0xdb7edb52b831ca57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831ca5e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.635519:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e637697600/0xdb7edb52b831ca57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831ca5e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.635536:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572419.635538:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572419.635540:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572419.635559:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875449639193216:0@lo:39:umount.0 00000100:00100000:2.0:1788572419.635940:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572419.636056:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572419.636066:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ad5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639193344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788572419.636100:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572419.636140:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639193344 00000100:00100000:2.0:1788572419.636148:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639193344 00000100:00100000:2.0:1788572419.636205:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788572419.636215:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639193344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788572419.636232:0:43971:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788572419.636250:0:43971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63ae3a200/0xdb7edb52b831ca5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831ca57 expref: 24 pid: 111985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.636264:0:43971:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788572419.636302:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d74e0a07-d05f-49a8-aa32-40b653992526+23:3653:x1875449639193344:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572419.636309:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788572419.636374:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ad5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639193344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572419.640091:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639193216 00000100:00100000:1.0:1788572419.640107:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639193216 00000100:00100000:1.0:1788572419.640175:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15489 00000100:00100000:1.0:1788572419.640186:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875449639193216:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788572419.640216:0:10390:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831cb6f 00000100:00080000:1.0:1788572419.640226:0:10390:0:(import.c:65:import_set_state_nolock()) ffff94e63ae1f000 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1788572419.640256:0:10390:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff94e63ad5c700 x1875449639193216/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:80/0 lens 224/224 e 0 to 0 dl 1788572430 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572419.640463:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3649:x1875449639193216:12345-0@lo:39:umount.0 Request processed in 279us (4523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572419.640474:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15489 00000020:00000080:1.0:1788572419.640486:0:10390:0:(genops.c:885:class_export_put()) final put ffff94e63ae1a000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788572419.640511:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572419.640545:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6349bc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788572419.640558:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875449639193216:0@lo:39:umount.0 00000100:00080000:1.0:1788572419.640588:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788572419.640591:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788572419.640597:0:116192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788572419.641463:0:116192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ade9600/0xdb7edb52b831c977 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b831c97e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641479:0:116192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ade9600/0xdb7edb52b831c977 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b831c97e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641486:0:116192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ade9600/0xdb7edb52b831c977 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831c97e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641493:0:116192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff94e63ade9600/0xdb7edb52b831c977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831c97e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641515:0:116192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572419.641530:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572419.641536:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff94e63ade9600/0xdb7edb52b831c977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831c97e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641543:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade9600 already unused, calling callback (ffffffffc11ccc20) 10000000:00010000:1.0:1788572419.641547:0:92610:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff94e63ade9600/0xdb7edb52b831c977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831c97e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641560:0:92610:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ade9600/0xdb7edb52b831c977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb7edb52b831c97e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572419.641568:0:92610:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ade9600/0xdb7edb52b831c977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb7edb52b831c97e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572419.641573:0:92610:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788572419.641575:0:92610:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788572419.641606:0:92610:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff94e63ade9600/0xdb7edb52b831c977 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831c97e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641613:0:92610:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572419.641636:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff94e63ade9600/0xdb7edb52b831c977 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831c97e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641643:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ade9600/0xdb7edb52b831c977 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831c97e expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641656:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572419.641658:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572419.641660:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572419.641668:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572419.641684:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639193472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572419.641738:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788572419.641795:0:116192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641803:0:116192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641814:0:116192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641821:0:116192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641834:0:116192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788572419.641840:0:116192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63af8cc00/0xdb7edb52b831ca49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b831ca50 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641846:0:116192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63af8cc00/0xdb7edb52b831ca49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b831ca50 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641853:0:116192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63af8cc00/0xdb7edb52b831ca49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831ca50 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641859:0:116192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff94e63af8cc00/0xdb7edb52b831ca49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831ca50 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641885:0:116192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788572419.641893:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788572419.641898:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641904:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e637700e00 already unused, calling callback (ffffffffc11ccc20) 10000000:00010000:1.0:1788572419.641908:0:92609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641915:0:92609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572419.641922:0:92609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572419.641928:0:92609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788572419.641930:0:92609:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788572419.641933:0:92609:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788572419.641948:0:92609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641954:0:92609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572419.641969:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641976:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e637700e00/0xdb7edb52b8334db8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b8334dbf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641987:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572419.641990:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff94e63af8cc00/0xdb7edb52b831ca49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831ca50 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.641996:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63af8cc00 already unused, calling callback (ffffffffc11ccc20) 10000000:00010000:1.0:1788572419.641999:0:92609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff94e63af8cc00/0xdb7edb52b831ca49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831ca50 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642023:0:92609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63af8cc00/0xdb7edb52b831ca49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb7edb52b831ca50 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572419.642030:0:92609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63af8cc00/0xdb7edb52b831ca49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb7edb52b831ca50 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572419.642038:0:92609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788572419.642041:0:92609:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788572419.642043:0:92609:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788572419.642058:0:92609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff94e63af8cc00/0xdb7edb52b831ca49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831ca50 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642064:0:92609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572419.642069:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff94e63af8cc00/0xdb7edb52b831ca49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831ca50 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642075:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63af8cc00/0xdb7edb52b831ca49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831ca50 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642084:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572419.642087:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572419.642089:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572419.642100:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639193600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572419.642131:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572419.642153:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572419.642159:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639193728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572419.642181:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572419.642209:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639193472 00000100:00100000:1.0:1788572419.642216:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639193472 00000100:00100000:1.0:1788572419.642263:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639193600 00000100:00100000:1.0:1788572419.642268:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639193600 00000100:00100000:1.0:1788572419.642284:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639193728 00000100:00100000:1.0:1788572419.642287:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639193728 00000100:00100000:1.0:1788572419.642303:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788572419.642311:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d74e0a07-d05f-49a8-aa32-40b653992526+25:3652:x1875449639193472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572419.642327:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572419.642344:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63ae3ba00/0xdb7edb52b831c97e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831c977 expref: 25 pid: 111985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642358:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572419.642393:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639193472:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572419.642401:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788572419.642420:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788572419.642427:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e640e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d74e0a07-d05f-49a8-aa32-40b653992526+23:3650:x1875449639193600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572419.642436:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572419.642445:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e609744400/0xdb7edb52b8334dbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b8334db8 expref: 23 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642454:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572419.642481:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e640e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d74e0a07-d05f-49a8-aa32-40b653992526+22:3650:x1875449639193600:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572419.642487:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788572419.642529:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788572419.642536:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d74e0a07-d05f-49a8-aa32-40b653992526+21:3650:x1875449639193728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572419.642543:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572419.642551:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63ade8200/0xdb7edb52b831ca50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831ca49 expref: 21 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642560:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572419.642582:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d74e0a07-d05f-49a8-aa32-40b653992526+20:3650:x1875449639193728:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572419.642591:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788572419.642628:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639193472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572419.642655:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639193728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788572419.642662:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639193600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572419.642686:0:116192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ade8c00/0xdb7edb52b831c969 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b831c970 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642696:0:116192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ade8c00/0xdb7edb52b831c969 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b831c970 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642702:0:116192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ade8c00/0xdb7edb52b831c969 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831c970 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642707:0:116192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.113@tcp lock: ffff94e63ade8c00/0xdb7edb52b831c969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb7edb52b831c970 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642722:0:116192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788572419.642725:0:116192:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788572419.642728:0:116192:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788572419.642765:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788572419.642771:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff94e63ade8c00/0xdb7edb52b831c969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831c970 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642777:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ade8c00 already unused, calling callback (ffffffffc11ccc20) 10000000:00010000:1.0:1788572419.642780:0:6539:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff94e63ade8c00/0xdb7edb52b831c969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb7edb52b831c970 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642791:0:6539:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ade8c00/0xdb7edb52b831c969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb7edb52b831c970 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788572419.642797:0:6539:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ade8c00/0xdb7edb52b831c969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb7edb52b831c970 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572419.642803:0:6539:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788572419.642805:0:6539:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788572419.642807:0:6539:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788572419.642823:0:6539:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff94e63ade8c00/0xdb7edb52b831c969 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831c970 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642830:0:6539:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788572419.642843:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff94e63ade8c00/0xdb7edb52b831c969 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831c970 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642849:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ade8c00/0xdb7edb52b831c969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb7edb52b831c970 expref: -99 pid: 111977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642858:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572419.642859:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572419.642861:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572419.642884:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639193856:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788572419.642895:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e63ae1a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1788572419.642909:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572419.642935:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639193856 00000100:00100000:1.0:1788572419.642938:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639193856 00000100:00100000:1.0:1788572419.642960:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000020:00000080:2.0:1788572419.642965:0:84098:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e63ae1f000 for lustre-MDT0000 00000100:00100000:1.0:1788572419.642966:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d74e0a07-d05f-49a8-aa32-40b653992526+20:3652:x1875449639193856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788572419.642973:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788572419.642981:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63af8c600/0xdb7edb52b831c970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831c969 expref: 20 pid: 111985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572419.642989:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788572419.643037:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d74e0a07-d05f-49a8-aa32-40b653992526+19:3652:x1875449639193856:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572419.643044:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000020:01000004:1.0:1788572419.643068:0:116192:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788572419.643072:0:116192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1788572419.643076:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788572419.643081:0:116192:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1788572419.643192:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639193856:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572419.644688:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1788572419.651093:0:116192:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:0.0:1788572419.661582:0:116192:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1788572419.661599:0:116192:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94e506b26800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572419.661607:0:116192:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94e61e72d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572419.661611:0:116192:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94e61e72a800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572419.661614:0:116192:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94e618797000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788572419.661622:0:116192:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94e618794000 35eb2d60-2de0-4b00-9815-d5153edd0057 192.168.202.13@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 219043334910 stale:0 00000020:00080000:0.0:1788572419.661627:0:116192:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff94e501f34d40) has exports, disconnecting them 00000020:00080000:0.0:1788572419.661634:0:116192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94e506b26800), last request at 1788572415 00000020:00000080:0.0:1788572419.661643:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b8334d8e 00000100:00080000:0.0:1788572419.661655:0:116192:0:(import.c:65:import_set_state_nolock()) ffff94e506b25800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572419.661691:0:116192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94e506b26800): rc 0 00000020:00000080:0.0:1788572419.661694:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e506b26800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788572419.661708:0:116192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94e61e72d000), last request at 1788572415 00000020:00000080:0.0:1788572419.661711:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831cb61 00000100:00080000:0.0:1788572419.661716:0:116192:0:(import.c:65:import_set_state_nolock()) ffff94e63ae1c800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572419.661791:0:116192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94e61e72d000): rc 0 00000020:00000080:0.0:1788572419.661794:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e61e72d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788572419.661798:0:116192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94e61e72a800), last request at 1788572213 00000020:00000080:0.0:1788572419.661801:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831cb5a 00000100:00080000:0.0:1788572419.661804:0:116192:0:(import.c:65:import_set_state_nolock()) ffff94e61e72f000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788572419.661839:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e506b26800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1788572419.661848:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572419.661913:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e61e72d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572419.661939:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e506b25800 for lustre-MDT0000 00000020:00000080:2.0:1788572419.661943:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e63ae1c800 for lustre-MDT0000 00000020:00080000:0.0:1788572419.663828:0:116192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94e61e72a800): rc 0 00000020:00000080:0.0:1788572419.663835:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e61e72a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788572419.663910:0:116192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94e618797000), last request at 1788572208 00000020:00000080:0.0:1788572419.663925:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c9cb 00000100:00080000:0.0:1788572419.663943:0:116192:0:(import.c:65:import_set_state_nolock()) ffff94e61e729800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788572419.663982:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788572419.664000:0:116192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94e618797000): rc 0 00000020:00000080:0.0:1788572419.664025:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e618797000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1788572419.664150:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572419.664158:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788572419.665552:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e61e72a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788572419.665620:0:84098:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e61e72f000 for lustre-MDT0000 00000020:00080000:0.0:1788572419.666061:0:116192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.13@tcp (ffff94e618794000), last request at 1788572418 00000020:00000080:0.0:1788572419.666070:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c9c4 00000020:00010000:0.0:1788572419.666083:0:116192:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94e618794000: total 1 00000100:00080000:0.0:1788572419.666087:0:116192:0:(import.c:65:import_set_state_nolock()) ffff94e63aed5800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788572419.666108:0:116192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.13@tcp (ffff94e618794000): rc 0 00000020:00000080:2.0:1788572419.666165:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e618797000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788572419.666196:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e61e729800 for lustre-MDT0000 00000004:00000080:0.0:1788572419.666222:0:116192:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa895c33f3ae0 00000100:00080000:0.0:1788572419.666247:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788572419.666251:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:3.0:1788572419.667125:0:6538:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94e618794000: total 0 00010000:00010000:3.0:1788572419.667200:0:6538:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94e618794000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1788572419.667244:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80200/0xdb7edb52b83267ad lrc: 0/0,0 mode: --/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47082 expref: 4 pid: 10390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572419.667272:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80a00/0xdb7edb52b8326775 lrc: 0/0,0 mode: --/PR res: [0x2000182d1:0x643:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4706d expref: 3 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572419.667289:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ac80000/0xdb7edb52b8326736 lrc: 0/0,0 mode: --/CR res: [0x2000182d1:0x643:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb47058 expref: 2 pid: 95742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572419.667309:0:6538:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94e618794000, canceled 3 locks, left on hash table 0. 00000100:00080000:0.0:1788572419.672049:0:116192:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788572419.672089:0:116192:0:(import.c:65:import_set_state_nolock()) ffff94e6056f2800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788572419.672155:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639193984:0@lo:39:umount.0 00000100:00100000:2.0:1788572419.672228:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572419.672538:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788572419.672544:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884902112 gen 3 00000004:00080000:1.0:1788572419.672563:0:116192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788572419.672621:0:116192:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788572419.672633:0:116192:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788572419.672643:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788572419.672645:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968876 gen 4 00000004:00080000:1.0:1788572419.672653:0:116192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788572419.672715:0:116192:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788572419.672724:0:116192:0:(import.c:65:import_set_state_nolock()) ffff94e63ae1a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788572419.672784:0:116192:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff94e501f34d40) has no exports 00000100:00100000:2.0:1788572419.673171:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639194112:0@lo:9:umount.0 00000100:00100000:2.0:1788572419.673211:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572419.673235:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639194240:0@lo:9:umount.0 00000100:00100000:2.0:1788572419.673256:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572419.673289:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639194112 00000100:00100000:2.0:1788572419.673296:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639194112 00000100:00100000:2.0:1788572419.673337:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639194240 00000100:00100000:2.0:1788572419.673340:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639194240 00000100:00100000:2.0:1788572419.673371:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4440 00000100:00100000:2.0:1788572419.673379:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3649:x1875449639194112:12345-0@lo:9:umount.0 00000020:00080000:1.0:1788572419.673387:0:116192:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff94e501f34d40) has no exports 00000020:00000080:2.0:1788572419.673404:0:43965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b8334d56 00000100:00080000:2.0:1788572419.673411:0:43965:0:(import.c:65:import_set_state_nolock()) ffff94e633fba800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788572419.673462:0:43965:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884902112 00000100:00100000:2.0:1788572419.673681:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3649:x1875449639194112:12345-0@lo:9:umount.0 Request processed in 301us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572419.673688:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4440 00000100:00100000:2.0:1788572419.673702:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4441 00000100:00100000:2.0:1788572419.673708:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3649:x1875449639194240:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788572419.673720:0:43965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831ca34 00000100:00080000:2.0:1788572419.673726:0:43965:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788572419.673746:0:43965:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968876 00000100:00100000:2.0:1788572419.673826:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3649:x1875449639194240:12345-0@lo:9:umount.0 Request processed in 118us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572419.673832:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4441 00000100:00080000:2.0:1788572419.673852:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788572419.673864:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572419.673903:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e640d5d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788572419.673912:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788572419.673914:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572419.673918:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639194112:0@lo:9:umount.0 00000100:00080000:2.0:1788572419.673927:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e63ae1a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788572419.673930:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788572419.673932:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788572419.673934:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639194240:0@lo:9:umount.0 00000100:00100000:0.0:1788572419.675593:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639193984 00000100:00100000:0.0:1788572419.675607:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639193984 00000100:00100000:0.0:1788572419.675672:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:0.0:1788572419.675682:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875449639193984:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788572419.675713:0:42013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831ca0a 00000100:00080000:0.0:1788572419.675721:0:42013:0:(import.c:65:import_set_state_nolock()) ffff94e641362800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788572419.675743:0:42013:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967371 00000100:00100000:0.0:1788572419.675929:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+3:3649:x1875449639193984:12345-0@lo:39:umount.0 Request processed in 248us (3700us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788572419.675936:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807 00010000:00010000:0.0:1788572419.675972:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572419.676039:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6056f2800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788572419.676048:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639193984:0@lo:39:umount.0 00010000:00010000:2.0:1788572419.710634:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788572419.715343:0:6538:0:(genops.c:885:class_export_put()) final put ffff94e618794000/35eb2d60-2de0-4b00-9815-d5153edd0057 00010000:00010000:3.0:1788572419.715404:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572419.715407:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572419.715410:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572419.720733:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e618794000/35eb2d60-2de0-4b00-9815-d5153edd0057 for lustre-MDT0000 00000020:00000080:2.0:1788572419.720839:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e63aed5800 for lustre-MDT0000 00000020:00000080:1.0:1788572419.762650:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c9e0 00000020:00000080:1.0:1788572419.762668:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e618471800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788572419.762693:0:116192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788572419.765087:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572419.765105:0:116192:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788572419.765112:0:116192:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff94e62d258000) has no exports 00000020:00000080:3.0:1788572419.765531:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c9d9 00000020:00000080:3.0:1788572419.765541:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e63acf8000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788572419.765590:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572419.765597:0:116192:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788572419.770146:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e618471800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788572419.770163:0:84098:0:(genops.c:885:class_export_put()) final put ffff94e50382e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788572419.770165:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e50382e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788572419.770173:0:84098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788572419.770320:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e63acf8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788572419.770456:0:116192:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94e505761600 - data ffff94e501a655e8/ffff94e61eb7fc00 00000020:01000000:3.0:1788572419.770602:0:116192:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94e5052cae40 - data ffff94e63380e6c0/ffff94e6377c4c00 00010000:00010000:2.0:1788572419.780457:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572419.839446:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788572419.839456:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788572419.839472:0:116192:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff94e5032b7b80 x1875449639193984/t4294967372(4294967372) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572429 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572419.839496:0:116192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788572419.841797:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788572419.841806:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884902112 gen 4 00000004:00080000:1.0:1788572419.841877:0:116192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572419.841880:0:116192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788572419.855511:0:111998:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788572419.855520:0:111998:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xcc:0x0] index 801 count 1 00000040:00080000:2.0:1788572419.855540:0:111998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 51 count 2 00000100:00080000:1.0:1788572419.856386:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788572419.856392:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968876 gen 5 00000004:00080000:1.0:1788572419.856411:0:116192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572419.856414:0:116192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788572419.859505:0:112000:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788572419.859513:0:112000:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xce:0x0] index 801 count 1 00000040:00080000:2.0:1788572419.859525:0:112000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 51 count 2 00000020:00000080:1.0:1788572419.860647:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c99a 00000020:00000080:1.0:1788572419.860659:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e62d0cc000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788572419.861331:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c9af 00000020:00000080:1.0:1788572419.861337:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e50303b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572419.861342:0:116192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788572419.861348:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572419.861356:0:116192:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788572419.861360:0:116192:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff94e501f33380) has no exports 00000004:01000000:1.0:1788572419.861508:0:116192:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788572419.861517:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831ca2d 00000020:00000080:1.0:1788572419.861521:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e63ae19000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572419.861526:0:116192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788572419.861529:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572419.861537:0:116192:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572419.861539:0:116192:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff94e505620000) has no exports 00000020:00000080:1.0:1788572419.861544:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831ca1f 00000020:00000080:1.0:1788572419.861547:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e63ad0d000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788572419.861919:0:116192:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788572419.861925:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788572419.861929:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968876 gen 6 00000004:00080000:1.0:1788572419.861935:0:116192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572419.861937:0:116192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572419.861968:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572419.861975:0:116192:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572419.861979:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831ca11 00000020:00000080:1.0:1788572419.861985:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e618474000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572419.861988:0:116192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788572419.861992:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572419.861995:0:116192:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572419.861997:0:116192:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff94e504b499c0) has no exports 00000020:00000080:1.0:1788572419.862001:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831ca03 00000020:00000080:1.0:1788572419.862027:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e640d5c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572419.863197:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e62d0cc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572419.863220:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e50303b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788572419.863225:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e63ae19000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788572419.863229:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e63ad0d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788572419.863235:0:84098:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e63ae1a800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788572419.863242:0:84098:0:(genops.c:885:class_export_put()) final put ffff94e618473000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572419.863245:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e618473000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788572419.863248:0:84098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572419.863374:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e618474000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788572419.863379:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e640d5c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788572419.866633:0:116192:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788572419.866643:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788572419.866647:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884902112 gen 5 00000004:00080000:1.0:1788572419.866655:0:116192:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788572419.866658:0:116192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788572419.866712:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572419.866726:0:116192:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788572419.866743:0:116192:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788572419.866749:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c9f5 00000020:00000080:1.0:1788572419.866759:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e618475800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788572419.866765:0:116192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788572419.866772:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788572419.866777:0:116192:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788572419.866781:0:116192:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff94e5056219c0) has no exports 00000020:00000080:1.0:1788572419.866787:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c9ee 00000020:00000080:1.0:1788572419.866791:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e6056f7800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788572419.872177:0:84098:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e640d5d800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788572419.872196:0:84098:0:(genops.c:885:class_export_put()) final put ffff94e618476000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788572419.872200:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e618476000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788572419.872208:0:84098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572419.872308:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e618475800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788572419.872314:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e6056f7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788572419.879207:0:116192:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788572419.879217:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788572419.879222:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788572419.879231:0:116192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788572419.879299:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572419.879311:0:116192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572419.879358:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572419.879362:0:116192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572419.879369:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e6056f3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572419.879374:0:116192:0:(genops.c:844:class_export_destroy()) destroying export ffff94e6056f3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788572419.879389:0:116192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788572419.879504:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c9b6 00000020:00000080:2.0:1788572419.879514:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e503039800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788572419.879519:0:116192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788572419.879522:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572419.879527:0:116192:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788572419.879530:0:116192:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff94e501f319c0) has no exports 00000020:00000080:2.0:1788572419.879549:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572419.879552:0:116192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788572419.879557:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c9bd 00000020:00000080:2.0:1788572419.879560:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e50303f800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788572419.879568:0:116192:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94e6056ea000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788572419.879571:0:116192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94e6056ea000 3 00000020:01000004:2.0:1788572419.879573:0:116192:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94e6056ea000 from lustre-MDT0000 00000020:00000080:2.0:1788572419.879590:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572419.879594:0:116192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788572419.879596:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e62d0ce000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788572419.879598:0:116192:0:(genops.c:844:class_export_destroy()) destroying export ffff94e62d0ce000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788572419.879604:0:116192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788572419.879632:0:116192:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788572419.879636:0:116192:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788572419.879639:0:116192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788572419.879641:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572419.879643:0:116192:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788572419.879649:0:116192:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff94e60fc4d800 d74e0a07-d05f-49a8-aa32-40b653992526 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572419.879657:0:116192:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff94e6056fe000 90fa6266-5a39-4f6d-b3cf-5043b0cc0e22 192.168.202.13@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788572419.879661:0:116192:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff94e505623380) has exports, disconnecting them 00000020:00080000:2.0:1788572419.879665:0:116192:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff94e60fc4d800), last request at 1788572208 00000020:00000080:2.0:1788572419.879688:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c95b 00000020:00010000:2.0:1788572419.879692:0:116192:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94e60fc4d800: total 2 00000100:00080000:2.0:1788572419.879696:0:116192:0:(import.c:65:import_set_state_nolock()) ffff94e61010f000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788572419.879707:0:116192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94e60fc4d800): rc 0 00000020:00080000:2.0:1788572419.879711:0:116192:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.13@tcp (ffff94e6056fe000), last request at 1788572208 00000020:00010000:2.0:1788572419.879723:0:92609:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94e60fc4d800: total 2 00010000:00010000:2.0:1788572419.879749:0:92609:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94e60fc4d800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788572419.879777:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63af8dc00/0xdb7edb52b831cb37 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831cb30 expref: 14 pid: 111985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879798:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63af8ce00/0xdb7edb52b831cb45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831cb3e expref: 13 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879809:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e637701a00/0xdb7edb52b8334d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b8334d33 expref: 12 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879820:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e637781000/0xdb7edb52b8334d79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b8334d72 expref: 11 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879828:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63af8de00/0xdb7edb52b831cad5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831cace expref: 10 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879838:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63af8d800/0xdb7edb52b831cae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831cadc expref: 9 pid: 111984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879846:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e637696800/0xdb7edb52b831caf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831caea expref: 8 pid: 111985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879856:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63af8c800/0xdb7edb52b831cb53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831cb4c expref: 7 pid: 111985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879865:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63ade8800/0xdb7edb52b831caff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831caf8 expref: 6 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879886:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e609744e00/0xdb7edb52b8334d6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b8334d64 expref: 5 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879896:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63ae3b600/0xdb7edb52b831cb1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831cb14 expref: 4 pid: 111984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879905:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e609745800/0xdb7edb52b8334dcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b8334dc6 expref: 3 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879919:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63af8c200/0xdb7edb52b831cb29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb7edb52b831cb22 expref: 2 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572419.879928:0:92609:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94e60fc4d800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788572419.879947:0:92609:0:(genops.c:885:class_export_put()) final put ffff94e60fc4d800/d74e0a07-d05f-49a8-aa32-40b653992526 00010000:00010000:2.0:1788572419.879952:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572419.879954:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572419.879956:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788572419.879999:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c954 00000020:00010000:2.0:1788572419.880025:0:116192:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94e6056fe000: total 3 00000100:00080000:2.0:1788572419.880029:0:116192:0:(import.c:65:import_set_state_nolock()) ffff94e6056f1800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788572419.880047:0:116192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.202.13@tcp (ffff94e6056fe000): rc 0 00000020:00080000:2.0:1788572419.880051:0:116192:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff94e505623380) has no exports 00000020:00000080:3.0:1788572419.880147:0:84098:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e6056f2800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788572419.880157:0:84098:0:(genops.c:885:class_export_put()) final put ffff94e63c40e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572419.880159:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e63c40e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788572419.880168:0:84098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572419.880232:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e503039800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788572419.880236:0:84098:0:(genops.c:885:class_export_put()) final put ffff94e618790800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788572419.880238:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e618790800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788572419.880241:0:84098:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788572419.880277:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e50303f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788572419.880282:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e60fc4d800/d74e0a07-d05f-49a8-aa32-40b653992526 for MGS 00000020:00000080:3.0:1788572419.880312:0:84098:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e61010f000 for MGS 00000100:00100000:3.0:1788572419.880346:0:111983:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff94e633f77600:111983] 0 exiting: rc = 1 00000100:00100000:3.0:1788572419.880476:0:111991:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff94e6376ed200:111991] 4 exiting: rc = 0 00000100:00100000:3.0:1788572419.880543:0:111989:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff94e63c401c00:111989] 3 exiting: rc = 0 00000100:00100000:3.0:1788572419.880617:0:111985:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff94e503bd4e00:111985] 2 exiting: rc = 0 00000020:00010000:0.0:1788572419.888210:0:17013:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94e6056fe000: total 0 00010000:00010000:0.0:1788572419.888222:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572419.888297:0:17013:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94e6056fe000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788572419.888350:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e609744800/0xdb7edb52b8334db1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4a74e expref: 5 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572419.888377:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63af8d600/0xdb7edb52b831ca81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a47 expref: 4 pid: 111983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572419.888388:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e637697200/0xdb7edb52b831ca8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a55 expref: 3 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572419.888401:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e637696400/0xdb7edb52b831ca88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb45a4e expref: 2 pid: 111991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572419.888413:0:17013:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94e6056fe000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788572419.888427:0:17013:0:(genops.c:885:class_export_put()) final put ffff94e6056fe000/90fa6266-5a39-4f6d-b3cf-5043b0cc0e22 00010000:00010000:0.0:1788572419.888551:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572419.888555:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572419.888557:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572419.888615:0:111984:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff94e501f20a00:111984] 1 exiting: rc = 0 00000020:00000080:3.0:1788572419.894020:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e6056fe000/90fa6266-5a39-4f6d-b3cf-5043b0cc0e22 for MGS 00000020:00000080:3.0:1788572419.894074:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e6056f1800 for MGS 00000100:00100000:3.0:1788572419.902335:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902349:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902354:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902360:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902366:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902371:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902378:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902384:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902391:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902397:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902403:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902408:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902415:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902422:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902428:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902433:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902439:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902445:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902450:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902455:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902462:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902467:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902472:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902477:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902482:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902487:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902494:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902502:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902508:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902513:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902518:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902524:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902529:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902536:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902541:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902546:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902551:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902556:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902562:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902566:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902572:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902578:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902583:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902588:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902594:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902599:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902605:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902611:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902616:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902621:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902627:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902633:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902639:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902644:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902649:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902656:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902661:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902666:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902671:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902677:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902683:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902688:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902695:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788572419.902701:0:116192:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788572419.904702:0:116192:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94e505f1e7e0 - data ffff94e63380b798/ffff94e62d278c00 00000020:01000000:3.0:1788572419.904842:0:116192:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94e63a912300 - data ffff94e6339365e8/ffff94e633e1ac00 00000020:00000080:3.0:1788572419.905381:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c94d 00000020:00000080:3.0:1788572419.905391:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e63c40e800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788572419.905409:0:116192:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94e6056ea000 from MGS, refs=2 00000020:01000004:3.0:1788572419.905412:0:116192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94e6056ea000 2 00000020:01000004:3.0:1788572419.905415:0:116192:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94e6056ea000 from MGS 00000020:00000080:3.0:1788572419.905437:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788572419.905445:0:116192:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788572419.905448:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e63c40f800/MGS 00000020:00000080:3.0:1788572419.905451:0:116192:0:(genops.c:844:class_export_destroy()) destroying export ffff94e63c40f800/MGS for MGS 00000020:01000000:3.0:1788572419.905458:0:116192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788572419.905535:0:116192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788572419.905539:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788572419.905551:0:116192:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788572419.905558:0:116192:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff94e61e72e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788572419.905564:0:116192:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff94e504b4cd40) has exports, disconnecting them 00000020:00080000:3.0:1788572419.905569:0:116192:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff94e61e72e800), last request at 1788572208 00000020:00000080:3.0:1788572419.905573:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831ca6c 00000020:00080000:3.0:1788572419.905582:0:116192:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94e61e72e800): rc 0 00000020:00000080:3.0:1788572419.905587:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e61e72e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788572419.906539:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e63c40e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788572419.906555:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e61e72e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788572419.907428:0:116192:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788572419.907435:0:116192:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788572419.907440:0:116192:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788572419.907446:0:116192:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788572419.907474:0:84098:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e6349bc800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788572419.907633:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788572419.907645:0:116192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788572419.907650:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e61e72c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788572419.907653:0:116192:0:(genops.c:844:class_export_destroy()) destroying export ffff94e61e72c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788572419.907658:0:116192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788572419.907735:0:116192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94e6056ea000 1 00000020:00000080:2.0:1788572419.907740:0:116192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b831c93f 00000020:00000080:2.0:1788572419.907746:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e63c40d000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788572419.907754:0:116192:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788572419.907761:0:84098:0:(genops.c:844:class_export_destroy()) destroying export ffff94e63c40d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788572419.907769:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788572419.907773:0:116192:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788572419.907777:0:116192:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff94e61eb919c0) has no exports 00000020:00000080:1.0:1788572420.090912:0:116192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788572420.090926:0:116192:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788572420.090931:0:116192:0:(genops.c:885:class_export_put()) final put ffff94e6056e8800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788572420.090936:0:116192:0:(genops.c:844:class_export_destroy()) destroying export ffff94e6056e8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788572420.090949:0:116192:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788572420.091397:0:116192:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94e6056ed000 00000020:02000400:1.0:1788572420.091466:0:116192:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1788572420.611523:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639194368:0@lo:400:kworker.0 00000400:00000100:0.0:1788572420.611600:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875449639194368 offset 0 length 224: 4 00000100:00100000:0.0:1788572420.611765:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572420.611774:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639194752:0@lo:400:kworker.0 00000100:00100000:0.0:1788572420.611927:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572420.611978:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639194752 00000100:00100000:0.0:1788572420.611988:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639194752 00000100:00100000:0.0:1788572420.612404:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:0.0:1788572420.612417:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639194752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572420.613208:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639194752:12345-0@lo:400:kworker.0 Request processed in 790us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572420.613218:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:0.0:1788572420.613298:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639194752:0@lo:400:kworker.0 00000100:00100000:2.0:1788572420.614147:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639195264:0@lo:400:kworker.0 00000100:00100000:2.0:1788572420.614213:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572420.614263:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572420.614269:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639194880:0@lo:400:kworker.0 00000100:00100000:2.0:1788572420.614294:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572420.614312:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639195392:0@lo:400:kworker.0 00000100:00100000:2.0:1788572420.614346:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572420.614621:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572420.614649:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639194624:0@lo:400:kworker.0 00000100:00100000:1.0:1788572420.614727:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572420.614765:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639195136:0@lo:400:kworker.0 00000100:00100000:1.0:1788572420.614791:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572420.614824:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572420.614833:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639194496:0@lo:400:kworker.0 00000100:00100000:0.0:1788572420.614845:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639195136 00000100:00100000:0.0:1788572420.614856:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639195136 00000100:00100000:1.0:1788572420.614863:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572420.615106:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:0.0:1788572420.615119:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639195136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572420.615191:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639195136:12345-0@lo:400:kworker.0 Request processed in 75us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572420.615200:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00100000:2.0:1788572420.617457:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639195264 00000100:00100000:2.0:1788572420.617483:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639195264 00000100:00100000:2.0:1788572420.617550:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639194880 00000100:00100000:2.0:1788572420.617553:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639194880 00000100:00100000:2.0:1788572420.617579:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639195392 00000100:00100000:2.0:1788572420.617582:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639195392 00000100:00100000:2.0:1788572420.617618:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639194624 00000100:00100000:2.0:1788572420.617622:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639194624 00000100:00100000:2.0:1788572420.617639:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4678 00000100:00100000:2.0:1788572420.617653:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639195392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572420.617772:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639195392:12345-0@lo:400:kworker.0 Request processed in 124us (3427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572420.617792:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4678 00000100:00100000:2.0:1788572420.617813:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15490 00000100:00100000:2.0:1788572420.617818:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1875449639195264:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788572420.617825:0:6552:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788572420.617855:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1875449639195264:12345-0@lo:400:kworker.0 Request processed in 35us (3642us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572420.617861:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15490 00000100:00100000:2.0:1788572420.617873:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15491 00000100:00100000:2.0:1788572420.617877:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1875449639194880:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788572420.617881:0:6552:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788572420.617916:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1875449639194880:12345-0@lo:400:kworker.0 Request processed in 38us (3622us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572420.617923:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15491 00000100:00100000:2.0:1788572420.617933:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15492 00000100:00100000:2.0:1788572420.617937:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1875449639194624:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788572420.617954:0:6552:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788572420.618403:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3651:x1875449639194624:12345-0@lo:400:kworker.0 Request processed in 461us (3673us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572420.618410:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15492 00000100:00080000:2.0:1788572420.618480:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788572420.618492:0:3652:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788572420.618498:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788572420.618504:0:3652:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572420.618509:0:3652:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4130 00000100:00080000:2.0:1788572420.618526:0:3652:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94e50222f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572420.618568:0:3652:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e63ae3f480 x1875449639195520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572420.618598:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639194880:0@lo:400:kworker.0 00000100:00100000:2.0:1788572420.618621:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639195392:0@lo:400:kworker.0 00000100:00080000:2.0:1788572420.618634:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788572420.618637:0:3652:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788572420.618641:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788572420.618644:0:3652:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572420.618648:0:3652:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4250 00000100:00080000:2.0:1788572420.618652:0:3652:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94e6056e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572420.618666:0:3652:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e63ae3c000 x1875449639195648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572420.618675:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639195264:0@lo:400:kworker.0 00000100:00080000:2.0:1788572420.618713:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572420.620001:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639195520:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788572420.620102:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572420.620141:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639195648:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788572420.620163:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572420.621094:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639195520 00000100:00100000:0.0:1788572420.621110:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639195520 00000100:00100000:2.0:1788572420.621128:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639195648 00000100:00100000:2.0:1788572420.621135:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639195648 00000100:00100000:0.0:1788572420.621172:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15493 00000100:00100000:2.0:1788572420.621183:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15494 00000100:00100000:0.0:1788572420.621185:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875449639195520:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788572420.621194:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875449639195648:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788572420.621221:0:6550:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572420.621293:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875449639195520:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 110us (1191us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572420.621301:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15493 00000100:00080000:0.0:1788572420.621357:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00020000:2.0:1788572420.621358:0:6552:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788572420.621368:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572420.621374:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639195520:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788572420.621414:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875449639195648:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 219us (1248us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788572420.621423:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1788572420.621424:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15494 00000100:00080000:0.0:1788572420.621432:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572420.621437:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639195648:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788572420.622993:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639195008:0@lo:400:kworker.0 00000100:00100000:1.0:1788572420.623073:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788572420.623110:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572420.623116:0:3651:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572420.623120:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788572420.623126:0:3651:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572420.623130:0:3651:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4130 00000100:00080000:1.0:1788572420.623140:0:3651:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94e63c3af800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572420.623170:0:3651:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e61e760000 x1875449639195776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572420.623171:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639194496 00000100:00100000:2.0:1788572420.623185:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639194496 00000100:00100000:1.0:1788572420.623201:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639194624:0@lo:400:kworker.0 00000100:00100000:1.0:1788572420.623225:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639195136:0@lo:400:kworker.0 00000100:00100000:2.0:1788572420.623313:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808 00000100:00100000:2.0:1788572420.623322:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1875449639194496:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788572420.623333:0:7860:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788572420.623499:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3651:x1875449639194496:12345-0@lo:400:kworker.0 Request processed in 175us (8636us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572420.623510:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808 00000100:00080000:1.0:1788572420.626505:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788572420.626514:0:3651:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788572420.626519:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788572420.626526:0:3651:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572420.626664:0:3651:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4130 00000100:00080000:1.0:1788572420.626674:0:3651:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94e607732800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572420.626717:0:3651:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e62d28d180 x1875449639195904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572420.626736:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639194496:0@lo:400:kworker.0 00000100:00100000:0.0:1788572420.627056:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639195008 00000100:00100000:0.0:1788572420.627073:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639195008 00000100:00100000:0.0:1788572420.627177:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4679 00000100:00100000:0.0:1788572420.627188:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639195008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572420.627303:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639195008:12345-0@lo:400:kworker.0 Request processed in 117us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572420.627311:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4679 00000100:00100000:0.0:1788572420.627347:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639195776:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788572420.627395:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572420.627425:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639195904:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788572420.627456:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572420.627491:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639195904 00000100:00100000:0.0:1788572420.627495:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639195904 00000100:00100000:0.0:1788572420.627521:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:0.0:1788572420.627527:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1875449639195904:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788572420.627553:0:42013:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572420.627595:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:0+-99:3649:x1875449639195904:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 67us (137us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572420.627602:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00100000:3.0:1788572420.627622:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639195776 00000100:00100000:3.0:1788572420.627627:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639195776 00000100:00080000:0.0:1788572420.627647:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572420.627654:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572420.627655:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15495 00000100:00100000:0.0:1788572420.627658:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639195904:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788572420.627661:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875449639195776:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788572420.627671:0:6550:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572420.627716:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875449639195776:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 54us (320us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572420.627722:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15495 00000100:00080000:1.0:1788572420.628592:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572420.628650:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639195008:0@lo:400:kworker.0 00000100:00080000:0.0:1788572420.632094:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572420.632115:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572420.632122:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639195776:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1788572420.808849:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572421.827379:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572422.854851:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572423.683412:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639196032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572423.683515:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572423.683675:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639196032 00000100:00100000:2.0:1788572423.683687:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639196032 00000100:00100000:2.0:1788572423.683765:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:2.0:1788572423.683775:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639196032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572423.683814:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572423.683867:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639196032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572423.683874:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000100:00100000:0.0:1788572423.685123:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639196032:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572423.686498:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572423.876855:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572424.101481:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572424.101608:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000400:00000100:1.0:1788572424.101639:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.13@tcp portal 26 match 1875449616256128 offset 0 length 224: 4 00000100:00100000:1.0:1788572424.101660:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572424.101722:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616256512 00000100:00100000:0.0:1788572424.101736:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616256512 00000100:00100000:0.0:1788572424.101823:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3775 00000100:00100000:0.0:1788572424.101846:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616256512:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572424.101962:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616256512:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 91us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572424.101975:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3775 00000100:00080000:3.0:1788572424.103363:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572424.106406:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572424.106747:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616256640 00000100:00100000:0.0:1788572424.106765:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616256640 00000100:00100000:0.0:1788572424.106886:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3776 00000100:00100000:0.0:1788572424.106898:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616256640:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572424.107043:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616256640:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 146us (2506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572424.107052:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3776 00000100:00080000:1.0:1788572424.109584:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572424.111535:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616256256 00000100:00100000:2.0:1788572424.111572:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616256256 00000100:00100000:2.0:1788572424.111675:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616256384 00000100:00100000:2.0:1788572424.111679:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616256384 00000100:00100000:2.0:1788572424.111753:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4680 00000100:00100000:2.0:1788572424.111767:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616256384:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572424.111897:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616256384:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 132us (10234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572424.111905:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4680 00000100:00100000:2.0:1788572424.111927:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15496 00000100:00100000:2.0:1788572424.111933:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2384:x1875449616256256:12345-192.168.202.13@tcp:400:kworker.0 00000020:00080000:2.0:1788572424.111955:0:6551:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.13@tcp 00000100:00100000:2.0:1788572424.111983:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2384:x1875449616256256:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 49us (10520us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788572424.111994:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15496 00000100:00080000:1.0:1788572424.112452:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572424.114970:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572424.115126:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616256768 00000100:00100000:3.0:1788572424.115141:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616256768 00000100:00100000:3.0:1788572424.115203:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15497 00000100:00100000:3.0:1788572424.115213:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2382:x1875449616256768:12345-192.168.202.13@tcp:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788572424.115246:0:6550:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572424.115332:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2382:x1875449616256768:12345-192.168.202.13@tcp:38:ptlrpcd_00_01.0 Request processed in 119us (377us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572424.115340:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15497 00000100:00100000:3.0:1788572424.197761:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572424.197796:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639196160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572424.197897:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572424.198217:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639196160 00000100:00100000:0.0:1788572424.198231:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639196160 00000100:00100000:0.0:1788572424.198320:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927 00000100:00100000:0.0:1788572424.198333:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639196160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572424.198375:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572424.198446:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639196160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572424.198455:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927 00000100:00080000:1.0:1788572424.198678:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572424.198766:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639196160:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1788572424.713100:0:114775:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572424.713114:0:114775:0:(genops.c:885:class_export_put()) final put ffff94e603bce000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572424.715057:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e603bce000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788572424.715173:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e633fba800 for lustre-OST0000 00000001:00100000:2.0:1788572424.715402:0:9546:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788572424.715409:0:9546:0:(genops.c:885:class_export_put()) final put ffff94e641362000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788572424.715476:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94e641362000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788572424.715539:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e641363000 for lustre-OST0001 00000001:00100000:0.0:1788572424.723201:0:7482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788572424.723221:0:7482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967372 is committed 00000020:00000080:0.0:1788572424.723227:0:7482:0:(genops.c:885:class_export_put()) final put ffff94e641360800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788572424.723394:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e641360800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788572424.723467:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e641362800 for lustre-MDT0001 00010000:00010000:0.0:1788572424.899217:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572425.732284:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572425.732294:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572425.732299:0:36:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572425.732310:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4337 00000100:00080000:0.0:1788572425.732318:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572425.732329:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94e607732800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572425.732357:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e62d288a80 x1875449639196416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572425.732380:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572425.732383:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572425.732384:0:36:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572425.732388:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4337 00000100:00080000:0.0:1788572425.732390:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572425.732394:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94e63c3af800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572425.732406:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e62d28b100 x1875449639196544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572425.732440:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572425.732444:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572425.732446:0:36:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572425.732451:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4337 00000100:00080000:0.0:1788572425.732454:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572425.732457:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94e50222f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572425.732469:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e62d289c00 x1875449639196800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572425.732510:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572425.732514:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572425.732516:0:36:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572425.732520:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4337 00000100:00080000:0.0:1788572425.732522:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788572425.732526:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94e6056e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572425.732540:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e60fc3f480 x1875449639197184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572425.732577:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639196416:0@lo:38:kworker.0 00000100:00100000:0.0:1788572425.732676:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572425.732739:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639196544:0@lo:38:kworker.0 00000100:00100000:0.0:1788572425.732780:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572425.732794:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639196800:0@lo:38:kworker.0 00000100:00100000:0.0:1788572425.732813:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572425.732831:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639197184:0@lo:38:kworker.0 00000100:00100000:0.0:1788572425.732853:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572425.732895:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639196928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572425.732922:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572425.732942:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572425.732960:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639197056:0@lo:400:kworker.0 00000100:00100000:0.0:1788572425.732985:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572425.733066:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639196544 00000100:00100000:0.0:1788572425.733076:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639196544 00000100:00100000:0.0:1788572425.733116:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639196800 00000100:00100000:0.0:1788572425.733118:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639196800 00000100:00100000:0.0:1788572425.733131:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639197184 00000100:00100000:0.0:1788572425.733133:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639197184 00000100:00100000:0.0:1788572425.733141:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639196928 00000100:00100000:0.0:1788572425.733143:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639196928 00000100:00100000:0.0:1788572425.733187:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4681 00000100:00100000:0.0:1788572425.733199:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639196928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572425.733270:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639196928:12345-0@lo:400:kworker.0 Request processed in 73us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572425.733278:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4681 00000100:00100000:0.0:1788572425.733297:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15498 00000100:00100000:0.0:1788572425.733302:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639196544:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572425.733324:0:9276:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572425.733360:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639196544:12345-0@lo:38:kworker.0 Request processed in 56us (579us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572425.733367:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15498 00000100:00100000:0.0:1788572425.733379:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15499 00000100:00100000:0.0:1788572425.733383:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639196800:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572425.733392:0:9276:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572425.733415:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639196800:12345-0@lo:38:kworker.0 Request processed in 30us (599us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572425.733421:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15499 00000100:00100000:0.0:1788572425.733431:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15500 00000100:00100000:0.0:1788572425.733435:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639197184:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572425.733444:0:9276:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572425.733467:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639197184:12345-0@lo:38:kworker.0 Request processed in 30us (613us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572425.733472:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15500 00000100:00100000:0.0:1788572425.733523:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639196928:0@lo:400:kworker.0 00000100:00080000:0.0:1788572425.733556:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572425.733561:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572425.733564:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639196544:0@lo:38:kworker.0 00000100:00080000:0.0:1788572425.733573:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572425.733576:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572425.733579:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639196800:0@lo:38:kworker.0 00000100:00080000:0.0:1788572425.733587:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572425.733590:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572425.733593:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639197184:0@lo:38:kworker.0 00000100:00080000:0.0:1788572425.733664:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572425.734231:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639196672:0@lo:400:kworker.0 00000100:00100000:3.0:1788572425.734286:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572425.734335:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788572425.734342:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639196288:0@lo:400:kworker.0 00000400:00000100:3.0:1788572425.734363:0:3653:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875449639196288 offset 0 length 224: 4 00000100:00100000:3.0:1788572425.734390:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639197312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572425.734432:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572425.734474:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639197312 00000100:00100000:3.0:1788572425.734481:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639197312 00000100:00100000:3.0:1788572425.734537:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4682 00000100:00100000:3.0:1788572425.734544:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639197312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572425.734596:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639197312:12345-0@lo:400:kworker.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572425.734602:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4682 00000100:00100000:3.0:1788572425.734624:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639197056 00000100:00100000:3.0:1788572425.734628:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639197056 00000100:00100000:3.0:1788572425.734659:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639196672 00000100:00100000:3.0:1788572425.734662:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639196672 00000100:00100000:3.0:1788572425.734687:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:3.0:1788572425.734693:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639197056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572425.734734:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639197056:12345-0@lo:400:kworker.0 Request processed in 41us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572425.734740:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00100000:0.0:1788572425.734917:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:0.0:1788572425.734927:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639196672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572425.735096:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639197056:0@lo:400:kworker.0 00000100:00080000:3.0:1788572425.735124:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572425.735129:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572425.735148:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639197312:0@lo:400:kworker.0 00000100:00100000:0.0:1788572425.735399:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639196672:12345-0@lo:400:kworker.0 Request processed in 473us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572425.735406:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:2.0:1788572425.735596:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639196416 00000100:00100000:2.0:1788572425.735603:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639196416 00000100:00100000:2.0:1788572425.735635:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:2.0:1788572425.735641:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1875449639196416:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572425.735663:0:7860:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572425.735714:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1875449639196416:12345-0@lo:38:kworker.0 Request processed in 72us (3039us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572425.735731:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00080000:2.0:1788572425.735791:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788572425.735797:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572425.735801:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639196416:0@lo:38:kworker.0 00000100:00100000:3.0:1788572425.736678:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639196672:0@lo:400:kworker.0 00010000:00010000:2.0:1788572425.924626:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572426.948483:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572427.982175:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572428.805253:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639197440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572428.805355:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572428.806027:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639197440 00000100:00100000:2.0:1788572428.806044:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639197440 00000100:00100000:2.0:1788572428.806151:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00100000:2.0:1788572428.806167:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639197440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572428.806216:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8668608 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572428.806487:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639197440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 323us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572428.806496:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00080000:3.0:1788572428.806587:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572428.814174:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639197440:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788572428.995462:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1788572429.215666:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.13@tcp portal 26 match 1875449616256896 offset 0 length 224: 4 00000100:00100000:2.0:1788572429.215735:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572429.215864:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616257152 00000100:00100000:3.0:1788572429.215875:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616257152 00000100:00100000:3.0:1788572429.216037:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4683 00000100:00100000:3.0:1788572429.216050:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616257152:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572429.216166:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616257152:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 119us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572429.216174:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4683 00000100:00080000:0.0:1788572429.216789:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572429.216975:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572429.217035:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572429.217112:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616257024 00000100:00100000:3.0:1788572429.217119:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616257024 00000100:00100000:3.0:1788572429.217153:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15501 00000100:00100000:3.0:1788572429.217159:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2382:x1875449616257024:12345-192.168.202.13@tcp:38:kworker.0 00010000:00020000:3.0:1788572429.217183:0:9276:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572429.217225:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2382:x1875449616257024:12345-192.168.202.13@tcp:38:kworker.0 Request processed in 64us (261us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572429.217233:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15501 00000100:00100000:0.0:1788572429.217808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572429.227885:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616257280 00000100:00100000:2.0:1788572429.227911:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616257280 00000100:00080000:0.0:1788572429.228115:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572429.229555:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616257408 00000100:00100000:2.0:1788572429.229569:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616257408 00000100:00100000:3.0:1788572429.229675:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4442 00000100:00100000:3.0:1788572429.229702:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2382:x1875449616257280:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:3.0:1788572429.229741:0:43973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b8339fff 00000100:00080000:3.0:1788572429.229752:0:43973:0:(import.c:65:import_set_state_nolock()) ffff94e63c533800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788572429.229801:0:43973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884902112 00000100:00100000:3.0:1788572429.229991:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+2:2382:x1875449616257280:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 304us (12954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572429.229999:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4442 00000100:00100000:3.0:1788572429.230032:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4443 00000100:00100000:3.0:1788572429.230040:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2382:x1875449616257408:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:3.0:1788572429.230052:0:43973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b833a006 00000100:00080000:3.0:1788572429.230058:0:43973:0:(import.c:65:import_set_state_nolock()) ffff94e641559800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788572429.230082:0:43973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968876 00000100:00100000:3.0:1788572429.230161:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+2:2382:x1875449616257408:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 121us (12354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572429.230168:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4443 00010000:00010000:0.0:1788572429.230238:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572429.230248:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788572429.230393:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572429.317351:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639197568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572429.317434:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572429.317571:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639197568 00000100:00100000:0.0:1788572429.317580:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639197568 00000100:00100000:0.0:1788572429.317649:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00100000:0.0:1788572429.317660:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50384df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639197568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572429.317692:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572429.317751:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50384df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639197568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572429.317759:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00100000:0.0:1788572429.317804:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639197568:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788572429.318031:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572430.021514:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572430.851400:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572430.851406:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572430.851410:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572430.851418:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4342 00000100:00080000:1.0:1788572430.851424:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572430.851430:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94e607732800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572430.851455:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e633ee9880 x1875449639197824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572430.851475:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572430.851479:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572430.851480:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788572430.851480:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1788572430.851484:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4342 00000100:00080000:1.0:1788572430.851486:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572430.851489:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94e63c3af800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572430.851499:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639197696:0@lo:400:kworker.0 00000100:00100000:1.0:1788572430.851500:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e633ee8700 x1875449639197952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572430.851526:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572430.851529:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572430.851531:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572430.851534:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4342 00000100:00080000:1.0:1788572430.851536:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572430.851539:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94e50222f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572430.851548:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e633eea300 x1875449639198208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1788572430.851550:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875449639197696 offset 0 length 224: 4 00000100:00080000:1.0:1788572430.851568:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788572430.851570:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788572430.851571:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788572430.851574:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4342 00000100:00080000:1.0:1788572430.851576:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788572430.851579:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94e6056e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572430.851590:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6414a5f80 x1875449639198592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572430.851599:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639198464:0@lo:400:kworker.0 00000100:00100000:1.0:1788572430.851614:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639198080:0@lo:400:kworker.0 00000100:00100000:2.0:1788572430.851642:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572430.851646:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639198336:0@lo:400:kworker.0 00000100:00100000:2.0:1788572430.851666:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572430.851671:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572430.851671:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639198720:0@lo:400:kworker.0 00000100:00100000:1.0:1788572430.851720:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639198336 00000100:00100000:1.0:1788572430.851727:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639198336 00000100:00100000:3.0:1788572430.851729:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639197824:0@lo:38:kworker.0 00000100:00100000:0.0:1788572430.851798:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572430.851911:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4684 00000100:00100000:1.0:1788572430.851922:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639198336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572430.856063:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572430.856165:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639198464 00000100:00100000:2.0:1788572430.856174:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639198464 00000100:00100000:2.0:1788572430.856231:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639198080 00000100:00100000:2.0:1788572430.856235:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639198080 00000100:00100000:3.0:1788572430.856312:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639198720 00000100:00100000:3.0:1788572430.856317:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639198720 00000100:00100000:3.0:1788572430.856353:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4685 00000100:00100000:3.0:1788572430.856364:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639198720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572430.856441:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639198720:12345-0@lo:400:kworker.0 Request processed in 79us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572430.856448:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4685 00000100:00100000:3.0:1788572430.856479:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572430.856504:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639197952:0@lo:38:kworker.0 00000100:00100000:3.0:1788572430.856535:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572430.856556:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639197952 00000100:00100000:3.0:1788572430.856559:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639197952 00000100:00100000:3.0:1788572430.856580:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15502 00000100:00100000:3.0:1788572430.856585:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639197952:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788572430.856605:0:9276:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572430.856635:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639197952:12345-0@lo:38:kworker.0 Request processed in 49us (99us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572430.856642:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15502 00000100:00080000:3.0:1788572430.856675:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572430.856680:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788572430.856892:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1788572430.856901:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639198464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572430.856938:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639198464:12345-0@lo:400:kworker.0 Request processed in 40us (5296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572430.856944:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1788572430.856956:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:2.0:1788572430.856962:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639198080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572430.857028:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639198080:12345-0@lo:400:kworker.0 Request processed in 42us (5206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572430.857034:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00100000:2.0:1788572430.857069:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639198720:0@lo:400:kworker.0 00000100:00100000:2.0:1788572430.857081:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639198464:0@lo:400:kworker.0 00000100:00080000:2.0:1788572430.857138:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572430.857144:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572430.857176:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639197824 00000100:00100000:2.0:1788572430.857180:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639197824 00000100:00100000:2.0:1788572430.857202:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811 00000100:00100000:2.0:1788572430.857207:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875449639197824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788572430.857218:0:6556:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572430.857248:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875449639197824:12345-0@lo:38:kworker.0 Request processed in 40us (768us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572430.857254:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811 00000100:00100000:0.0:1788572430.857286:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639198080:0@lo:400:kworker.0 00000100:00100000:3.0:1788572430.857439:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639197952:0@lo:38:kworker.0 00000100:00100000:3.0:1788572430.857449:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639198208:0@lo:38:kworker.0 00000100:00100000:3.0:1788572430.857481:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572430.857512:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639198592:0@lo:38:kworker.0 00000100:00100000:3.0:1788572430.857533:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788572430.857572:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572430.857578:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572430.857580:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639197824:0@lo:38:kworker.0 00000100:00100000:0.0:1788572430.861054:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639198208 00000100:00100000:0.0:1788572430.861072:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639198208 00000100:00100000:0.0:1788572430.861146:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639198592 00000100:00100000:0.0:1788572430.861150:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639198592 00000100:00100000:0.0:1788572430.861177:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15503 00000100:00100000:0.0:1788572430.861184:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639198208:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572430.861209:0:9276:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572430.861288:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639198208:12345-0@lo:38:kworker.0 Request processed in 103us (3805us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572430.861295:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15503 00000100:00100000:0.0:1788572430.861312:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15504 00000100:00100000:0.0:1788572430.861317:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639198592:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572430.861326:0:9276:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572430.861351:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639198592:12345-0@lo:38:kworker.0 Request processed in 33us (3817us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572430.861356:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15504 00000100:00080000:3.0:1788572430.863528:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572430.863542:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572430.863547:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639198208:0@lo:38:kworker.0 00000100:00080000:3.0:1788572430.863561:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572430.863565:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572430.863567:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639198592:0@lo:38:kworker.0 00000100:00100000:1.0:1788572430.869627:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639198336:12345-0@lo:400:kworker.0 Request processed in 17698us (17945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572430.869643:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4684 00000100:00100000:2.0:1788572430.869842:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639198336:0@lo:400:kworker.0 00010000:00010000:2.0:1788572431.043174:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572432.067232:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572433.091127:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572433.923407:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639198848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572433.923518:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572433.923640:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639198848 00000100:00100000:0.0:1788572433.923653:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639198848 00000100:00100000:0.0:1788572433.923733:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:0.0:1788572433.923744:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639198848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572433.923785:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572433.923838:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639198848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572433.923846:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00080000:0.0:1788572433.923870:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572433.923915:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639198848:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788572434.115467:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572434.338981:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000400:00000100:3.0:1788572434.339080:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.13@tcp portal 26 match 1875449616257536 offset 0 length 224: 4 00000100:00100000:3.0:1788572434.339163:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572434.339261:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616257664 00000100:00100000:0.0:1788572434.339276:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616257664 00000100:00100000:0.0:1788572434.339337:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616257792 00000100:00100000:0.0:1788572434.339341:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616257792 00000100:00100000:0.0:1788572434.339399:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4686 00000100:00100000:0.0:1788572434.339411:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616257792:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572434.339512:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616257792:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 103us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572434.339520:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4686 00000100:00100000:0.0:1788572434.339555:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15505 00000100:00100000:0.0:1788572434.339561:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2382:x1875449616257664:12345-192.168.202.13@tcp:38:kworker.0 00010000:00020000:0.0:1788572434.339588:0:6552:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572434.339617:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2382:x1875449616257664:12345-192.168.202.13@tcp:38:kworker.0 Request processed in 55us (650us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572434.339624:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15505 00000100:00080000:0.0:1788572434.339642:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572434.437631:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572434.437664:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639198976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572434.437764:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572434.437962:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639198976 00000100:00100000:1.0:1788572434.437974:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639198976 00000100:00100000:1.0:1788572434.438079:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00100000:1.0:1788572434.438092:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639198976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572434.438137:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572434.438198:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639198976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572434.438207:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000100:00080000:2.0:1788572434.438340:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572434.438393:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639198976:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1788572434.950601:0:114775:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000020:00000080:0.0:1788572434.950869:0:114775:0:(genops.c:885:class_export_put()) final put ffff94e63c537000/35eb2d60-2de0-4b00-9815-d5153edd0057 00000020:00000080:3.0:1788572434.950958:0:93352:0:(genops.c:844:class_export_destroy()) destroying export ffff94e63c537000/35eb2d60-2de0-4b00-9815-d5153edd0057 for lustre-OST0000 00000020:00000080:3.0:1788572434.951045:0:93352:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e63c533800 for lustre-OST0000 00000001:00100000:3.0:1788572434.952797:0:9546:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000020:00000080:3.0:1788572434.952861:0:9546:0:(genops.c:885:class_export_put()) final put ffff94e64155a000/35eb2d60-2de0-4b00-9815-d5153edd0057 00000020:00000080:2.0:1788572434.952920:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94e64155a000/35eb2d60-2de0-4b00-9815-d5153edd0057 for lustre-OST0001 00000020:00000080:2.0:1788572434.953078:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e641559800 for lustre-OST0001 00010000:00010000:2.0:1788572435.140396:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788572435.971413:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572435.971424:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572435.971429:0:36:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572435.971443:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4347 00000100:00080000:0.0:1788572435.971453:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572435.971462:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94e607732800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572435.971493:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e62d289c00 x1875449639199232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572435.971514:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572435.971518:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572435.971520:0:36:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572435.971524:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4347 00000100:00080000:0.0:1788572435.971527:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572435.971532:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94e63c3af800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788572435.971546:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639199232:0@lo:38:kworker.0 00000100:00100000:0.0:1788572435.971547:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e62d28b100 x1875449639199360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572435.971588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572435.971593:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572435.971594:0:36:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572435.971601:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4347 00000100:00080000:0.0:1788572435.971604:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572435.971609:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94e50222f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572435.971651:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b1880 x1875449639199616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572435.971675:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788572435.971727:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572435.971731:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572435.971733:0:36:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572435.971738:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4347 00000100:00080000:0.0:1788572435.971742:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788572435.971748:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94e6056e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572435.971763:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b3100 x1875449639200000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572435.971796:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639199360:0@lo:38:kworker.0 00000100:00100000:0.0:1788572435.971814:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639199488:0@lo:400:kworker.0 00000100:00100000:3.0:1788572435.971834:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572435.971875:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639199616:0@lo:38:kworker.0 00000100:00100000:0.0:1788572435.971887:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572435.971921:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572435.971936:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788572435.971948:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639199104:0@lo:400:kworker.0 00000100:00100000:3.0:1788572435.971953:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639200000:0@lo:38:kworker.0 00000100:00100000:3.0:1788572435.971988:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:0.0:1788572435.971997:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875449639199104 offset 0 length 224: 4 00000100:00100000:0.0:1788572435.972078:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639200128:0@lo:400:kworker.0 00000100:00100000:3.0:1788572435.972084:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639199232 00000100:00100000:3.0:1788572435.972095:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639199232 00000100:00100000:0.0:1788572435.972114:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572435.972132:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639199744:0@lo:400:kworker.0 00000100:00100000:3.0:1788572435.972146:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812 00000100:00100000:3.0:1788572435.972155:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1875449639199232:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788572435.972173:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:3.0:1788572435.972181:0:6555:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572435.972203:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572435.972215:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639199872:0@lo:400:kworker.0 00000100:00100000:3.0:1788572435.972244:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1875449639199232:12345-0@lo:38:kworker.0 Request processed in 87us (569us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572435.972256:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572435.972270:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812 00000100:00100000:0.0:1788572435.972559:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639199488 00000100:00100000:0.0:1788572435.972568:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639199488 00000100:00100000:3.0:1788572435.975105:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639199360 00000100:00100000:3.0:1788572435.975120:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639199360 00000100:00100000:1.0:1788572435.975135:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639199616 00000100:00100000:1.0:1788572435.975148:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639199616 00000100:00100000:3.0:1788572435.975177:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639200000 00000100:00100000:3.0:1788572435.975183:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639200000 00000100:00100000:1.0:1788572435.975195:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639200128 00000100:00100000:1.0:1788572435.975202:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639200128 00000100:00100000:3.0:1788572435.975206:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639199744 00000100:00100000:3.0:1788572435.975213:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639199744 00000100:00100000:0.0:1788572435.975495:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639199872 00000100:00100000:0.0:1788572435.975502:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639199872 00000100:00080000:2.0:1788572435.975548:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572435.975554:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572435.975645:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:0.0:1788572435.975658:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639199488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572435.975770:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:2.0:1788572435.975782:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639199872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572435.975893:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639199488:12345-0@lo:400:kworker.0 Request processed in 238us (4007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572435.975902:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00100000:0.0:1788572435.975939:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15506 00000100:00100000:0.0:1788572435.975946:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875449639199360:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572435.975983:0:6552:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572435.976306:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875449639199360:12345-0@lo:38:kworker.0 Request processed in 358us (4473us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572435.976313:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15506 00000100:00100000:0.0:1788572435.976332:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15507 00000100:00100000:0.0:1788572435.976336:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875449639199616:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572435.976345:0:6552:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572435.976370:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875449639199616:12345-0@lo:38:kworker.0 Request processed in 32us (4452us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572435.976375:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15507 00000100:00100000:0.0:1788572435.976397:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15508 00000100:00100000:0.0:1788572435.976402:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875449639200000:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572435.976412:0:6552:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572435.976438:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875449639200000:12345-0@lo:38:kworker.0 Request processed in 35us (4451us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572435.976444:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15508 00000100:00100000:0.0:1788572435.976535:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639199488:0@lo:400:kworker.0 00000100:00100000:1.0:1788572435.976935:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4687 00000100:00100000:1.0:1788572435.976946:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639200128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572435.977082:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4688 00000100:00100000:3.0:1788572435.977100:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639199744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572435.977208:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639199744:12345-0@lo:400:kworker.0 Request processed in 115us (5036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572435.977216:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4688 00000100:00100000:1.0:1788572435.977256:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639200128:12345-0@lo:400:kworker.0 Request processed in 309us (5138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572435.977266:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4687 00000100:00100000:0.0:1788572435.977372:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639200128:0@lo:400:kworker.0 00000100:00100000:2.0:1788572435.977499:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639199872:12345-0@lo:400:kworker.0 Request processed in 1720us (5242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572435.977509:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:2.0:1788572435.977553:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639199872:0@lo:400:kworker.0 00000100:00100000:2.0:1788572435.977570:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639199744:0@lo:400:kworker.0 00000100:00080000:3.0:1788572435.978130:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572435.978141:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572435.978147:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639199360:0@lo:38:kworker.0 00000100:00080000:3.0:1788572435.978165:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572435.978170:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572435.978177:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639199616:0@lo:38:kworker.0 00000100:00080000:3.0:1788572435.978193:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572435.978198:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572435.978202:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639200000:0@lo:38:kworker.0 00000100:00080000:3.0:1788572435.978226:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572435.978230:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572435.978234:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639199232:0@lo:38:kworker.0 00010000:00010000:2.0:1788572436.163239:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788572436.996128:0:3653:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572420/real 1788572420] req@ffff94e63aeb3480 x1875449639194368/t0(0) o400->MGC192.168.202.113@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572436 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572436.996161:0:3653:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff94e63aeb3480 x1875449639194368/t0(0) o400->MGC192.168.202.113@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572436 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572436.996171:0:3653:0:(import.c:65:import_set_state_nolock()) ffff94e60369c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788572436.996175:0:3653:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788572436.996178:0:3653:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.113@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788572436.996180:0:3653:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788572436.996184:0:3653:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94e63aeb3480 x1875449639194368/t0(0) o400->MGC192.168.202.113@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788572436 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572436.996192:0:3653:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94e62d288e00 x1875449639196288/t0(0) o400->MGC192.168.202.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572441 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572436.996199:0:3653:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94e633de6680 x1875449639197696/t0(0) o400->MGC192.168.202.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572446 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572436.996212:0:3653:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff94e62d288a80 x1875449639199104/t0(0) o400->MGC192.168.202.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788572451 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788572436.996222:0:3653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788572436.996225:0:3653:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788572436.996226:0:3653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788572436.996228:0:3653:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1788572436.996252:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639196288:0@lo:400:kworker.0 00000100:00100000:3.0:1788572436.996258:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639194368:0@lo:400:kworker.0 00000100:00100000:1.0:1788572436.996724:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639199104:0@lo:400:kworker.0 00000100:00100000:1.0:1788572436.996749:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639197696:0@lo:400:kworker.0 00000100:00080000:0.0:1788572436.999208:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) d74e0a07-d05f-49a8-aa32-40b653992526->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572436.999219:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788572436.999223:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e60369c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572436.999232:0:93352:0:(import.c:545:import_select_connection()) MGC192.168.202.113@tcp: connect to NID 0@lo last attempt 4125 00000100:00080000:0.0:1788572436.999242:0:93352:0:(import.c:665:import_select_connection()) MGC192.168.202.113@tcp: import ffff94e60369c800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572436.999278:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b2680 x1875449639200256/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788572436.999347:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d74e0a07-d05f-49a8-aa32-40b653992526:3649:1875449639200256:0@lo:250:kworker.0 00000400:00000100:1.0:1788572436.999403:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875449639200256 offset 0 length 520: 4 00000100:00080000:0.0:1788572436.999463:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572436.999467:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572436.999469:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572436.999473:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4352 00000100:00080000:0.0:1788572436.999475:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572436.999479:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94e607732800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572436.999495:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b1f80 x1875449639200384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572437.001042:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572437.001051:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572437.001054:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572437.001060:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4352 00000100:00080000:0.0:1788572437.001063:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572437.001070:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94e63c3af800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572437.001101:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b3480 x1875449639200512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572437.001147:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572437.001150:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572437.001152:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572437.001156:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4352 00000100:00080000:0.0:1788572437.001158:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572437.001161:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94e50222f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572437.001174:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b1500 x1875449639200768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572437.001213:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572437.001229:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639200896:0@lo:400:kworker.0 00000100:00100000:0.0:1788572437.001288:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572437.001334:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639200896 00000100:00100000:0.0:1788572437.001342:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639200896 00000100:00100000:0.0:1788572437.001390:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4689 00000100:00100000:0.0:1788572437.001400:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639200896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572437.001454:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639200896:12345-0@lo:400:kworker.0 Request processed in 54us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572437.001462:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4689 00000100:00100000:0.0:1788572437.001529:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639200896:0@lo:400:kworker.0 00000100:00080000:0.0:1788572437.001562:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572437.001567:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572437.001569:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572437.001573:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4352 00000100:00080000:0.0:1788572437.001576:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572437.001580:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94e6056e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572437.001588:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639201024:0@lo:400:kworker.0 00000100:00100000:0.0:1788572437.001616:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572437.001643:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639201024 00000100:00100000:0.0:1788572437.001647:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639201024 00000100:00100000:0.0:1788572437.001679:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:0.0:1788572437.001685:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639201024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572437.001689:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639200640:0@lo:400:kworker.0 00000100:00100000:3.0:1788572437.001717:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572437.001721:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639201024:12345-0@lo:400:kworker.0 Request processed in 37us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572437.001728:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:0.0:1788572437.001738:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639200640 00000100:00100000:0.0:1788572437.001741:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639200640 00000100:00100000:0.0:1788572437.001761:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:0.0:1788572437.001766:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639200640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572437.001809:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639200640:12345-0@lo:400:kworker.0 Request processed in 42us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572437.001816:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00080000:0.0:1788572437.001832:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572437.001836:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572437.001856:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639201024:0@lo:400:kworker.0 00000100:00100000:0.0:1788572437.001883:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b0380 x1875449639201152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572437.001968:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639200640:0@lo:400:kworker.0 00000100:00100000:3.0:1788572437.001980:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572437.001985:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639201280:0@lo:400:kworker.0 00000100:00100000:3.0:1788572437.002032:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572437.002037:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639200384:0@lo:38:kworker.0 00000100:00100000:3.0:1788572437.002059:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639201280 00000100:00100000:3.0:1788572437.002062:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639201280 00000100:00100000:1.0:1788572437.002070:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572437.002090:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639200512:0@lo:38:kworker.0 00000100:00100000:3.0:1788572437.002098:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4690 00000100:00100000:3.0:1788572437.002104:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639201280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572437.002109:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572437.002124:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639200768:0@lo:38:kworker.0 00000100:00100000:3.0:1788572437.002134:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639201280:12345-0@lo:400:kworker.0 Request processed in 31us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572437.002141:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4690 00000100:00100000:1.0:1788572437.002142:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572437.002153:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639200512 00000100:00100000:1.0:1788572437.002156:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639201152:0@lo:38:kworker.0 00000100:00100000:3.0:1788572437.002156:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639200512 00000100:00100000:3.0:1788572437.002169:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639200768 00000100:00100000:3.0:1788572437.002171:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639200768 00000100:00100000:1.0:1788572437.002181:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572437.002183:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639201152 00000100:00100000:3.0:1788572437.002185:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639201152 00000100:00100000:3.0:1788572437.002195:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15509 00000100:00100000:3.0:1788572437.002199:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875449639200512:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788572437.002206:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639200384 00000100:00100000:1.0:1788572437.002209:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639200384 00010000:00020000:3.0:1788572437.002218:0:6551:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572437.002230:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:1.0:1788572437.002234:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875449639200384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572437.002244:0:6556:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572437.002248:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875449639200512:12345-0@lo:38:kworker.0 Request processed in 48us (138us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572437.002254:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15509 00000100:00100000:1.0:1788572437.002265:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875449639200384:12345-0@lo:38:kworker.0 Request processed in 30us (195us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572437.002265:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15510 00000100:00100000:3.0:1788572437.002269:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875449639200768:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788572437.002270:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00010000:00020000:3.0:1788572437.002279:0:6551:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572437.002288:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15511 00000100:00100000:1.0:1788572437.002292:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875449639201152:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788572437.002299:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875449639200768:12345-0@lo:38:kworker.0 Request processed in 29us (156us total) trans 0 rc -19/-19 00010000:00020000:1.0:1788572437.002301:0:6552:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572437.002304:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15510 00000100:00100000:1.0:1788572437.002321:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1875449639201152:12345-0@lo:38:kworker.0 Request processed in 28us (140us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572437.002327:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15511 00000100:00100000:3.0:1788572437.002335:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639201280:0@lo:400:kworker.0 00000100:00080000:3.0:1788572437.002354:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572437.002358:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572437.002361:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639200384:0@lo:38:kworker.0 00000100:00080000:3.0:1788572437.002367:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572437.002370:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572437.002372:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639200512:0@lo:38:kworker.0 00000100:00080000:3.0:1788572437.002379:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572437.002382:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572437.002385:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639200768:0@lo:38:kworker.0 00000100:00080000:3.0:1788572437.002391:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572437.002394:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572437.002396:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639201152:0@lo:38:kworker.0 00000100:00080000:1.0:1788572437.002427:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788572437.188571:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572438.212439:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572439.044842:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572439.044877:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639201408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572439.044984:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572439.053757:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639201408 00000100:00100000:0.0:1788572439.053778:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639201408 00000100:00100000:3.0:1788572439.063601:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:3.0:1788572439.063626:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639201408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572439.063683:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572439.063810:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639201408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 194us (18826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572439.063821:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1788572439.064773:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639201408:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788572439.065237:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572439.235800:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788572439.456511:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.13@tcp portal 26 match 1875449616257920 offset 0 length 224: 4 00000100:00100000:1.0:1788572439.456638:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572439.456963:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616258048 00000100:00100000:3.0:1788572439.456977:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616258048 00000100:00100000:3.0:1788572439.457235:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15512 00000100:00100000:3.0:1788572439.457247:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2382:x1875449616258048:12345-192.168.202.13@tcp:38:kworker.0 00010000:00020000:3.0:1788572439.457281:0:6551:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788572439.457370:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2382:x1875449616258048:12345-192.168.202.13@tcp:38:kworker.0 Request processed in 123us (733us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788572439.457378:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15512 00000100:00100000:3.0:1788572439.457433:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572439.457544:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616258176 00000100:00100000:3.0:1788572439.457549:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616258176 00000100:00100000:3.0:1788572439.458248:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4691 00000100:00100000:3.0:1788572439.458263:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616258176:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572439.458337:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616258176:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 78us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572439.458345:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4691 00000100:00080000:2.0:1788572439.463910:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572439.557711:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639201536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572439.557822:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572439.558047:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639201536 00000100:00100000:1.0:1788572439.558344:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639201536 00000100:00100000:1.0:1788572439.559716:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933 00000100:00100000:1.0:1788572439.559738:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639201536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572439.559785:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572439.559891:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639201536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572439.559899:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933 00000100:00100000:1.0:1788572439.559977:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639201536:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788572439.573285:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572440.259255:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1788572440.571232:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.202.13@tcp portal 26 match 1875449616258304 offset 0 length 520: 4 00000100:00100000:1.0:1788572440.576247:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572440.576402:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616258432 00000100:00100000:2.0:1788572440.576416:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616258432 00000100:00100000:2.0:1788572440.576555:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15513 00000100:00100000:2.0:1788572440.576566:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2382:x1875449616258432:12345-192.168.202.13@tcp:38:kworker.0 00010000:00020000:2.0:1788572440.576600:0:6552:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788572440.576699:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2382:x1875449616258432:12345-192.168.202.13@tcp:38:kworker.0 Request processed in 132us (466us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788572440.576711:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15513 00000100:00100000:1.0:1788572440.576808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572440.577360:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616258560 00000100:00100000:0.0:1788572440.577368:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616258560 00000100:00100000:0.0:1788572440.577434:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4692 00000100:00100000:0.0:1788572440.577445:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616258560:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572440.577516:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616258560:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 73us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572440.577524:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4692 00010000:00010000:2.0:1788572441.283368:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788572442.115315:0:84098:0:(pinger.c:229:ptlrpc_pinger_process_import()) d74e0a07-d05f-49a8-aa32-40b653992526->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572442.115326:0:84098:0:(pinger.c:247:ptlrpc_pinger_process_import()) d74e0a07-d05f-49a8-aa32-40b653992526->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788572442.115330:0:84098:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572442.115334:0:84098:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572442.115340:0:84098:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572442.115352:0:84098:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4354 00000100:00080000:2.0:1788572442.115357:0:84098:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788572442.115366:0:84098:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94e607732800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572442.115427:0:84098:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e633eea300 x1875449639201664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572442.115492:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639201664:0@lo:38:kworker.0 00000100:00100000:3.0:1788572442.115605:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572442.115721:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639201664 00000100:00100000:1.0:1788572442.115734:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639201664 00000100:00100000:1.0:1788572442.115786:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814 00000100:00100000:1.0:1788572442.115796:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1875449639201664:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572442.115826:0:6555:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788572442.119184:0:84098:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572442.119199:0:84098:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572442.119204:0:84098:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572442.119214:0:84098:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4354 00000100:00080000:2.0:1788572442.119220:0:84098:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788572442.119229:0:84098:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94e63c3af800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572442.119280:0:84098:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e633ee9880 x1875449639201792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788572442.121604:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639201792:0@lo:38:kworker.0 00000100:00100000:3.0:1788572442.121716:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572442.121829:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639201792 00000100:00100000:0.0:1788572442.121842:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639201792 00000100:00100000:0.0:1788572442.121897:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15514 00000100:00100000:0.0:1788572442.121907:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875449639201792:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572442.121936:0:10390:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572442.121990:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875449639201792:12345-0@lo:38:kworker.0 Request processed in 83us (274us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572442.121997:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15514 00000100:00100000:1.0:1788572442.122213:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1875449639201664:12345-0@lo:38:kworker.0 Request processed in 6414us (6605us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572442.122223:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814 00000100:00080000:3.0:1788572442.122737:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572442.122744:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572442.122748:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639201664:0@lo:38:kworker.0 00000100:00080000:3.0:1788572442.122780:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788572442.122785:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788572442.122787:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639201792:0@lo:38:kworker.0 00000100:00100000:3.0:1788572442.125631:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1788572442.126141:0:84098:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572442.126149:0:84098:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572442.126153:0:84098:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572442.126165:0:84098:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4354 00000100:00080000:2.0:1788572442.126172:0:84098:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788572442.126181:0:84098:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94e50222f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572442.126214:0:84098:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e633ee8a80 x1875449639202048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572442.126266:0:84098:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572442.126270:0:84098:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572442.126272:0:84098:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572442.126276:0:84098:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4354 00000100:00080000:2.0:1788572442.126279:0:84098:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788572442.126283:0:84098:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94e6056e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572442.126293:0:84098:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e633eea300 x1875449639202432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572442.126367:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639202048:0@lo:38:kworker.0 00000100:00100000:0.0:1788572442.126457:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572442.126497:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639202432:0@lo:38:kworker.0 00000100:00100000:0.0:1788572442.126521:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572442.126563:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639202048 00000100:00100000:0.0:1788572442.126573:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639202048 00000100:00100000:0.0:1788572442.126611:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639202432 00000100:00100000:0.0:1788572442.126613:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639202432 00000100:00100000:0.0:1788572442.126636:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15515 00000100:00100000:0.0:1788572442.126645:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875449639202048:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572442.126671:0:95742:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572442.126725:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875449639202048:12345-0@lo:38:kworker.0 Request processed in 79us (267us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572442.126732:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15515 00000100:00100000:0.0:1788572442.126752:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15516 00000100:00100000:0.0:1788572442.126756:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875449639202432:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788572442.126764:0:95742:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572442.126786:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3649:x1875449639202432:12345-0@lo:38:kworker.0 Request processed in 29us (265us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572442.126795:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15516 00000100:00080000:0.0:1788572442.126843:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572442.126848:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572442.126852:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639202048:0@lo:38:kworker.0 00000100:00080000:0.0:1788572442.126862:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788572442.126865:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788572442.126868:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639202432:0@lo:38:kworker.0 00000100:00100000:3.0:1788572442.129407:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639202560:0@lo:400:kworker.0 00000100:00100000:3.0:1788572442.129508:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572442.129563:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639201920:0@lo:400:kworker.0 00000100:00100000:3.0:1788572442.129593:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572442.129640:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639201920 00000100:00100000:3.0:1788572442.129651:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639201920 00000100:00100000:3.0:1788572442.129729:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:3.0:1788572442.129740:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639201920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572442.129807:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639201920:12345-0@lo:400:kworker.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572442.129814:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000100:00100000:3.0:1788572442.129867:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639201920:0@lo:400:kworker.0 00000100:00080000:0.0:1788572442.130175:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572442.130205:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639202560 00000100:00100000:0.0:1788572442.130212:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639202560 00000100:00100000:0.0:1788572442.130261:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4693 00000100:00100000:0.0:1788572442.130271:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639202560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572442.130324:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639202560:12345-0@lo:400:kworker.0 Request processed in 56us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572442.130330:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4693 00000100:00100000:0.0:1788572442.130366:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639202560:0@lo:400:kworker.0 00000100:00080000:3.0:1788572442.131181:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572442.131366:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639202176:0@lo:400:kworker.0 00000100:00100000:2.0:1788572442.131436:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572442.131477:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572442.131485:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639202304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572442.131512:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572442.131554:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639202176 00000100:00100000:2.0:1788572442.131561:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639202176 00000100:00100000:2.0:1788572442.131620:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4694 00000100:00100000:2.0:1788572442.131630:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639202176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572442.131681:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639202176:12345-0@lo:400:kworker.0 Request processed in 52us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572442.131687:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4694 00000100:00100000:2.0:1788572442.131712:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639202304 00000100:00100000:2.0:1788572442.131717:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639202304 00000100:00100000:2.0:1788572442.131748:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1788572442.131755:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639202304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572442.131790:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639202304:12345-0@lo:400:kworker.0 Request processed in 34us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572442.131796:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:2.0:1788572442.131835:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639202304:0@lo:400:kworker.0 00000100:00100000:2.0:1788572442.131847:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639202176:0@lo:400:kworker.0 00000100:00080000:2.0:1788572442.131882:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572442.131885:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788572442.310856:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572443.332111:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572444.165447:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639202688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572444.165562:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572444.165671:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639202688 00000100:00100000:1.0:1788572444.165682:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639202688 00000100:00100000:1.0:1788572444.165760:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934 00000100:00100000:1.0:1788572444.165772:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639202688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572444.165817:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572444.165888:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639202688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572444.165896:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934 00000100:00080000:1.0:1788572444.165924:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572444.165974:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639202688:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572444.356807:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572444.690024:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639202816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572444.690149:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572444.690263:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639202816 00000100:00100000:1.0:1788572444.690273:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639202816 00000100:00100000:1.0:1788572444.692883:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:1.0:1788572444.692907:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639202816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572444.692965:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572444.693111:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639202816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 211us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572444.693118:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00080000:1.0:1788572444.693151:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572444.693219:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639202816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572445.099976:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572445.100061:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616258688 00000100:00100000:0.0:1788572445.100076:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616258688 00000100:00080000:1.0:1788572445.100153:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572445.100180:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15517 00000100:00100000:0.0:1788572445.100194:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616258688:12345-192.168.202.13@tcp:17:kworker.0 00000100:00100000:0.0:1788572445.100341:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616258688:12345-192.168.202.13@tcp:17:kworker.0 Request processed in 150us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572445.100350:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15517 00010000:00010000:2.0:1788572445.382593:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572445.614921:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572445.615092:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616258816 00000100:00100000:0.0:1788572445.615110:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616258816 00000100:00100000:0.0:1788572445.615187:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15518 00000100:00100000:0.0:1788572445.615198:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2382:x1875449616258816:12345-192.168.202.13@tcp:38:kworker.0 00010000:00020000:0.0:1788572445.615235:0:9276:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.13@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788572445.615349:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2382:x1875449616258816:12345-192.168.202.13@tcp:38:kworker.0 Request processed in 149us (446us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788572445.615358:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15518 00000020:01000004:2.0:1788572445.640836:0:116810:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788572445.640847:0:116810:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788572445.640849:0:116810:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788572445.640992:0:116810:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff94e6184a3000 00000020:01000004:2.0:1788572445.642404:0:116810:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788572445.642430:0:116810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788572445.642456:0:116810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff94e5033c8000) 00000020:00000080:2.0:1788572445.642481:0:116810:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788572445.992818:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788572445.993266:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788572446.009864:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788572446.010402:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788572446.010615:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788572446.010878:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788572446.011236:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788572446.014070:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788572446.014541:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788572446.014802:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788572446.015243:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.015620:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.015832:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.016055:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.018752:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.019508:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788572446.020098:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.020404:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788572446.021100:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788572446.021401:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788572446.021655:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788572446.022476:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.022938:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.024725:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788572446.025330:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788572446.025666:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.025907:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.026524:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.026785:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788572446.027034:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788572446.027414:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788572446.027623:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788572446.027833:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788572446.032646:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788572446.039292:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.040590:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.040957:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.041425:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.042734:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.044103:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.045037:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.045442:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788572446.045661:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.045872:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.046170:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.046532:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788572446.046976:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788572446.057450:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788572446.057908:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788572446.059543:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788572446.060170:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788572446.060768:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788572446.064545:0:116810:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1788572446.065274:0:116810:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788572446.065541:0:116810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788572446.065550:0:116810:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788572446.065562:0:116810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb7edb52b833a068 00000020:01000004:2.0:1788572446.065571:0:116810:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788572446.065585:0:116810:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788572446.065592:0:116810:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94e6184a3000 from MGS 00000020:01000004:2.0:1788572446.065598:0:116810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788572446.065609:0:116810:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff94e5033c99c0) 00000020:00000080:2.0:1788572446.065620:0:116810:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788572446.065687:0:116810:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94e6184a3000 from MGS, refs=2 00080000:01000000:2.0:1788572446.065692:0:116810:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788572446.065696:0:116810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb7edb52b833a076 00010000:00010000:2.0:1788572446.065811:0:116810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1788572446.086549:0:116810:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788572446.091153:0:116814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788572446.091223:0:116810:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788572446.091311:0:116810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788572446.092237:0:116810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788572446.092594:0:116810:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788572446.092758:0:116810:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788572446.092764:0:116810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788572446.108752:0:116810:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788572446.108767:0:116810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788572446.109596:0:116810:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788572446.109606:0:116810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788572446.110128:0:116810:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788572446.110153:0:116810:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1788572446.110155:0:116810:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.113@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1788572446.110158:0:116810:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.113@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1788572446.110164:0:116810:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff94e60369c800 already not connected (conn 124, was 0): CONNECTING 00000100:00100000:0.0:1788572446.110170:0:116810:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788572446.211491:0:3649:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572436/real 1788572436] req@ffff94e6412b2680 x1875449639200256/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572446 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788572446.211524:0:3649:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94e6412b2680 x1875449639200256/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788572446 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572446.211552:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e60369c800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572446.211635:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788572446.211653:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d74e0a07-d05f-49a8-aa32-40b653992526:3649:1875449639200256:0@lo:250:kworker.0 10000000:01000000:2.0:1788572446.211737:0:116810:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1788572446.211756:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ae3aa00/0xdb7edb52b831cb30 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b831cb37 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.211767:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ae3aa00/0xdb7edb52b831cb30 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b831cb37 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.211773:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788572446.211792:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.211803:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ae3aa00/0xdb7edb52b831cb30 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b831cb37 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.211823:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ae3bc00/0xdb7edb52b831cace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b831cad5 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.211830:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ae3bc00/0xdb7edb52b831cace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b831cad5 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.211835:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572446.211839:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.211842:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ae3bc00/0xdb7edb52b831cace lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b831cad5 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.211850:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e637696600/0xdb7edb52b831cadc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b831cae3 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.211856:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e637696600/0xdb7edb52b831cadc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b831cae3 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.211861:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572446.211864:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.211868:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e637696600/0xdb7edb52b831cadc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b831cae3 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.211877:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63af8c400/0xdb7edb52b831caf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b831caff expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.211882:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63af8c400/0xdb7edb52b831caf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b831caff expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.211887:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572446.211890:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.211893:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63af8c400/0xdb7edb52b831caf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b831caff expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.211901:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ade9c00/0xdb7edb52b831cb14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b831cb1b expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.211906:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ade9c00/0xdb7edb52b831cb14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b831cb1b expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.211911:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572446.211914:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.211918:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ade9c00/0xdb7edb52b831cb14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b831cb1b expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.211932:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ae3b400/0xdb7edb52b831cb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b831cb53 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.211937:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ae3b400/0xdb7edb52b831cb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b831cb53 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.211942:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572446.211945:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.211948:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ae3b400/0xdb7edb52b831cb4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b831cb53 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.211956:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e609745a00/0xdb7edb52b8334d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b8334d3a expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.211962:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e609745a00/0xdb7edb52b8334d33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b8334d3a expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.211967:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572446.211969:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.211972:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e609745a00/0xdb7edb52b8334d33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b8334d3a expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.211982:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e609745400/0xdb7edb52b8334d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b8334d79 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.211988:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e609745400/0xdb7edb52b8334d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b8334d79 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.211993:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572446.211997:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.212001:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e609745400/0xdb7edb52b8334d72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b8334d79 expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.212073:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e637700c00/0xdb7edb52b8334dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b8334dcd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.212080:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e637700c00/0xdb7edb52b8334dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b8334dcd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.212085:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572446.212089:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.212092:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e637700c00/0xdb7edb52b8334dc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b8334dcd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.212113:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ae3be00/0xdb7edb52b831cb22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b831cb29 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.212120:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ae3be00/0xdb7edb52b831cb22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b831cb29 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.212125:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788572446.212128:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.212132:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ae3be00/0xdb7edb52b831cb22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b831cb29 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.212143:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a600/0xdb7edb52b831caea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b831caf1 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.212150:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a600/0xdb7edb52b831caea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b831caf1 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.212160:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788572446.212164:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.212167:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ae3a600/0xdb7edb52b831caea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b831caf1 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.212175:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e63ae3b000/0xdb7edb52b831cb3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b831cb45 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.212180:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e63ae3b000/0xdb7edb52b831cb3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b831cb45 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.212185:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788572446.212188:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.212191:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e63ae3b000/0xdb7edb52b831cb3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b831cb45 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572446.212198:0:116810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e609744000/0xdb7edb52b8334d64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xdb7edb52b8334d6b expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788572446.212204:0:116810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e609744000/0xdb7edb52b8334d64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xdb7edb52b8334d6b expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572446.212208:0:116810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788572446.212211:0:116810:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788572446.212214:0:116810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e609744000/0xdb7edb52b8334d64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xdb7edb52b8334d6b expref: -99 pid: 114774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788572446.212229:0:116810:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff94e60369c800 already not connected (conn 124, was 0): DISCONN 00000100:00080000:2.0:1788572446.212235:0:116810:0:(import.c:65:import_set_state_nolock()) ffff94e60369c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572446.212241:0:116810:0:(import.c:545:import_select_connection()) MGC192.168.202.113@tcp: connect to NID 0@lo last attempt 4354 00000100:00080000:2.0:1788572446.212246:0:116810:0:(import.c:630:import_select_connection()) MGC192.168.202.113@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788572446.212252:0:116810:0:(import.c:665:import_select_connection()) MGC192.168.202.113@tcp: import ffff94e60369c800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572446.212297:0:116810:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e63aeb1c00 x1875449639202944/t0(0) o250->MGC192.168.202.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572446.212321:0:116810:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788572446.213156:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d74e0a07-d05f-49a8-aa32-40b653992526:3649:1875449639202944:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788572446.213231:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.214437:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639202944 00000100:00100000:2.0:1788572446.214450:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639202944 00000100:00100000:2.0:1788572446.214494:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788572446.214502:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3649:x1875449639202944:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788572446.214529:0:116815:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d74e0a07-d05f-49a8-aa32-40b653992526@0@lo t0 exp 0000000000000000 cur 4363 last 0 00000020:00000080:2.0:1788572446.214558:0:116815:0:(genops.c:1385:class_connect()) connect: client d74e0a07-d05f-49a8-aa32-40b653992526, cookie 0xdb7edb52b833a07d 00000100:00080000:2.0:1788572446.214705:0:116815:0:(import.c:65:import_set_state_nolock()) ffff94e633e0a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572446.214780:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+5:3649:x1875449639202944:12345-0@lo:250:mount.lustre.0 Request processed in 276us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.214788:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788572446.215093:0:3649:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.113@tcp: committing for last_committed 0 gen 52 00000100:00080000:1.0:1788572446.215244:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.113@tcp: connect to target with instance 0 00000100:00080000:1.0:1788572446.215255:0:3649:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788572446.215260:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788572446.215264:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e60369c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788572446.215266:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788572446.215563:0:84098:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572446.215568:0:84098:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572446.215571:0:84098:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572446.215576:0:84098:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4359 00000100:00080000:0.0:1788572446.215580:0:84098:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572446.215585:0:84098:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94e607732800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572446.215605:0:84098:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b1180 x1875449639203200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572446.215619:0:84098:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572446.215621:0:84098:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572446.215623:0:84098:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572446.215626:0:84098:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4359 00000100:00080000:0.0:1788572446.215628:0:84098:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572446.215631:0:84098:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94e63c3af800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572446.215642:0:84098:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b3b80 x1875449639203328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572446.215668:0:84098:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572446.215672:0:84098:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572446.215673:0:84098:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572446.215677:0:84098:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4359 00000100:00080000:0.0:1788572446.215679:0:84098:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572446.215683:0:84098:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94e50222f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572446.215696:0:84098:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b1880 x1875449639203584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572446.215717:0:84098:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788572446.215721:0:84098:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788572446.215722:0:84098:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788572446.215725:0:84098:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4359 00000100:00080000:0.0:1788572446.215727:0:84098:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788572446.215730:0:84098:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94e6056e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572446.215742:0:84098:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e6412b2680 x1875449639203968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788572446.215778:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639203456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572446.215823:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.215855:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572446.215861:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639203712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572446.215885:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.215920:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639203456 00000100:00100000:0.0:1788572446.215925:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639203456 00000100:00100000:0.0:1788572446.215976:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:0.0:1788572446.215984:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639203456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572446.216072:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639203456:12345-0@lo:400:kworker.0 Request processed in 89us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.216079:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:0.0:1788572446.216113:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639203712 00000100:00100000:0.0:1788572446.216117:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639203712 00000100:00100000:0.0:1788572446.216146:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4695 00000100:00100000:0.0:1788572446.216152:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639203712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572446.216184:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639203712:12345-0@lo:400:kworker.0 Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.216190:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4695 00000100:00100000:0.0:1788572446.216228:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639203712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572446.216239:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639203456:0@lo:400:kworker.0 00000100:00100000:2.0:1788572446.216564:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639203072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572446.216600:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.216626:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639204096:0@lo:400:kworker.0 00000100:00100000:2.0:1788572446.216648:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.216666:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572446.216672:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639203840:0@lo:400:kworker.0 00000100:00100000:2.0:1788572446.216691:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.216716:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639203840 00000100:00100000:2.0:1788572446.216720:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639203840 00000100:00100000:2.0:1788572446.216747:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:2.0:1788572446.216754:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639203840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572446.216790:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639203840:12345-0@lo:400:kworker.0 Request processed in 36us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.216796:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00100000:2.0:1788572446.216825:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639203840:0@lo:400:kworker.0 00000100:00080000:2.0:1788572446.218706:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572446.218718:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572446.218722:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572446.219765:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639204096 00000100:00100000:3.0:1788572446.219777:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639204096 00000100:00100000:3.0:1788572446.219871:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4696 00000100:00100000:3.0:1788572446.219881:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639204096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572446.219982:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639204096:12345-0@lo:400:kworker.0 Request processed in 102us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.219989:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4696 00000100:00100000:3.0:1788572446.220081:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639203072 00000100:00100000:3.0:1788572446.220085:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639203072 00000100:00100000:3.0:1788572446.220111:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788572446.220117:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+5:3651:x1875449639203072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572446.220149:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+5:3651:x1875449639203072:12345-0@lo:400:kworker.0 Request processed in 33us (3548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.220156:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788572446.220443:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572446.220481:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639203072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572446.220503:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639204096:0@lo:400:kworker.0 00000100:00080000:3.0:1788572446.220627:0:116810:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1788572446.220638:0:116810:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788572446.220676:0:116810:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788572446.220682:0:116810:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788572446.220785:0:116810:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788572446.220826:0:116810:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.113@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788572446.220830:0:116810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788572446.220832:0:116810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788572446.220833:0:116810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572446.220834:0:116810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572446.220836:0:116810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572446.220837:0:116810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572446.220838:0:116810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788572446.220839:0:116810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788572446.220841:0:116810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572446.220842:0:116810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788572446.220845:0:116810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788572446.220847:0:116810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788572446.220848:0:116810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788572446.220850:0:116810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572446.220851:0:116810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572446.220852:0:116810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572446.220853:0:116810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572446.220854:0:116810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788572446.220855:0:116810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788572446.220856:0:116810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572446.220857:0:116810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788572446.220880:0:116810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788572446.220896:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639204224:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788572446.220939:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.220977:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e50468b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572446.221069:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639204224 00000100:00100000:2.0:1788572446.221074:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639204224 00000100:00100000:2.0:1788572446.221114:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788572446.221121:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+5:116810:x1875449639204224:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788572446.221160:0:116817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788572446.221163:0:116817:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788572446.221166:0:116817:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788572446.221351:0:116819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788572446.221422:0:116817:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 208 20000000:01000000:2.0:1788572446.223246:0:116820:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788572446.223254:0:116820:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788572446.223256:0:116820:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788572446.223259:0:116820:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788572446.223615:0:116820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788572446.223880:0:116817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788572446.223891:0:116817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788572446.225951:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+5:116810:x1875449639204224:12345-0@lo:253:mount.lustre.0 Request processed in 4821us (5002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.225974:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788572446.226263:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639204224:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788572446.226281:0:116810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788572446.226295:0:116810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788572446.226297:0:116810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788572446.226298:0:116810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572446.226299:0:116810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572446.226302:0:116810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572446.226308:0:116810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572446.226309:0:116810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788572446.226311:0:116810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788572446.226312:0:116810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572446.226313:0:116810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788572446.226335:0:116810:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94e6184a3000 from lustre-MDT0000 10000000:01000000:3.0:1788572446.226367:0:116810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788572446.226370:0:116810:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788572446.226380:0:116810:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94e6184a3000 10000000:01000000:3.0:1788572446.226384:0:116810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788572446.226390:0:116810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94e6184a3000 10000000:01000000:3.0:1788572446.226392:0:116810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788572446.226396:0:116810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94e6184a3000 from 1 10000000:01000000:3.0:1788572446.226399:0:116810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788572446.226440:0:116810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8200/0xdb7edb52b833a084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.226451:0:116810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8200/0xdb7edb52b833a084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.226460:0:116810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8200/0xdb7edb52b833a084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.226479:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639204352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572446.226517:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.226552:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e50468b240 going to sleep for 11 seconds 00000100:00080000:1.0:1788572446.226756:0:3649:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788572446.226766:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d74e0a07-d05f-49a8-aa32-40b653992526:3649:1875449639202944:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788572446.226789:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639203200:0@lo:38:kworker.0 00000100:00100000:1.0:1788572446.226824:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.226854:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639203200 00000100:00100000:1.0:1788572446.226860:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639203200 00000100:00100000:1.0:1788572446.226890:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:1.0:1788572446.226897:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875449639203200:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572446.226917:0:6556:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572446.226949:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875449639203200:12345-0@lo:38:kworker.0 Request processed in 52us (124us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572446.226955:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00080000:1.0:1788572446.226988:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572446.226992:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572446.226995:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639203200:0@lo:38:kworker.0 00000100:00100000:1.0:1788572446.227017:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639203328:0@lo:38:kworker.0 00000100:00100000:1.0:1788572446.227235:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.227267:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639203328 00000100:00100000:1.0:1788572446.227270:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639203328 00000020:01000000:0.0:1788572446.227453:0:84098:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.202.113@tcp 10000000:01000000:0.0:1788572446.227468:0:84098:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1788572446.227471:0:84098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788572446.227473:0:84098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788572446.227474:0:84098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572446.227475:0:84098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572446.227476:0:84098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572446.227477:0:84098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572446.227479:0:84098:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788572446.227480:0:84098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572446.227481:0:84098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788572446.227512:0:84098:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788572446.227518:0:84098:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1788572446.227520:0:84098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788572446.227521:0:84098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788572446.227523:0:84098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572446.227524:0:84098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572446.227525:0:84098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572446.227526:0:84098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572446.227527:0:84098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572446.227528:0:84098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572446.227529:0:84098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788572446.227540:0:84098:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788572446.227545:0:84098:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1788572446.227547:0:84098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788572446.227548:0:84098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788572446.227549:0:84098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788572446.227550:0:84098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788572446.227551:0:84098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788572446.227552:0:84098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788572446.227553:0:84098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788572446.227554:0:84098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788572446.227555:0:84098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788572446.227576:0:84098:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1788572446.227635:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639204736:0@lo:253:kworker.0 00000100:00100000:0.0:1788572446.227673:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.227715:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639204608:0@lo:253:kworker.0 00000100:00100000:0.0:1788572446.227745:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.227762:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572446.227767:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639204480:0@lo:253:kworker.0 00000100:00100000:0.0:1788572446.227790:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.227812:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639204352 00000100:00100000:0.0:1788572446.227816:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639204352 00000100:00100000:0.0:1788572446.227840:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639204736 00000100:00100000:0.0:1788572446.227843:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639204736 00000100:00100000:0.0:1788572446.227853:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639204608 00000100:00100000:0.0:1788572446.227856:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639204608 00000100:00100000:0.0:1788572446.227864:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639204480 00000100:00100000:0.0:1788572446.227866:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639204480 00000100:00100000:0.0:1788572446.227876:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788572446.227883:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+8:116810:x1875449639204352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572446.227897:0:116817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572446.227917:0:116817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ac9c400/0xdb7edb52b833a08b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a084 expref: -99 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.227946:0:116817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ac9c400/0xdb7edb52b833a08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a084 expref: 9 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.227956:0:116817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ac9c400/0xdb7edb52b833a08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a084 expref: 9 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.227965:0:116817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ac9c400, rc 0) 00000100:00100000:0.0:1788572446.227998:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+9:116810:x1875449639204352:12345-0@lo:101:mount.lustre.0 Request processed in 116us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.228026:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788572446.228249:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15519 00000100:00100000:1.0:1788572446.228254:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639203328:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572446.228269:0:9276:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572446.229445:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639203328:12345-0@lo:38:kworker.0 Request processed in 1183us (2394us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572446.229458:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15519 00000100:00080000:1.0:1788572446.229521:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572446.229526:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572446.229530:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639203328:0@lo:38:kworker.0 00000100:00100000:1.0:1788572446.229540:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639203584:0@lo:38:kworker.0 00000100:00100000:1.0:1788572446.229576:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.229611:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639203584 00000100:00100000:1.0:1788572446.229616:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639203584 00000100:00100000:1.0:1788572446.229648:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15520 00000100:00100000:1.0:1788572446.229652:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875449639203584:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572446.229670:0:6550:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572446.229700:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875449639203584:12345-0@lo:38:kworker.0 Request processed in 47us (124us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572446.229706:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15520 00000100:00080000:1.0:1788572446.229728:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572446.229732:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572446.229735:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639203584:0@lo:38:kworker.0 00000100:00100000:1.0:1788572446.229742:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639203968:0@lo:38:kworker.0 00000100:00100000:1.0:1788572446.229768:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.229794:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639203968 00000100:00100000:1.0:1788572446.229797:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639203968 00000100:00100000:1.0:1788572446.229818:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15521 00000100:00100000:1.0:1788572446.229822:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875449639203968:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788572446.229833:0:10390:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788572446.229858:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875449639203968:12345-0@lo:38:kworker.0 Request processed in 35us (89us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788572446.229865:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15521 00000100:00080000:1.0:1788572446.229889:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572446.229893:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788572446.229896:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639203968:0@lo:38:kworker.0 00000100:00100000:1.0:1788572446.229955:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788572446.229965:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+8:3650:x1875449639204736:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788572446.229993:0:116818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788572446.230029:0:116818:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788572446.230213:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788572446.230223:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+8:3653:x1875449639204608:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788572446.230241:0:116817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1788572446.230565:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639204352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572446.230588:0:116810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8200/0xdb7edb52b833a084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a08b expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.230602:0:116810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8200/0xdb7edb52b833a084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a08b expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572446.230630:0:116810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788572446.230648:0:116810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8200/0xdb7edb52b833a084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a08b expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.230657:0:116810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8200/0xdb7edb52b833a084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a08b expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572446.230667:0:116810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788572446.230672:0:116810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788572446.230678:0:116810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94e6184a3000 10000000:01000000:3.0:1788572446.230681:0:116810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788572446.230685:0:116810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788572446.230688:0:116810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788572446.230716:0:116810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9c00/0xdb7edb52b833a092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.230723:0:116810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9c00/0xdb7edb52b833a092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.230731:0:116810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9c00/0xdb7edb52b833a092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.230747:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639204864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572446.230780:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.230815:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e50468b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.232496:0:116815:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788572446.232511:0:116815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1788572446.232887:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639204864 00000100:00100000:2.0:1788572446.232896:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639204864 00000100:00100000:0.0:1788572446.233078:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788572446.233090:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+9:3653:x1875449639204480:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788572446.233122:0:116821:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788572446.254394:0:116818:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788572446.254415:0:116818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788572446.255068:0:116819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788572446.255074:0:116819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788572446.255102:0:116819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94e61a3f8600/0xdb7edb52b833a099 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.255122:0:116819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e61a3f8600/0xdb7edb52b833a099 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788572446.255131:0:116819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000058450s 00010000:00010000:3.0:1788572446.255136:0:116819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94e61a3f8600/0xdb7edb52b833a099 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.255143:0:116819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94e61a3f8600/0xdb7edb52b833a099 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.255151:0:116819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94e61a3f8600/0xdb7edb52b833a099 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.255158:0:116819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94e61a3f8600/0xdb7edb52b833a099 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.255164:0:116819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572446.255168:0:116819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94e61a3f8600/0xdb7edb52b833a099 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.255175:0:116819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94e61a3f8600/0xdb7edb52b833a099 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.255189:0:116819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94e61a3f8600/0xdb7edb52b833a099 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.255197:0:116819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94e61a3f8600/0xdb7edb52b833a099 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.255204:0:116819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e61a3f8600/0xdb7edb52b833a099 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572446.255643:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+9:3650:x1875449639204736:12345-0@lo:253:kworker.0 Request processed in 25675us (27964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.255654:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788572446.255701:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788572446.255711:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+8:116810:x1875449639204864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788572446.255727:0:116818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572446.255741:0:116818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ac9cc00/0xdb7edb52b833a0a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a092 expref: -99 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.255763:0:116818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ac9cc00/0xdb7edb52b833a0a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a092 expref: 9 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.255773:0:116818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ac9cc00/0xdb7edb52b833a0a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a092 expref: 9 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.255779:0:116818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ac9cc00, rc 0) 00000100:00100000:0.0:1788572446.255822:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+9:116810:x1875449639204864:12345-0@lo:101:mount.lustre.0 Request processed in 113us (25041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.255827:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 20000000:01000000:2.0:1788572446.255963:0:116817:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788572446.256227:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639204864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572446.256249:0:116810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9c00/0xdb7edb52b833a092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a0a0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.256258:0:116810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9c00/0xdb7edb52b833a092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a0a0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572446.256367:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639204992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572446.256404:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.256443:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e606517480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572446.256609:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639204992 00000100:00100000:2.0:1788572446.256617:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639204992 00000100:00100000:2.0:1788572446.256649:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788572446.256655:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+9:116810:x1875449639204992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788572446.256776:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+10:116810:x1875449639204992:12345-0@lo:501:mount.lustre.0 Request processed in 120us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.256783:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000004:3.0:1788572446.256870:0:3650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788572446.256872:0:3650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788572446.256873:0:3650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572446.256875:0:3650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572446.256877:0:3650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572446.256878:0:3650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572446.256879:0:3650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788572446.256881:0:3650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572446.256883:0:3650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788572446.256886:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639204736:0@lo:253:kworker.0 00000100:00100000:1.0:1788572446.257160:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639204992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572446.257193:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639205120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572446.257240:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.257271:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e606517480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572446.257397:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639205120 00000100:00100000:2.0:1788572446.257402:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639205120 00000100:00100000:2.0:1788572446.257433:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788572446.257440:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+10:116810:x1875449639205120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572446.259426:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+10:116810:x1875449639205120:12345-0@lo:503:mount.lustre.0 Request processed in 1977us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.259440:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 20000000:01000000:2.0:1788572446.259697:0:116817:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572446.259713:0:116817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788572446.259889:0:116819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788572446.259894:0:116819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788572446.259916:0:116819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94e61a3f9200/0xdb7edb52b833a0a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.259932:0:116819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e61a3f9200/0xdb7edb52b833a0a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788572446.259941:0:116819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000058450s 00010000:00010000:3.0:1788572446.259946:0:116819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94e61a3f9200/0xdb7edb52b833a0a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.259952:0:116819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94e61a3f9200/0xdb7edb52b833a0a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.259959:0:116819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94e61a3f9200/0xdb7edb52b833a0a7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.259966:0:116819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94e61a3f9200/0xdb7edb52b833a0a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.259972:0:116819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f9200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572446.259977:0:116819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94e61a3f9200/0xdb7edb52b833a0a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.259985:0:116819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94e61a3f9200/0xdb7edb52b833a0a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.259998:0:116819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94e61a3f9200/0xdb7edb52b833a0a7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.260027:0:116819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94e61a3f9200/0xdb7edb52b833a0a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.260034:0:116819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e61a3f9200/0xdb7edb52b833a0a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572446.260204:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6414a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639205120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572446.260597:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+9:3653:x1875449639204608:12345-0@lo:253:kworker.0 Request processed in 30375us (32849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.260606:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 20000000:01000000:0.0:1788572446.261313:0:116821:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:2.0:1788572446.261597:0:3653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788572446.261600:0:3653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788572446.261602:0:3653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572446.261603:0:3653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572446.261605:0:3653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572446.261606:0:3653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572446.261608:0:3653:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788572446.261610:0:3653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572446.261611:0:3653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788572446.261616:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639204608:0@lo:253:kworker.0 00000100:00100000:2.0:1788572446.261726:0:116822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116822:1875449639205248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572446.261790:0:116822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.261820:0:116822:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e618bf3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.261943:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639205248 00000100:00100000:0.0:1788572446.261949:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639205248 00000100:00100000:0.0:1788572446.261993:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788572446.262027:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+9:116822:x1875449639205248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572446.262957:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+9:116822:x1875449639205248:12345-0@lo:502:llog_process_th.0 Request processed in 952us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.262966:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 20000000:01000000:2.0:1788572446.272177:0:116821:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788572446.272202:0:116821:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788572446.272493:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+8:3653:x1875449639204480:12345-0@lo:253:kworker.0 Request processed in 39401us (44696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.272506:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000004:1.0:1788572446.273452:0:3653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788572446.273457:0:3653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788572446.273459:0:3653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788572446.273460:0:3653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788572446.273461:0:3653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788572446.273463:0:3653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788572446.273464:0:3653:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788572446.273467:0:3653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788572446.273468:0:3653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788572446.273473:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639204480:0@lo:253:kworker.0 20000000:01000000:0.0:1788572446.273560:0:116819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788572446.273566:0:116819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788572446.273594:0:116819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94e63ac9c800/0xdb7edb52b833a0ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.273610:0:116819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ac9c800/0xdb7edb52b833a0ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788572446.273620:0:116819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000058450s 00010000:00010000:0.0:1788572446.273624:0:116819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94e63ac9c800/0xdb7edb52b833a0ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.273631:0:116819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94e63ac9c800/0xdb7edb52b833a0ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.273638:0:116819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94e63ac9c800/0xdb7edb52b833a0ae lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.273645:0:116819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94e63ac9c800/0xdb7edb52b833a0ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.273651:0:116819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63ac9c800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572446.273655:0:116819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94e63ac9c800/0xdb7edb52b833a0ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.273664:0:116819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94e63ac9c800/0xdb7edb52b833a0ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.273677:0:116819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94e63ac9c800/0xdb7edb52b833a0ae lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.273686:0:116819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94e63ac9c800/0xdb7edb52b833a0ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.273692:0:116819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e63ac9c800/0xdb7edb52b833a0ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.276407:0:116822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116822:1875449639205248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788572446.276466:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.276482:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.276484:0:116822:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788572446.276490:0:116822:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788572446.276494:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572446.276514:0:116822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff94e504b48000) 00000020:00000080:3.0:1788572446.276548:0:116822:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788572446.276555:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788572446.276652:0:116822:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788572446.276659:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb7edb52b833a0bc 00000020:00000080:3.0:1788572446.276915:0:116822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788572446.276920:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.276924:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.276925:0:116822:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788572446.276928:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.276932:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.276933:0:116822:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788572446.276936:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572446.276944:0:116822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff94e504b4cd40) 00000020:00000080:3.0:1788572446.276955:0:116822:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788572446.276958:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788572446.276960:0:116822:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788572446.276964:0:116822:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788572446.276971:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788572446.278275:0:116822:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94e6184a3000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788572446.278924:0:116822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff94e504b499c0) 00000020:00000080:3.0:1788572446.278949:0:116822:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788572446.279397:0:116822:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788572446.279408:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb7edb52b833a0d1 00000020:00000080:3.0:1788572446.279599:0:116822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788572446.279607:0:116822:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788572446.279612:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdb7edb52b833a0d8 00080000:01000000:3.0:1788572446.279618:0:116822:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788572446.279622:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb7edb52b833a0df 00010000:00010000:1.0:1788572446.403262:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572446.407540:0:116822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788572446.407699:0:116822:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 35eb2d60-2de0-4b00-9815-d5153edd0057 idx: 0 lr: 214748367202 srv lr: 219043332096 lx: 0 gen 16 00000001:00080000:2.0:1788572446.407744:0:116822:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 219043332096 lx: 0 gen 17 00000001:00000004:2.0:1788572446.407771:0:116822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 52, last_transno is 219043332096 00000001:00080000:2.0:1788572446.407880:0:116822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1788572446.407935:0:116822:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff94e618bf3600: xid 1875449616251904, transno 219043334908, client gen 16, slot idx 0 00000001:00080000:2.0:1788572446.407944:0:116822:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff94e618bf30c0: xid 1875449616251520, transno 219043334907, client gen 16, slot idx 1 00000001:00080000:2.0:1788572446.407948:0:116822:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff94e618bf3480: xid 1875449615414144, transno 219043332503, client gen 16, slot idx 2 00000020:00000080:2.0:1788572446.411414:0:116822:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff94e5033cb380) 00000020:00000080:2.0:1788572446.411442:0:116822:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788572446.411528:0:116822:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788572446.411535:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb7edb52b833a0fb 00000020:00000080:3.0:1788572446.412463:0:116822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788572446.431641:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdb7edb52b833a102 00000020:00000080:3.0:1788572446.432084:0:116822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788572446.432098:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.432105:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.432107:0:116822:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788572446.432110:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788572446.432112:0:116822:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788572446.432114:0:116822:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572446.432116:0:116822:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788572446.432117:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788572446.432119:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.432121:0:116822:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788572446.432123:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.432127:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.432129:0:116822:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788572446.432133:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788572446.432183:0:116822:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788572446.432195:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.432199:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.432200:0:116822:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788572446.432202:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.432206:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.432207:0:116822:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788572446.432209:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788572446.432215:0:116822:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:00000080:3.0:1788572446.432240:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788572446.432254:0:116822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff94e504b4b380) 00000020:00000080:3.0:1788572446.432274:0:116822:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788572446.432279:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788572446.432729:0:116822:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788572446.432736:0:116822:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788572446.432742:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb7edb52b833a110 00010000:00080000:3.0:1788572446.432772:0:116822:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94e607718800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:3.0:1788572446.441214:0:116822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1788572446.447917:0:116822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788572446.447934:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788572446.447975:0:116822:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788572446.447998:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb7edb52b833a117 00000100:00080000:0.0:1788572446.448041:0:116822:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788572446.448048:0:116822:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff94e607718800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:0.0:1788572446.448097:0:116822:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e633ee8700 x1875449639205376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788572446.448130:0:116822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788572446.448210:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572446.448213:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572446.448215:0:116822:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788572446.448218:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788572446.448220:0:116822:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788572446.448222:0:116822:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788572446.448224:0:116822:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788572446.448225:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788572446.448228:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572446.448229:0:116822:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788572446.448232:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788572446.448236:0:116822:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788572446.448239:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572446.448240:0:116822:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788572446.448244:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788572446.448247:0:116822:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:0.0:1788572446.448272:0:116822:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788572446.448275:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788572446.448300:0:116822:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff94e505620000) 00000020:00000080:0.0:1788572446.448319:0:116822:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1788572446.448324:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788572446.448388:0:116822:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788572446.448394:0:116822:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788572446.448400:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb7edb52b833a125 00010000:00080000:0.0:1788572446.448427:0:116822:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94e503039800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:0.0:1788572446.448624:0:116822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:0.0:1788572446.450521:0:116822:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788572446.450564:0:116822:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788572446.450794:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639205376:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572446.450873:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788572446.451277:0:116822:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 50, last_idx 51 00000100:00100000:3.0:1788572446.451322:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639205376 00000100:00100000:3.0:1788572446.451332:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639205376 00000100:00100000:3.0:1788572446.451364:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816 00000100:00100000:3.0:1788572446.451373:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6414a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1875449639205376:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788572446.451405:0:6555:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4363 last 0 00000020:00000080:3.0:1788572446.451440:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb7edb52b833a12c 00000004:00100000:3.0:1788572446.451467:0:6555:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788572446.451541:0:6555:0:(import.c:65:import_set_state_nolock()) ffff94e63ae1d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572446.451607:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6414a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875449639205376:12345-0@lo:38:llog_process_th.0 Request processed in 233us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.451619:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816 00000100:00100000:1.0:1788572446.451636:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572446.451645:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788572446.451652:0:3649:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788572446.451658:0:3649:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788572446.451660:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607718800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788572446.451679:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639205376:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572446.451938:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572446.451948:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639205504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572446.451982:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.452240:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639205504 00000100:00100000:1.0:1788572446.452245:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639205504 00000100:00100000:1.0:1788572446.452284:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:1.0:1788572446.452303:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639205504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572446.452330:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572446.452377:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639205504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.452383:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00000100:00100000:3.0:1788572446.452825:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639205504:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788572446.463409:0:116822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572446.463447:0:116822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].52, 64 off11520 00000040:00080000:2.0:1788572446.474692:0:116822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xd0:0x0].1, 64 off8256 00000040:00080000:2.0:1788572446.480333:0:116828:0:(llog.c:805:llog_process_thread()) index: 51, lh_last_idx: 52 synced_idx: 0 lgh_last_idx: 52 00000040:00080000:2.0:1788572446.480345:0:116828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xcc:0x0] at index 51 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788572446.486758:0:116822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788572446.486777:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788572446.486826:0:116822:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788572446.486851:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb7edb52b833a133 00000100:00080000:1.0:1788572446.486864:0:116822:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788572446.486870:0:116822:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94e503039800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:1.0:1788572446.486913:0:116822:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e60fe44000 x1875449639205632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788572446.486947:0:116822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788572446.487091:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788572446.487096:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572446.487098:0:116822:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788572446.487110:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788572446.487113:0:116822:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788572446.487115:0:116822:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788572446.487117:0:116822:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788572446.487118:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788572446.487120:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572446.487122:0:116822:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788572446.487125:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788572446.487129:0:116822:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788572446.487132:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788572446.487133:0:116822:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788572446.487136:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788572446.487140:0:116822:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.113@tcp to nid 0x20000c0a8ca71 (192.168.202.113@tcp) 00000020:01000000:1.0:1788572446.487166:0:116822:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788572446.487168:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788572446.487180:0:116822:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff94e62d258000) 00000020:00000080:1.0:1788572446.487196:0:116822:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788572446.487201:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788572446.487270:0:116822:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788572446.487277:0:116822:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788572446.487283:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb7edb52b833a141 00010000:00080000:1.0:1788572446.487326:0:116822:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94e618476000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:1.0:1788572446.487510:0:116822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1788572446.487590:0:116822:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788572446.487607:0:116822:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788572446.487848:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639205632:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788572446.487927:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.488036:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639205632 00000100:00100000:3.0:1788572446.488045:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639205632 00000100:00100000:3.0:1788572446.488099:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4444 00000100:00100000:3.0:1788572446.488106:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3649:x1875449639205632:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788572446.488133:0:43974:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4363 last 0 00000020:00000080:3.0:1788572446.488166:0:43974:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb7edb52b833a148 00002000:00100000:3.0:1788572446.488178:0:43974:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff94e63ae1b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788572446.488182:0:43974:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788572446.488185:0:43974:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788572446.488273:0:43974:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788572446.488299:0:43974:0:(import.c:65:import_set_state_nolock()) ffff94e63ae18000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572446.488375:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3649:x1875449639205632:12345-0@lo:8:llog_process_th.0 Request processed in 267us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.488383:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4444 00000100:00100000:1.0:1788572446.491820:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572446.491841:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788572446.491850:0:3649:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788572446.491857:0:3649:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788572446.491861:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e503039800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788572446.491887:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788572446.491896:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639205632:0@lo:8:llog_process_th.0 00000040:00080000:0.0:1788572446.493120:0:116822:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 50, last_idx 51 00000100:00100000:3.0:1788572446.495261:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639206016:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.495530:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.495586:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639206528:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.495611:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.495635:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788572446.495641:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639206144:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.495663:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.495680:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639206656:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.495704:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.495746:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639206016 00000100:00100000:3.0:1788572446.495755:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639206016 00000100:00100000:3.0:1788572446.495821:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639206528 00000100:00100000:3.0:1788572446.495824:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639206528 00000100:00100000:3.0:1788572446.495842:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639206144 00000100:00100000:3.0:1788572446.495845:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639206144 00000100:00100000:3.0:1788572446.495860:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639206656 00000100:00100000:3.0:1788572446.495863:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639206656 00000100:00100000:3.0:1788572446.495880:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4445 00000100:00100000:3.0:1788572446.495889:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449639206016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.495920:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2811 count 1 00000100:00100000:3.0:1788572446.496050:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449639206016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 161us (591us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.496644:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4445 00000100:00100000:0.0:1788572446.496789:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639205760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572446.496841:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.496864:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639206272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.496885:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.496902:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639206784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.496921:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.496940:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788572446.496946:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639205888:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.496967:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.496984:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639206400:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.497019:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.497055:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639206272 00000100:00100000:0.0:1788572446.497071:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639206272 00000100:00100000:1.0:1788572446.497153:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639205760 00000100:00100000:1.0:1788572446.497157:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639205760 00000100:00100000:1.0:1788572446.497186:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936 00000100:00100000:1.0:1788572446.497195:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449639205760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572446.497221:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572446.497264:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449639205760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.497271:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936 00000100:00100000:1.0:1788572446.497324:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639205760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572446.497379:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639206784 00000100:00100000:1.0:1788572446.497383:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639206784 00000100:00100000:2.0:1788572446.500125:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4446 00000100:00100000:2.0:1788572446.500175:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449639206528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.500225:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2815 count 1 00000100:00100000:2.0:1788572446.500377:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449639206528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 234us (4764us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.500386:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4446 00000100:00100000:2.0:1788572446.500414:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639205888 00000100:00100000:2.0:1788572446.500420:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639205888 00000100:00100000:2.0:1788572446.500470:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639206400 00000100:00100000:2.0:1788572446.500473:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639206400 00000100:00100000:2.0:1788572446.500494:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4447 00000100:00100000:2.0:1788572446.500501:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3650:x1875449639206144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.500515:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2812 count 1 00000100:00100000:2.0:1788572446.500562:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3650:x1875449639206144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 61us (4897us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.500568:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4447 00000100:00100000:2.0:1788572446.500581:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4448 00000100:00100000:2.0:1788572446.500588:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449639206656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.500600:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2816 count 1 00000100:00100000:2.0:1788572446.500642:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449639206656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55us (4936us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.500648:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4448 00000100:00100000:2.0:1788572446.500979:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4449 00000100:00100000:2.0:1788572446.500986:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449639205888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.500997:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2810 count 1 00000100:00100000:2.0:1788572446.501076:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449639205888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 89us (4108us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.501083:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4449 00000100:00100000:2.0:1788572446.501095:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4450 00000100:00100000:2.0:1788572446.501101:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449639206400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.501113:0:12091:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2814 count 1 00000100:00100000:2.0:1788572446.501152:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449639206400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51us (4148us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.501159:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4450 00000100:00080000:3.0:1788572446.508332:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788572446.508407:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493800, transno 0 00000004:00080000:3.0:1788572446.508418:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493800/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.508436:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639206144:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.508447:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493100, transno 0 00000004:00080000:3.0:1788572446.508449:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493100/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.508453:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639206656:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.508474:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb0000, transno 0 00000004:00080000:3.0:1788572446.508476:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63aeb0000/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.508480:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639206016:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.508487:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493b80, transno 0 00000004:00080000:3.0:1788572446.508490:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493b80/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.508493:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639206528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.508992:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4451 00000100:00100000:0.0:1788572446.509023:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449639206272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.509056:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2813 count 1 00000004:00080000:2.0:1788572446.509089:0:116828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 4 in flight, 4 done 00000100:00100000:0.0:1788572446.509188:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449639206272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 185us (12302us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.509196:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4451 00000100:00100000:0.0:1788572446.509242:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639207168:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.509279:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.509382:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572446.509388:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639207040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.509411:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.534649:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639207168 00000100:00100000:3.0:1788572446.534667:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639207168 00000100:00100000:3.0:1788572446.534750:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639207040 00000100:00100000:3.0:1788572446.534753:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639207040 00000100:00100000:3.0:1788572446.534776:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4452 00000100:00100000:3.0:1788572446.534785:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449639206784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.534821:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2817 count 1 00000100:00100000:3.0:1788572446.534959:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449639206784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 174us (38035us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.534966:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4452 00000100:00100000:3.0:1788572446.534987:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4453 00000100:00100000:3.0:1788572446.534994:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449639207168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.535024:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2820 count 1 00000100:00100000:3.0:1788572446.535096:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449639207168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 103us (25816us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.535102:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4453 00000100:00100000:3.0:1788572446.535116:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4454 00000100:00100000:3.0:1788572446.535122:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449639207040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.535135:0:17011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2819 count 1 00000100:00100000:3.0:1788572446.535189:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449639207040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 68us (25777us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.535195:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4454 00000100:00100000:3.0:1788572446.535755:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639206912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.535802:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.535836:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572446.535843:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639207296:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.535868:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.535896:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639206912 00000100:00100000:3.0:1788572446.535900:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639206912 00000100:00100000:3.0:1788572446.535926:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639207296 00000100:00100000:3.0:1788572446.535929:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639207296 00000100:00100000:3.0:1788572446.535945:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4455 00000100:00100000:3.0:1788572446.535951:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449639206912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.535967:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2818 count 1 00000100:00100000:3.0:1788572446.536034:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449639206912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 83us (232us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.536040:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4455 00000100:00100000:3.0:1788572446.536053:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4456 00000040:00080000:2.0:1788572446.536924:0:116822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572446.536959:0:116822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].52, 64 off11520 00000040:00080000:2.0:1788572446.537128:0:116822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xd2:0x0].1, 64 off8256 00000100:00100000:3.0:1788572446.537430:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449639207296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.537526:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2821 count 1 00000100:00100000:3.0:1788572446.537607:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449639207296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1546us (1737us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.537615:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4456 00000004:00080000:3.0:1788572446.537673:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618491880, transno 0 00000004:00080000:3.0:1788572446.537680:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618491880/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.537699:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639207296:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.537710:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493800, transno 0 00000004:00080000:3.0:1788572446.537713:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493800/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.537717:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639206912:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.537743:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e63aeb3480, transno 0 00000004:00080000:3.0:1788572446.537747:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e63aeb3480/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.537751:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639205888:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.537759:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618492300, transno 0 00000004:00080000:3.0:1788572446.537762:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618492300/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.537765:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639206400:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.537773:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490380, transno 0 00000004:00080000:3.0:1788572446.537776:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490380/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.537779:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639206272:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.537787:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490e00, transno 0 00000004:00080000:3.0:1788572446.537790:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490e00/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.537793:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639206784:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572446.539788:0:116828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 2 in progress, 2 in flight, 6 done 00000100:00100000:3.0:1788572446.539968:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639207424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.540660:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.540703:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639207936:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.540731:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.540760:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572446.540765:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639207808:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.540786:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.540820:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639207552:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.540841:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.540844:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639207424 00000100:00100000:0.0:1788572446.540852:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639207424 00000100:00100000:3.0:1788572446.540856:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639208064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.540872:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.540887:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572446.540892:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639207680:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.540909:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.540988:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639207936 00000100:00100000:2.0:1788572446.540992:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639207936 00000100:00100000:2.0:1788572446.541047:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639207808 00000100:00100000:2.0:1788572446.541051:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639207808 00000100:00100000:2.0:1788572446.541085:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639207552 00000100:00100000:2.0:1788572446.541088:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639207552 00000100:00100000:2.0:1788572446.541102:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639208064 00000100:00100000:2.0:1788572446.541104:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639208064 00000100:00100000:2.0:1788572446.541117:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639207680 00000100:00100000:2.0:1788572446.541120:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639207680 00000100:00100000:0.0:1788572446.541135:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4457 00000100:00100000:0.0:1788572446.541147:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3653:x1875449639207936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.541177:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2826 count 1 00000100:00100000:0.0:1788572446.541273:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3653:x1875449639207936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 129us (540us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.546954:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4458 00000100:00100000:2.0:1788572446.546987:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3653:x1875449639207808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.547045:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2825 count 1 00000100:00100000:2.0:1788572446.547355:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3653:x1875449639207808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 386us (6566us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.547363:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4458 00000100:00100000:2.0:1788572446.547395:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4459 00000100:00100000:2.0:1788572446.547403:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449639207552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.547416:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2823 count 1 00000100:00100000:2.0:1788572446.547663:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449639207552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 260us (6819us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.547671:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4459 00000100:00100000:2.0:1788572446.547686:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4460 00000100:00100000:2.0:1788572446.547694:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449639208064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.547708:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2827 count 1 00000100:00100000:2.0:1788572446.547753:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449639208064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 60us (6879us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.547759:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4460 00000100:00100000:2.0:1788572446.547770:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4461 00000100:00100000:2.0:1788572446.547777:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449639207680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.547788:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2824 count 1 00000100:00100000:2.0:1788572446.547826:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875449639207680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (6915us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.547832:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4461 00000004:00080000:3.0:1788572446.547974:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618492300, transno 0 00000004:00080000:3.0:1788572446.547982:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618492300/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.548014:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639207680:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.548027:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493800, transno 0 00000004:00080000:3.0:1788572446.548030:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493800/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.548034:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639207552:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.548041:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490a80, transno 0 00000004:00080000:3.0:1788572446.548043:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490a80/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.548047:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639208064:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572446.548562:0:116828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 5 in progress, 5 in flight, 3 done 00000100:00100000:3.0:1788572446.548639:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572446.548733:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639208192:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.548781:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.548826:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639208320:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.548849:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.548868:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572446.548873:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639208448:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.548893:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.548922:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639208192 00000100:00100000:3.0:1788572446.548928:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639208192 00000100:00100000:3.0:1788572446.548964:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639208320 00000100:00100000:3.0:1788572446.548967:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639208320 00000100:00100000:3.0:1788572446.548983:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639208448 00000100:00100000:3.0:1788572446.548985:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639208448 00000100:00100000:3.0:1788572446.549023:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4462 00000100:00100000:3.0:1788572446.549031:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449639208192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.549051:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2828 count 1 00000100:00100000:2.0:1788572446.549251:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4463 00000100:00100000:2.0:1788572446.549259:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449639208320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.549273:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2829 count 1 00000100:00100000:2.0:1788572446.549587:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449639208320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 328us (735us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.549594:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4463 00000100:00100000:2.0:1788572446.549611:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4464 00000100:00100000:2.0:1788572446.549618:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449639208448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.549631:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2830 count 1 00000100:00100000:2.0:1788572446.549670:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449639208448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53us (776us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.549676:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4464 00000004:00080000:2.0:1788572446.549705:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490a80, transno 0 00000004:00080000:2.0:1788572446.549710:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490a80/1, rc -2, transno 0 00000100:00100000:2.0:1788572446.549720:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639208448:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572446.549730:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493800, transno 0 00000004:00080000:2.0:1788572446.549732:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493800/1, rc -2, transno 0 00000100:00100000:2.0:1788572446.549736:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639208320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572446.549859:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639208576:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572446.549887:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.549907:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572446.549912:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639208704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572446.549934:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.549960:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639208576 00000100:00100000:2.0:1788572446.549964:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639208576 00000100:00100000:2.0:1788572446.549985:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639208704 00000100:00100000:2.0:1788572446.549988:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639208704 00000100:00100000:0.0:1788572446.549989:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4457 00000100:00100000:2.0:1788572446.550018:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4465 00000100:00100000:0.0:1788572446.550022:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4466 00000100:00100000:2.0:1788572446.550024:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449639208576:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.550029:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449639208704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.550036:0:43975:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2831 count 1 00002000:00080000:0.0:1788572446.550038:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2832 count 1 00000100:00100000:0.0:1788572446.550124:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449639208704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 96us (188us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.550130:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4466 00000004:00080000:0.0:1788572446.550247:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493100, transno 0 00000004:00080000:0.0:1788572446.550251:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493100/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.550261:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639207040:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572446.550270:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493b80, transno 0 00000004:00080000:0.0:1788572446.550273:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493b80/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.550276:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639207168:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572446.550306:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618493800, transno 0 00000004:00080000:0.0:1788572446.550309:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618493800/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.550313:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639208704:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572446.550331:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490380, transno 0 00000004:00080000:0.0:1788572446.550334:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490380/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.550337:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639207808:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572446.550345:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490e00, transno 0 00000004:00080000:0.0:1788572446.550347:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490e00/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.550350:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639207936:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572446.550406:0:116828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 3 in progress, 3 in flight, 5 done 00000100:00100000:0.0:1788572446.550483:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639209216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.550510:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.550528:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572446.550533:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639209088:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.550552:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.550574:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639209216 00000100:00100000:0.0:1788572446.550578:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639209216 00000100:00100000:0.0:1788572446.550599:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639209088 00000100:00100000:0.0:1788572446.550602:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639209088 00000100:00100000:0.0:1788572446.550617:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4467 00000100:00100000:0.0:1788572446.550623:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449639209216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.550636:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2836 count 1 00000100:00100000:0.0:1788572446.550673:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449639209216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51us (163us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.550674:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449639208192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1642us (1891us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.550680:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4467 00000100:00100000:3.0:1788572446.550684:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4462 00000100:00100000:0.0:1788572446.550694:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4468 00000100:00100000:0.0:1788572446.550699:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449639209088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.550867:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2835 count 1 00000100:00100000:0.0:1788572446.550908:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449639209088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 209us (355us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.550914:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4468 00000004:00080000:0.0:1788572446.550941:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0000, transno 0 00000004:00080000:0.0:1788572446.550944:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412b0000/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.550951:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639209088:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572446.550958:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b3100, transno 0 00000004:00080000:0.0:1788572446.550960:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412b3100/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.550963:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639209216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.550975:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639208832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.550997:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.551032:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639209344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.551070:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.551087:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572446.551092:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639208960:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.551125:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.551147:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639208832 00000100:00100000:0.0:1788572446.551151:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639208832 00000100:00100000:0.0:1788572446.551170:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639209344 00000100:00100000:0.0:1788572446.551172:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639209344 00000100:00100000:0.0:1788572446.551182:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639208960 00000100:00100000:0.0:1788572446.551185:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639208960 00000100:00100000:0.0:1788572446.551195:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4469 00000100:00100000:0.0:1788572446.551200:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449639208832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.551212:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2833 count 1 00000100:00100000:0.0:1788572446.551257:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3652:x1875449639208832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 56us (258us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.551266:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4469 00000100:00100000:0.0:1788572446.551277:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4470 00000100:00100000:0.0:1788572446.551283:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449639209344:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.551415:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4471 00000100:00100000:1.0:1788572446.551425:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449639208960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.551438:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2834 count 1 00000100:00100000:1.0:1788572446.551485:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449639208960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 62us (358us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.551491:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4471 00000004:00080000:1.0:1788572446.551544:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618492300, transno 0 00000004:00080000:1.0:1788572446.551548:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618492300/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.551553:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639208192:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572446.551627:0:116828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 5 in progress, 5 in flight, 3 done 00000100:00100000:1.0:1788572446.551682:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639209600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.551705:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.551722:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572446.551727:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639209728:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.551744:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.551763:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639209600 00000040:00080000:3.0:1788572446.551763:0:116830:0:(llog.c:805:llog_process_thread()) index: 51, lh_last_idx: 52 synced_idx: 0 lgh_last_idx: 52 00000100:00100000:1.0:1788572446.551767:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639209600 00000040:00080000:3.0:1788572446.551767:0:116830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xce:0x0] at index 51 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1788572446.551784:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639209728 00000100:00100000:1.0:1788572446.551786:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639209728 00000100:00100000:1.0:1788572446.551802:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4472 00000100:00100000:1.0:1788572446.551807:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449639209600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.551818:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2839 count 1 00000100:00100000:1.0:1788572446.551860:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:3650:x1875449639209600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52us (153us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.551865:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4472 00000100:00100000:1.0:1788572446.551878:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4473 00000100:00100000:1.0:1788572446.551883:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449639209728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.551893:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2840 count 1 00000040:00080000:3.0:1788572446.551919:0:116830:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 51, last_idx 52 00000100:00100000:1.0:1788572446.551927:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+9:3650:x1875449639209728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44us (182us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.551933:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4473 00000040:00080000:3.0:1788572446.551943:0:116830:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xce:0x0] at index 51 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1788572446.551954:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44e00, transno 0 00000004:00080000:1.0:1788572446.551957:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe44e00/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.551964:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639209728:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572446.551972:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47b80, transno 0 00000004:00080000:1.0:1788572446.551974:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe47b80/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.551977:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639209600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.551990:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639209472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.552028:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.552054:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639209472 00000100:00100000:1.0:1788572446.552057:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639209472 00000100:00100000:1.0:1788572446.552092:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4474 00000100:00100000:1.0:1788572446.552098:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3653:x1875449639209472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.552119:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2838 count 1 00000100:00100000:1.0:1788572446.552164:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3653:x1875449639209472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 66us (135us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.552169:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4474 00000004:00080000:1.0:1788572446.552191:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44000, transno 0 00000004:00080000:1.0:1788572446.552195:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe44000/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.552199:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639209472:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572446.552249:0:116828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 5 in progress, 5 in flight, 3 done 00002000:00080000:0.0:1788572446.552397:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2837 count 1 00000100:00100000:0.0:1788572446.552565:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449639209344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1281us (1503us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.552572:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4470 00000100:00100000:0.0:1788572446.552600:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572446.552609:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639210112:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.552634:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.552661:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639210112 00000100:00100000:0.0:1788572446.552665:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639210112 00000100:00100000:0.0:1788572446.552687:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4475 00000100:00100000:0.0:1788572446.552693:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449639210112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.552703:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2843 count 1 00000040:00080000:3.0:1788572446.552712:0:116830:0:(llog.c:805:llog_process_thread()) index: 52, lh_last_idx: 52 synced_idx: 52 lgh_last_idx: 52 00000040:00080000:3.0:1788572446.552716:0:116830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xd2:0x0] at index 52 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788572446.552746:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449639210112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53us (111us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.552752:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4475 00000100:00100000:2.0:1788572446.552772:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449639208576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2747us (2883us total) trans 0 rc -2/-2 00000004:00080000:0.0:1788572446.552776:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44000, transno 0 00000004:00080000:0.0:1788572446.552779:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe44000/1, rc -2, transno 0 00000100:00100000:2.0:1788572446.552779:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4465 00000004:00080000:1.0:1788572446.554659:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618490a80, transno 0 00000004:00080000:1.0:1788572446.554671:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618490a80/1, rc -2, transno 0 00000100:00100000:2.0:1788572446.554840:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4476 00000100:00100000:2.0:1788572446.554851:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449639207424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.554888:0:43974:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2822 count 1 00000100:00100000:2.0:1788572446.554998:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449639207424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 148us (14541us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.555025:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4476 00000100:00100000:1.0:1788572446.561545:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639208576:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.561587:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639209984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.561664:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.561702:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639209856:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572446.561715:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e618491880, transno 0 00000004:00080000:1.0:1788572446.561722:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e618491880/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.561726:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639207424:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572446.561731:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.561748:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639209984 00000100:00100000:1.0:1788572446.561755:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639209984 00000004:00080000:2.0:1788572446.561756:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b1f80, transno 0 00000004:00080000:2.0:1788572446.561759:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412b1f80/1, rc -2, transno 0 00000100:00100000:2.0:1788572446.561763:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639208960:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572446.561770:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0380, transno 0 00000004:00080000:2.0:1788572446.561772:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412b0380/1, rc -2, transno 0 00000100:00100000:2.0:1788572446.561776:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639208832:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788572446.561783:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0a80, transno 0 00000004:00080000:2.0:1788572446.561785:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412b0a80/1, rc -2, transno 0 00000100:00100000:2.0:1788572446.561789:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639209344:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.561801:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639209856 00000100:00100000:1.0:1788572446.561805:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639209856 00000100:00100000:1.0:1788572446.561834:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4477 00000100:00100000:3.0:1788572446.561840:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4478 00000100:00100000:1.0:1788572446.561843:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449639209984:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.561851:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449639209856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.561871:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2842 count 1 00002000:00080000:3.0:1788572446.561871:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2841 count 1 00000100:00100000:1.0:1788572446.561952:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449639209984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 108us (285us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.561952:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1875449639209856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 103us (217us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.561959:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4477 00000004:00080000:1.0:1788572446.562115:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47b80, transno 0 00000004:00080000:1.0:1788572446.562119:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe47b80/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.562123:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639209984:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572446.562249:0:116828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 1 in progress, 1 in flight, 7 done 00000100:00100000:2.0:1788572446.562546:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572446.568544:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639210112:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.568591:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572446.568601:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639210624:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.568673:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.568730:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639210624 00000100:00100000:0.0:1788572446.568737:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639210624 00000100:00100000:3.0:1788572446.569040:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4478 00000100:00100000:3.0:1788572446.569095:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639210368:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.569124:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788572446.569160:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44e00, transno 0 00000004:00080000:3.0:1788572446.569166:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe44e00/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.569171:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639209856:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.569181:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572446.569187:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639210496:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.569210:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.569238:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639210368 00000100:00100000:3.0:1788572446.569243:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639210368 00000100:00100000:3.0:1788572446.569274:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639210496 00000100:00100000:3.0:1788572446.569277:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639210496 00000100:00100000:3.0:1788572446.569292:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4479 00000100:00100000:3.0:1788572446.569302:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449639210368:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788572446.570452:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4480 00000100:00100000:0.0:1788572446.570471:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449639210496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.570516:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2846 count 1 00000100:00100000:0.0:1788572446.570650:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449639210496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 187us (1438us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.570657:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4480 00000100:00100000:0.0:1788572446.570675:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4481 00000100:00100000:0.0:1788572446.570683:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449639210624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.570697:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2847 count 1 00000100:00100000:0.0:1788572446.570744:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449639210624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 61us (2071us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.570750:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4481 00000004:00080000:0.0:1788572446.570808:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44a80, transno 0 00000004:00080000:0.0:1788572446.570813:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe44a80/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.570819:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639210624:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572446.570840:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe45c00, transno 0 00000004:00080000:0.0:1788572446.570842:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe45c00/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.570846:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639210496:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.570848:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2845 count 1 00000100:00100000:3.0:1788572446.570906:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639210368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1605us (1781us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.570913:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4479 00000100:00100000:2.0:1788572446.570998:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639210240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572446.571057:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.571199:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639210240 00000100:00100000:0.0:1788572446.571206:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639210240 00000100:00100000:0.0:1788572446.571244:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4482 00000100:00100000:0.0:1788572446.571251:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639210240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.571262:0:43965:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2844 count 1 00000100:00100000:0.0:1788572446.571318:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639210240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 67us (260us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.571324:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4482 00000004:00080000:0.0:1788572446.571348:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46680, transno 0 00000004:00080000:0.0:1788572446.571351:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe46680/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.571355:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639210368:0@lo:6:osp-syn-0-0.0 00000020:00000080:3.0:1788572446.571575:0:116822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788572446.571591:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788572446.571640:0:116822:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788572446.571668:0:116822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb7edb52b833a14f 00000100:00080000:3.0:1788572446.571675:0:116822:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572446.571681:0:116822:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94e618476000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788572446.571712:0:116822:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e62dac7100 x1875449639210752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572446.571743:0:116822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788572446.571796:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.571800:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.571802:0:116822:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788572446.571805:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.571808:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.571810:0:116822:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788572446.571812:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788572446.571814:0:116822:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788572446.571816:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.571819:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.571820:0:116822:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788572446.571822:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788572446.571824:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.571826:0:116822:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788572446.571829:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788572446.571854:0:116822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116822:1875449639210880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572446.571901:0:116822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.571925:0:116822:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d9c19c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788572446.571965:0:116828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 1 in progress, 1 in flight, 4 done 00000100:00100000:1.0:1788572446.572080:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639211264:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.572111:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639211136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.572118:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.572136:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639211776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.572136:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.572166:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639210880 00000100:00100000:1.0:1788572446.572170:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639210880 00000100:00100000:1.0:1788572446.572201:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788572446.572207:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+8:116822:x1875449639210880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572446.572334:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639210752:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788572446.572335:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639211264 00000100:00100000:2.0:1788572446.572339:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639211264 00000100:00100000:2.0:1788572446.572369:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639211136 00000100:00100000:2.0:1788572446.572372:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639211136 00000100:00100000:2.0:1788572446.572390:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4483 00000100:00100000:2.0:1788572446.572397:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449639211264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788572446.572413:0:8663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2850 count 1 00000100:00100000:1.0:1788572446.574823:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+8:116822:x1875449639210880:12345-0@lo:502:llog_process_th.0 Request processed in 2604us (2911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.574838:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788572446.574921:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.574981:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639211776 00000100:00100000:1.0:1788572446.574989:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639211776 00000100:00100000:3.0:1788572446.576545:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639211648:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.576597:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.576663:0:116822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116822:1875449639210880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788572446.576702:0:116822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788572446.576708:0:116822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788572446.576711:0:116822:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788572446.576715:0:116822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1788572446.577017:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.580740:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639211648 00000100:00100000:1.0:1788572446.580758:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639211648 00000100:00100000:1.0:1788572446.580828:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639210752 00000100:00100000:1.0:1788572446.580831:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639210752 00000100:00100000:1.0:1788572446.580860:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4484 00000100:00100000:1.0:1788572446.580870:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449639211136:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.580872:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4485 00000100:00100000:3.0:1788572446.580886:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3653:x1875449639211776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.580904:0:43969:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2849 count 1 00002000:00080000:3.0:1788572446.580904:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2854 count 1 00000100:00100000:0.0:1788572446.581121:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4486 00000100:00100000:0.0:1788572446.581131:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449639211648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.581144:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2853 count 1 00000100:00100000:1.0:1788572446.587498:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449639211136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6617us (15349us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.587516:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4484 00000100:00100000:1.0:1788572446.587561:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4487 00000100:00100000:1.0:1788572446.587568:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3649:x1875449639210752:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788572446.587605:0:43969:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 4363 last 0 00000020:00000080:1.0:1788572446.587639:0:43969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb7edb52b833a156 00002000:00100000:1.0:1788572446.587654:0:43969:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94e618473000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788572446.587658:0:43969:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788572446.587661:0:43969:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788572446.587740:0:43969:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788572446.587767:0:43969:0:(import.c:65:import_set_state_nolock()) ffff94e618471800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572446.587826:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3649:x1875449639210752:12345-0@lo:8:llog_process_th.0 Request processed in 258us (10822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.587833:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4487 00000020:01000000:1.0:1788572446.587868:0:116810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788572446.587905:0:116810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788572446.587923:0:116810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9c00/0xdb7edb52b833a092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a0a0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.587934:0:116810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9c00/0xdb7edb52b833a092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a0a0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572446.587943:0:116810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94e6184a3000 from 1 10000000:01000000:1.0:1788572446.587946:0:116810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788572446.587977:0:116810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.587985:0:116810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.587994:0:116810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572446.588034:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639211904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572446.589289:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3653:x1875449639211776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8400us (14359us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.589302:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4485 00000100:00100000:1.0:1788572446.590285:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.590348:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61ebbe900 going to sleep for 11 seconds 00000004:00080000:1.0:1788572446.590410:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46d80, transno 0 00000004:00080000:1.0:1788572446.590416:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe46d80/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.590428:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639211776:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572446.590455:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44a80, transno 0 00000004:00080000:1.0:1788572446.590458:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe44a80/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.590462:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639211136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.590693:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639211008:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.590724:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.590744:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639211520:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.590762:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.590779:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639212160:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.590798:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.590818:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788572446.590824:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639211392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.590844:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.590869:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639212032:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.590888:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.590928:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639211904 00000100:00100000:1.0:1788572446.590934:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639211904 00000100:00100000:1.0:1788572446.590980:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788572446.590988:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+8:116810:x1875449639211904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572446.591029:0:116818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572446.591053:0:116818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e641589a00/0xdb7edb52b833a164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a15d expref: -99 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.591094:0:116818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e641589a00/0xdb7edb52b833a164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a15d expref: 9 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.592467:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639211008 00000100:00100000:3.0:1788572446.592481:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639211008 00000100:00100000:3.0:1788572446.592525:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639211520 00000100:00100000:3.0:1788572446.592528:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639211520 00000100:00100000:3.0:1788572446.592545:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639212160 00000100:00100000:3.0:1788572446.592548:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639212160 00000100:00100000:3.0:1788572446.592565:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639211392 00000100:00100000:3.0:1788572446.592568:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639211392 00000100:00100000:3.0:1788572446.592583:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639212032 00000100:00100000:3.0:1788572446.592586:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639212032 00000100:00100000:3.0:1788572446.592604:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4488 00000100:00100000:3.0:1788572446.592612:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3651:x1875449639211008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.592639:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2848 count 1 00000100:00100000:3.0:1788572446.592756:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3651:x1875449639211008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 144us (2029us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.592763:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4488 00000100:00100000:3.0:1788572446.592776:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4489 00000100:00100000:3.0:1788572446.592784:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3651:x1875449639211520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.592795:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2852 count 1 00000100:00100000:3.0:1788572446.592837:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3651:x1875449639211520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 55us (2073us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.592844:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4489 00000100:00100000:3.0:1788572446.592855:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4490 00000100:00100000:3.0:1788572446.592862:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449639212160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.592873:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2856 count 1 00000100:00100000:3.0:1788572446.592912:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3651:x1875449639212160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 51us (2113us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.592918:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4490 00000100:00100000:3.0:1788572446.592930:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4491 00000100:00100000:3.0:1788572446.592937:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3651:x1875449639211392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.592949:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2851 count 1 00000100:00100000:3.0:1788572446.592986:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3651:x1875449639211392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (2141us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.592992:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4491 00000100:00100000:3.0:1788572446.593019:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4492 00000100:00100000:3.0:1788572446.593028:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449639212032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.593041:0:43967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2855 count 1 00000100:00100000:3.0:1788572446.593091:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3651:x1875449639212032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 65us (2202us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.593097:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4492 00000004:00080000:3.0:1788572446.593139:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46680, transno 0 00010000:00010000:1.0:1788572446.593186:0:116818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e641589a00/0xdb7edb52b833a164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a15d expref: 9 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.593199:0:116818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e641589a00, rc 0) 00000100:00100000:1.0:1788572446.593233:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+9:116810:x1875449639211904:12345-0@lo:101:mount.lustre.0 Request processed in 2246us (2954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.593240:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788572446.593356:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572446.593366:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788572446.593375:0:3649:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788572446.593380:0:3649:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788572446.593383:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e618476000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788572446.593394:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788572446.593400:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639210752:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788572446.593453:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639211904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788572446.593473:0:116810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572446.593484:0:116810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788572446.594221:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe46680/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.594236:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639211392:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.594255:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46d80, transno 0 00000004:00080000:3.0:1788572446.594258:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe46d80/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.594261:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639212032:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.594269:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44e00, transno 0 00000004:00080000:3.0:1788572446.594272:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe44e00/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.594275:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639211008:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.594282:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47480, transno 0 00000004:00080000:3.0:1788572446.594284:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe47480/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.594287:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639211520:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.594294:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44a80, transno 0 00000004:00080000:3.0:1788572446.594296:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe44a80/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.594300:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639212160:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788572446.594346:0:116830:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788572446.594421:0:116830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 4363615416398ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788572446.594428:0:116830:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788572446.594841:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47b80, transno 0 00000004:00080000:2.0:1788572446.594846:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe47b80/1, rc -2, transno 0 00000100:00100000:2.0:1788572446.594851:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639210240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572446.594922:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449639211264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22525us (22802us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788572446.594931:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4483 00000100:00100000:2.0:1788572446.594987:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639212416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572446.595051:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.595114:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639212416 00000100:00100000:2.0:1788572446.595121:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639212416 00000100:00100000:2.0:1788572446.595181:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937 00000100:00100000:2.0:1788572446.595189:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639212416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572446.595217:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572446.595259:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639212416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.595265:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937 00000100:00100000:2.0:1788572446.595295:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639212416:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788572446.596030:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe45c00, transno 0 00000004:00080000:3.0:1788572446.596037:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe45c00/1, rc -2, transno 0 00000100:00100000:3.0:1788572446.596042:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639211264:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788572446.596067:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572446.598247:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639212288:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788572446.598425:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.598473:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61ebbe900 going to sleep for 11 seconds 00000004:00080000:1.0:1788572446.598627:0:116828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 1 in progress, 1 in flight, 7 done 00000100:00100000:1.0:1788572446.598736:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639212544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.598769:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.598790:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639213056:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.598811:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.598833:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572446.598839:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639212928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.598860:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.598892:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639212544 00000100:00100000:1.0:1788572446.598899:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639212544 00000100:00100000:1.0:1788572446.598936:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639213056 00000100:00100000:1.0:1788572446.598939:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639213056 00000100:00100000:1.0:1788572446.598953:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639212928 00000100:00100000:1.0:1788572446.598955:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639212928 00000100:00100000:1.0:1788572446.598971:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4493 00000100:00100000:1.0:1788572446.598979:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+9:3653:x1875449639212544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.599035:0:43970:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2857 count 1 00000100:00100000:0.0:1788572446.600237:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3652:x1875449639211648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19102us (23632us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.600249:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4486 00000100:00100000:0.0:1788572446.600430:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4494 00000100:00100000:0.0:1788572446.600444:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3653:x1875449639213056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.600471:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2861 count 1 00000100:00100000:0.0:1788572446.600569:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3653:x1875449639213056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 131us (1757us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.600575:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4494 00000100:00100000:0.0:1788572446.600589:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4495 00000100:00100000:0.0:1788572446.600597:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449639212928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788572446.600608:0:43968:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2860 count 1 00000100:00100000:0.0:1788572446.600648:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3653:x1875449639212928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53us (1788us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788572446.600654:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4495 00000100:00100000:3.0:1788572446.601156:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639212288 00000100:00100000:3.0:1788572446.601165:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639212288 00000100:00100000:3.0:1788572446.601212:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788572446.601221:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+9:116810:x1875449639212288:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788572446.601237:0:116817:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788572446.601257:0:116817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788572446.601261:0:116817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788572446.601264:0:116817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788572446.601267:0:116817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 211 00000100:00100000:3.0:1788572446.601370:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+9:116810:x1875449639212288:12345-0@lo:256:mount.lustre.0 Request processed in 151us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.601377:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788572446.601436:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639212800:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572446.601602:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639212672:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.611935:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3653:x1875449639212544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12944us (13153us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.611951:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4493 00000004:00080000:1.0:1788572446.612081:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46a00, transno 0 00000004:00080000:1.0:1788572446.612089:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe46a00/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.612104:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639211648:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.612282:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639213440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.612330:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.619695:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.619760:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639213184:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788572446.619794:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.621259:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639213440 00000100:00100000:1.0:1788572446.621275:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639213440 00000100:00100000:1.0:1788572446.621370:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639212672 00000100:00100000:1.0:1788572446.621374:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639212672 00000100:00100000:1.0:1788572446.621402:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639213184 00000100:00100000:1.0:1788572446.621406:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639213184 00000100:00100000:1.0:1788572446.621430:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4496 00000100:00100000:1.0:1788572446.621441:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449639213440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.621479:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2864 count 1 00000100:00100000:1.0:1788572446.621607:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3652:x1875449639213440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 168us (9277us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.621615:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4496 00000100:00100000:1.0:1788572446.621633:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4497 00000100:00100000:1.0:1788572446.621640:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449639212672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.621652:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2858 count 1 00000100:00100000:1.0:1788572446.621698:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449639212672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59us (2013us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.621705:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4497 00000100:00100000:1.0:1788572446.621716:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4498 00000100:00100000:1.0:1788572446.621723:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639213184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.621733:0:8464:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2862 count 1 00000100:00100000:1.0:1788572446.621771:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639213184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50us (1977us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.621777:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4498 00000004:00080000:1.0:1788572446.621818:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46d80, transno 0 00000004:00080000:1.0:1788572446.621825:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe46d80/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.621837:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639212672:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572446.621847:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47b80, transno 0 00000004:00080000:1.0:1788572446.621850:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe47b80/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.621854:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639213184:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572446.621878:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46a00, transno 0 00000004:00080000:1.0:1788572446.621881:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe46a00/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.621885:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639213440:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572446.622001:0:116828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 5 in progress, 5 in flight, 3 done 00000040:00080000:1.0:1788572446.622121:0:116828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xcc:0x0] index 802 count 8 00000040:00080000:1.0:1788572446.622144:0:116828:0:(llog.c:805:llog_process_thread()) index: 52, lh_last_idx: 52 synced_idx: 52 lgh_last_idx: 52 00000040:00080000:1.0:1788572446.622148:0:116828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xd0:0x0] at index 52 of catalog [0x1:0x2:0x0] 00000004:00080000:1.0:1788572446.622166:0:116828:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788572446.622193:0:116828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 4363643187929ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788572446.622198:0:116828:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788572446.622220:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639213696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.622255:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.622295:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572446.622301:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639213568:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.622323:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.622344:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639213696 00000100:00100000:1.0:1788572446.622348:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639213696 00000100:00100000:1.0:1788572446.622369:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639213568 00000100:00100000:1.0:1788572446.622371:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639213568 00000100:00100000:1.0:1788572446.622385:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4499 00000100:00100000:1.0:1788572446.622391:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449639213696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.622404:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2866 count 1 00000100:00100000:1.0:1788572446.622453:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875449639213696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 61us (197us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.622459:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4499 00000004:00080000:1.0:1788572446.622481:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0a80, transno 0 00000004:00080000:1.0:1788572446.622484:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412b0a80/1, rc -2, transno 0 00000100:00100000:1.0:1788572446.622491:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639213696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788572446.622537:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4500 00000100:00100000:1.0:1788572446.622545:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639213568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788572446.622556:0:8466:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2865 count 1 00000100:00100000:1.0:1788572446.622612:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639213568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 68us (287us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572446.622619:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4500 00000004:00080000:2.0:1788572446.622639:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e6412b0380, transno 0 00000004:00080000:2.0:1788572446.622644:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e6412b0380/1, rc -2, transno 0 00000100:00100000:2.0:1788572446.622656:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639213568:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.629395:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.629489:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639213312:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.629566:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.629638:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639212800 00000100:00100000:3.0:1788572446.629648:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639212800 00000100:00100000:3.0:1788572446.629712:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639213312 00000100:00100000:3.0:1788572446.629715:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639213312 00000100:00100000:3.0:1788572446.629737:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4501 00000100:00100000:3.0:1788572446.629748:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449639212800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.629785:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2859 count 1 00000100:00100000:3.0:1788572446.629881:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3651:x1875449639212800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 133us (496us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.629888:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4501 00000100:00100000:3.0:1788572446.629906:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4502 00000100:00100000:3.0:1788572446.629913:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449639213312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788572446.629924:0:43972:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2863 count 1 00000100:00100000:3.0:1788572446.629962:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449639213312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49us (395us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788572446.629968:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4502 00000100:00100000:3.0:1788572446.630271:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639212288:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788572446.630878:0:116810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788572446.630907:0:116810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.630918:0:116810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572446.630927:0:116810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94e6184a3000 from 1 10000000:01000000:3.0:1788572446.630930:0:116810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000004:00080000:0.0:1788572446.630931:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe47480, transno 0 00000004:00080000:0.0:1788572446.630938:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe47480/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.630948:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639212928:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788572446.630966:0:116810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8600/0xdb7edb52b833a16b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.630973:0:116810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8600/0xdb7edb52b833a16b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.630982:0:116810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8600/0xdb7edb52b833a16b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.631016:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639213824:0@lo:101:mount.lustre.0 00000004:00080000:0.0:1788572446.631025:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe46680, transno 0 00000004:00080000:0.0:1788572446.631028:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe46680/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.631033:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639212544:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572446.631041:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44a80, transno 0 00000100:00100000:3.0:1788572446.631054:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572446.631057:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe44a80/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.631070:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639213056:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788572446.631536:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d9c1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.631558:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639213824 00000100:00100000:3.0:1788572446.631565:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639213824 00000100:00100000:3.0:1788572446.631650:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788572446.631661:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+9:116810:x1875449639213824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572446.631675:0:116818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572446.631690:0:116818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e61a3f9800/0xdb7edb52b833a172 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a16b expref: -99 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.631713:0:116818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e61a3f9800/0xdb7edb52b833a172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a16b expref: 10 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.631723:0:116818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e61a3f9800/0xdb7edb52b833a172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a16b expref: 10 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.631732:0:116818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61a3f9800, rc 0) 00000100:00100000:3.0:1788572446.631769:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+10:116810:x1875449639213824:12345-0@lo:101:mount.lustre.0 Request processed in 111us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.631775:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1788572446.631937:0:116828:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 2 in progress, 2 in flight, 3 done 00000004:00080000:0.0:1788572446.632339:0:116811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788572446.637384:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe44e00, transno 0 00000004:00080000:0.0:1788572446.637402:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe44e00/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.637424:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639212800:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788572446.637437:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94e60fe45c00, transno 0 00000004:00080000:0.0:1788572446.637440:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94e60fe45c00/1, rc -2, transno 0 00000100:00100000:0.0:1788572446.637443:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639213312:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788572446.637649:0:116811:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1788572446.637840:0:116828:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 51, last_idx 52 00000040:00080000:1.0:1788572446.637864:0:116828:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xcc:0x0] at index 51 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1788572446.641778:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639213824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572446.641810:0:116810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8600/0xdb7edb52b833a16b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a172 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.641823:0:116810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8600/0xdb7edb52b833a16b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a172 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.641911:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639213952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572446.641975:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.642043:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d9c1600 going to sleep for 11 seconds 00000100:00100000:1.0:1788572446.646181:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639213952 00000100:00100000:1.0:1788572446.646197:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639213952 00000100:00100000:1.0:1788572446.646281:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788572446.646304:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+10:116810:x1875449639213952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788572446.646526:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+10:116810:x1875449639213952:12345-0@lo:501:mount.lustre.0 Request processed in 235us (4550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572446.646535:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788572446.648162:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639213952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572446.648232:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639214080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572446.648317:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.648419:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d9c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788572446.650561:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639214080 00000100:00100000:2.0:1788572446.650583:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639214080 00000100:00100000:2.0:1788572446.650652:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788572446.650663:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+10:116810:x1875449639214080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788572446.650849:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+10:116810:x1875449639214080:12345-0@lo:503:mount.lustre.0 Request processed in 187us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.650857:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788572446.652931:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639214080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788572446.654784:0:116832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116832:1875449639214208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572446.654874:0:116832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.654920:0:116832:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e633d003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572446.656121:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639214208 00000100:00100000:2.0:1788572446.656134:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639214208 00000100:00100000:2.0:1788572446.656194:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788572446.656205:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+10:116832:x1875449639214208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572446.656972:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+10:116832:x1875449639214208:12345-0@lo:502:llog_process_th.0 Request processed in 764us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.656982:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788572446.659324:0:116832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116832:1875449639214208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788572446.659381:0:116832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572446.659394:0:116832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572446.659396:0:116832:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788572446.659406:0:116832:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94e6184a3000 00000020:00000080:0.0:1788572446.659408:0:116832:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788572446.659417:0:116832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788572446.659419:0:116832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572446.659421:0:116832:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788572446.659423:0:116832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788572446.659425:0:116832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788572446.659426:0:116832:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788572446.659429:0:116832:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94e6184a3000 00000020:00000080:0.0:1788572446.659431:0:116832:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788572446.659537:0:116832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116832:1875449639214336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788572446.659619:0:116832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.659670:0:116832:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e633d003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572446.661159:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639214336 00000100:00100000:2.0:1788572446.661171:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639214336 00000100:00100000:2.0:1788572446.661231:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572446.661241:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+10:116832:x1875449639214336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788572446.661419:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+10:116832:x1875449639214336:12345-0@lo:502:llog_process_th.0 Request processed in 178us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.661427:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788572446.661816:0:116832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116832:1875449639214336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788572446.661851:0:116832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788572446.661860:0:116832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788572446.661862:0:116832:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788572446.661866:0:116832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788572446.662966:0:116810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788572446.663026:0:116810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572446.663040:0:116810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8600/0xdb7edb52b833a16b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a172 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.663052:0:116810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8600/0xdb7edb52b833a16b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a172 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572446.663140:0:116810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788572446.663143:0:116810:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94e6184a3000 10000000:01000000:3.0:1788572446.663146:0:116810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94e6184a3000 10000000:01000000:3.0:1788572446.663150:0:116810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788572446.663157:0:116810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94e6184a3000 from 1 10000000:01000000:3.0:1788572446.663159:0:116810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788572446.663193:0:116810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9000/0xdb7edb52b833a179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.663201:0:116810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9000/0xdb7edb52b833a179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.663210:0:116810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9000/0xdb7edb52b833a179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.663234:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639214464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788572446.663301:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.663349:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d9c1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.663374:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639214464 00000100:00100000:3.0:1788572446.663381:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639214464 00000100:00100000:3.0:1788572446.663430:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788572446.663439:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+10:116810:x1875449639214464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572446.663454:0:116817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572446.663479:0:116817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e61a3f8a00/0xdb7edb52b833a180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a179 expref: -99 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.663503:0:116817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e61a3f8a00/0xdb7edb52b833a180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a179 expref: 11 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.663513:0:116817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e61a3f8a00/0xdb7edb52b833a180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a179 expref: 11 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.663521:0:116817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61a3f8a00, rc 0) 00000100:00100000:3.0:1788572446.663559:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+11:116810:x1875449639214464:12345-0@lo:101:mount.lustre.0 Request processed in 121us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.663565:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788572446.663610:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639214464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788572446.663623:0:116810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9000/0xdb7edb52b833a179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a180 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.663631:0:116810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9000/0xdb7edb52b833a179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a180 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.663678:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639214592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572446.663703:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.663716:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d9c1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.663729:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639214592 00000100:00100000:3.0:1788572446.663732:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639214592 00000100:00100000:3.0:1788572446.663756:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788572446.663763:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+11:116810:x1875449639214592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572446.663885:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+11:116810:x1875449639214592:12345-0@lo:501:mount.lustre.0 Request processed in 122us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.663891:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788572446.663922:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639214592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788572446.663949:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639214720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572446.664123:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.664140:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d9c1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.664152:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639214720 00000100:00100000:3.0:1788572446.664155:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639214720 00000100:00100000:3.0:1788572446.664173:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788572446.664179:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+11:116810:x1875449639214720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788572446.664259:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+11:116810:x1875449639214720:12345-0@lo:503:mount.lustre.0 Request processed in 80us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.664267:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788572446.664301:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639214720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788572446.669526:0:116834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116834:1875449639214848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788572446.669637:0:116834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.669740:0:116834:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e502c54f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.674362:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639214848 00000100:00100000:3.0:1788572446.674382:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639214848 00000100:00100000:3.0:1788572446.674449:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788572446.674459:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+11:116834:x1875449639214848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572446.674705:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+11:116834:x1875449639214848:12345-0@lo:502:llog_process_th.0 Request processed in 247us (5067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.674716:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788572446.677682:0:116834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116834:1875449639214848:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788572446.677782:0:116834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788572446.677799:0:116834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff94e61eb919c0) 00000020:00000080:1.0:1788572446.677827:0:116834:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788572446.677938:0:116834:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94e6184a3000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788572446.677942:0:116834:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94e6184a3000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788572446.677945:0:116834:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94e6184a3000 4 00010000:00080000:1.0:1788572446.677976:0:116834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94e501f3b800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.113@tcp at head 00010000:00010000:3.0:1788572446.687691:0:116834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1788572446.687909:0:116834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788572446.687959:0:116834:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788572446.687973:0:116834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdb7edb52b833a18e 00000100:00080000:3.0:1788572446.687983:0:116834:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788572446.687989:0:116834:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94e501f3b800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:3.0:1788572446.688048:0:116834:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e62dac6d80 x1875449639214976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788572446.688080:0:116834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788572446.689968:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875449639214976:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572446.690082:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572446.690162:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639214976 00000100:00100000:1.0:1788572446.690172:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639214976 00000100:00100000:1.0:1788572446.690209:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15522 00000100:00100000:1.0:1788572446.690217:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639214976:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788572446.690275:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1875449639214976:12345-0@lo:38:llog_process_th.0 Request processed in 56us (192us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788572446.690282:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15522 00000100:00100000:1.0:1788572446.690324:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788572446.690333:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501f3b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788572446.690337:0:3649:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788572446.690340:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875449639214976:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788572446.701534:0:116834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116834:1875449639215104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572446.701624:0:116834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.701665:0:116834:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e6184b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.701688:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639215104 00000100:00100000:3.0:1788572446.701695:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639215104 00000100:00100000:3.0:1788572446.701736:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572446.701745:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+11:116834:x1875449639215104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572446.701864:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+11:116834:x1875449639215104:12345-0@lo:502:llog_process_th.0 Request processed in 119us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.701871:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788572446.701924:0:116834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116834:1875449639215104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572446.701965:0:116834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116834:1875449639215232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572446.701998:0:116834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.702042:0:116834:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62dad66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572446.702055:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639215232 00000100:00100000:3.0:1788572446.702071:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639215232 00000100:00100000:3.0:1788572446.702098:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788572446.703501:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+11:116834:x1875449639215232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788572446.703669:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+11:116834:x1875449639215232:12345-0@lo:502:llog_process_th.0 Request processed in 1563us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.703678:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788572446.704616:0:116834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d74e0a07-d05f-49a8-aa32-40b653992526:116834:1875449639215232:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788572446.704658:0:116834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788572446.706575:0:116810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788572446.706618:0:116810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788572446.707072:0:116810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9000/0xdb7edb52b833a179 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a180 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.707087:0:116810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9000/0xdb7edb52b833a179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a180 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788572446.707181:0:116810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788572446.707184:0:116810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788572446.707185:0:116810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572446.707186:0:116810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572446.707188:0:116810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572446.707189:0:116810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572446.707190:0:116810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788572446.707191:0:116810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788572446.707193:0:116810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572446.707194:0:116810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788572446.707199:0:116810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788572446.707201:0:116810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788572446.707202:0:116810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788572446.707203:0:116810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788572446.707204:0:116810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788572446.707205:0:116810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788572446.707206:0:116810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788572446.707207:0:116810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788572446.707208:0:116810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788572446.707210:0:116810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788572446.707211:0:116810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788572446.707242:0:116810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788572446.707265:0:116810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639215360:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788572446.709504:0:116810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.709556:0:116810:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62dad69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.710267:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639215360 00000100:00100000:0.0:1788572446.710277:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639215360 00000100:00100000:0.0:1788572446.710342:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788572446.710353:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+11:116810:x1875449639215360:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788572446.710386:0:116818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788572446.710401:0:116818:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788572446.735340:0:116818:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788572446.735362:0:116818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788572446.735632:0:116819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788572446.735638:0:116819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788572446.735662:0:116819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.735682:0:116819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94e641589a00/0xdb7edb52b833a164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a15d expref: 11 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.735691:0:116819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.735733:0:116819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94e641589a00/0xdb7edb52b833a164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb7edb52b833a15d expref: 11 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.735748:0:116819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94e641589a00/0xdb7edb52b833a164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb7edb52b833a15d expref: 11 pid: 116818 timeout: 4463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.735764:0:116819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:116819:1875449639215488:0@lo:104: 00000100:00100000:3.0:1788572446.735834:0:116819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.735877:0:116819:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62dad6900 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.736958:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639215488 00000100:00100000:0.0:1788572446.736971:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639215488 00000100:00100000:0.0:1788572446.737284:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788572446.737483:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+11:116810:x1875449639215360:12345-0@lo:253:mount.lustre.0 Request processed in 27130us (27984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.737494:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788572446.737838:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d74e0a07-d05f-49a8-aa32-40b653992526+3:116819:x1875449639215488:12345-0@lo:104: 00010000:00010000:0.0:1788572446.737855:0:6533:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572446.737912:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788572446.737918:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d74e0a07-d05f-49a8-aa32-40b653992526+3:116819:x1875449639215488:12345-0@lo:104: Request processed in 87us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572446.738512:0:116810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d74e0a07-d05f-49a8-aa32-40b653992526:116810:1875449639215360:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788572446.738527:0:116810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788572446.738530:0:116810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788572446.738532:0:116810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788572446.738533:0:116810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788572446.738534:0:116810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788572446.738535:0:116810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788572446.738536:0:116810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788572446.738538:0:116810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788572446.738539:0:116810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788572446.738541:0:116810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788572446.738543:0:116810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788572446.738561:0:116810:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788572446.739251:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572446.739261:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.739272:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589600 already unused, calling callback (ffffffffc11ccc20) 10000000:00010000:3.0:1788572446.739275:0:92609:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.739286:0:92609:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788572446.739303:0:92609:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572446.739315:0:92609:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788572446.739369:0:92609:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.739376:0:92609:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788572446.739402:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.739409:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.113@tcp lock: ffff94e641589600/0xdb7edb52b833a15d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb7edb52b833a164 expref: -99 pid: 116810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.739428:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572446.739430:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572446.739432:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572446.739475:0:116819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:116819:1875449639215488:0@lo:104: 00010000:00010000:3.0:1788572446.739497:0:116819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.743584:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572446.743617:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639215616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788572446.743696:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572446.745963:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639215616 00000100:00100000:3.0:1788572446.745978:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639215616 00010000:00010000:3.0:1788572446.746041:0:6535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94e641589a00/0xdb7edb52b833a164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb7edb52b833a15d expref: 11 pid: 116818 timeout: 4463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572446.746101:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788572446.746124:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d74e0a07-d05f-49a8-aa32-40b653992526+11:3650:x1875449639215616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572446.746140:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788572446.746145:0:6535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94e641589a00/0xdb7edb52b833a164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb7edb52b833a15d expref: 11 pid: 116818 timeout: 4463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746158:0:6535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94e641589a00/0xdb7edb52b833a164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb7edb52b833a15d expref: 11 pid: 116818 timeout: 4463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746176:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e641589a00/0xdb7edb52b833a164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb7edb52b833a15d expref: 11 pid: 116818 timeout: 4463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746195:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746203:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788572446.746219:0:6535:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010582204s 00010000:00010000:3.0:1788572446.746224:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746230:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746242:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746249:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746255:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e61a3f8e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572446.746260:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746268:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746297:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746309:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788572446.746385:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d74e0a07-d05f-49a8-aa32-40b653992526+10:3650:x1875449639215616:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (2688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572446.746393:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788572446.746449:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639215616:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788572446.746481:0:116819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746488:0:116819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572446.746494:0:116819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94e61a3f8e00/0xdb7edb52b833a195 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 116819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572446.753756:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000040:01000000:1.0:1788572446.784208:0:116810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788572446.784777:0:116841:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788572446.787100:0:116841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788572446.789122:0:116841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2000182d0:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788572446.789219:0:116841:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788572446.790513:0:116810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:0.0:1788572446.790811:0:116840:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788572446.790816:0:116840:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788572446.797914:0:116842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:116842:1875449639215744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788572446.797992:0:116842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.799906:0:116842:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e633f74480 going to sleep for 11 seconds 00000040:01000000:3.0:1788572446.801275:0:116810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788572446.801622:0:116810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788572446.802081:0:116810:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788572446.802090:0:116810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788572446.805612:0:116810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572446.812185:0:116810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788572446.813841:0:116810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788572446.813913:0:116810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:0.0:1788572446.814611:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639215744 00000100:00100000:0.0:1788572446.814625:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639215744 00000100:00100000:0.0:1788572446.814686:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1788572446.814697:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:116842:x1875449639215744:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572446.814827:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:116842:x1875449639215744:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 132us (16834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.814836:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818 00000100:00100000:2.0:1788572446.814937:0:116842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:116842:1875449639215744:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788572446.814987:0:116842:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788572446.815077:0:116842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:116842:1875449639215872:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788572446.815134:0:116842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572446.815167:0:116842:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e633f74480 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.815336:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639215872 00000100:00100000:0.0:1788572446.815341:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639215872 00000100:00100000:0.0:1788572446.815375:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1788572446.815382:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:116842:x1875449639215872:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572446.815489:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:116842:x1875449639215872:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 108us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.815496:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1788572446.815532:0:116842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:116842:1875449639215872:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572446.815600:0:116842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:116842:1875449639216000:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572446.815627:0:116842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572446.815642:0:116842:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e633d00c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788572446.815654:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639216000 00000100:00100000:0.0:1788572446.815656:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639216000 00000100:00100000:0.0:1788572446.815680:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:0.0:1788572446.815686:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:116842:x1875449639216000:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788572446.815737:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:116842:x1875449639216000:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 51us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572446.815742:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00000100:00100000:0.0:1788572446.815770:0:116842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:116842:1875449639216000:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788572446.815817:0:116842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788572446.817731:0:116810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788572446.821291:0:116842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400007eb:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788572446.821383:0:116842:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788572446.821390:0:116842:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:3.0:1788572446.821878:0:116810:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x67:0x0] (8/32) registered 00010000:00080000:3.0:1788572446.825694:0:116810:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 219043334908 00010000:00080000:0.0:1788572446.830088:0:116843:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 116843 00010000:02000000:0.0:1788572446.830463:0:116843:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1788572446.830468:0:116843:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788572446.830473:0:116843:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1788572446.831584:0:116810:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788572446.831607:0:116810:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788572446.831628:0:116810:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788572446.831654:0:116810:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788572446.842029:0:116810:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788572446.848825:0:116810:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788572447.364354:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788572447.364363:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94e6184a3000 from 212 10000000:01000000:3.0:1788572447.364368:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788572447.364417:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9600/0xdb7edb52b833a19c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.364428:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9600/0xdb7edb52b833a19c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.364440:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9600/0xdb7edb52b833a19c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572447.364465:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.364532:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572447.364570:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d29f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.365418:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639216128 00000100:00100000:2.0:1788572447.365429:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639216128 00000100:00100000:2.0:1788572447.365475:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788572447.365484:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+10:6548:x1875449639216128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.365499:0:116815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572447.365518:0:116815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ad1ba00/0xdb7edb52b833a1a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a19c expref: -99 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.365540:0:116815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ad1ba00/0xdb7edb52b833a1a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a19c expref: 11 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.365551:0:116815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ad1ba00/0xdb7edb52b833a1a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a19c expref: 11 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.365561:0:116815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1ba00, rc 0) 00000100:00100000:2.0:1788572447.365618:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+11:6548:x1875449639216128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.365625:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788572447.365725:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572447.365741:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9600/0xdb7edb52b833a19c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1a3 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.365751:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9600/0xdb7edb52b833a19c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a1a3 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572447.365811:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.365844:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572447.365877:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61ebc5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.365930:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639216256 00000100:00100000:2.0:1788572447.365935:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639216256 00000100:00100000:2.0:1788572447.365963:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788572447.365969:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+11:6548:x1875449639216256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788572447.365981:0:116817:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788572447.365996:0:116817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788572447.365999:0:116817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 212 00000100:00100000:2.0:1788572447.366105:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+11:6548:x1875449639216256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.366121:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788572447.366149:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788572447.366196:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788572447.366203:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9600/0xdb7edb52b833a19c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1a3 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.366211:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9600/0xdb7edb52b833a19c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1a3 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572447.366219:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788572447.366221:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94e506b20000 from 52 10000000:01000000:2.0:1788572447.366224:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788572447.366246:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ad1b600/0xdb7edb52b833a1aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.366252:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e63ad1b600/0xdb7edb52b833a1aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.366263:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e63ad1b600/0xdb7edb52b833a1aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572447.366275:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.366298:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.366316:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e633f74840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.366327:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639216384 00000100:00100000:2.0:1788572447.366330:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639216384 00000100:00100000:2.0:1788572447.366349:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788572447.366355:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+11:6548:x1875449639216384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.366361:0:116815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572447.366370:0:116815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ad1b000/0xdb7edb52b833a1b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a1aa expref: -99 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.366383:0:116815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ad1b000/0xdb7edb52b833a1b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a1aa expref: 12 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.366392:0:116815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ad1b000/0xdb7edb52b833a1b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a1aa expref: 12 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.366399:0:116815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1b000, rc 0) 00000100:00100000:2.0:1788572447.366428:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+12:6548:x1875449639216384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.366434:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788572447.366468:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.366478:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e63ad1b600/0xdb7edb52b833a1aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1b1 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.366485:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e63ad1b600/0xdb7edb52b833a1aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a1b1 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572447.366538:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.366562:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.366574:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e633f74840 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.366584:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639216512 00000100:00100000:2.0:1788572447.366587:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639216512 00000100:00100000:2.0:1788572447.366607:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788572447.366612:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+12:6548:x1875449639216512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.366719:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+12:6548:x1875449639216512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.366725:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788572447.366755:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.366779:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.366816:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.366829:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e5042e9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.366840:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639216640 00000100:00100000:2.0:1788572447.366843:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639216640 00000100:00100000:2.0:1788572447.366863:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788572447.366868:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+12:6548:x1875449639216640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.366938:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+12:6548:x1875449639216640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.366945:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788572447.366984:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572447.367671:0:116862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788572447.367734:0:6548:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788572447.367761:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788572447.367770:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ad1b600/0xdb7edb52b833a1aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1b1 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.367778:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e63ad1b600/0xdb7edb52b833a1aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1b1 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572447.367786:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788572447.367789:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788572447.367791:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788572447.367818:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a800/0xdb7edb52b833a1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.367825:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a800/0xdb7edb52b833a1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.367833:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a800/0xdb7edb52b833a1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572447.367849:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.367886:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.367912:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e5042e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.367926:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639216768 00000100:00100000:2.0:1788572447.367931:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639216768 00000100:00100000:2.0:1788572447.367960:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788572447.367967:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+12:6548:x1875449639216768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.367981:0:116815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572447.367994:0:116815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ad1be00/0xdb7edb52b833a1bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a1b8 expref: -99 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.368036:0:116815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ad1be00/0xdb7edb52b833a1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a1b8 expref: 13 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.368046:0:116815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ad1be00/0xdb7edb52b833a1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a1b8 expref: 13 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.368054:0:116815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1be00, rc 0) 00000100:00100000:2.0:1788572447.368097:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+13:6548:x1875449639216768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.368102:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788572447.368138:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.368149:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a800/0xdb7edb52b833a1b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1bf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.368157:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a800/0xdb7edb52b833a1b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a1bf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572447.368199:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.368222:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.368239:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e5042e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.368249:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639216896 00000100:00100000:2.0:1788572447.368252:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639216896 00000100:00100000:2.0:1788572447.368272:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788572447.368277:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+13:6548:x1875449639216896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.368390:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+13:6548:x1875449639216896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.368396:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788572447.368427:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639216896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.368453:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.368490:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.368504:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e5042e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.368513:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639217024 00000100:00100000:2.0:1788572447.368517:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639217024 00000100:00100000:2.0:1788572447.368536:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788572447.368542:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+13:6548:x1875449639217024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.372257:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+13:6548:x1875449639217024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3700us (3750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.372275:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788572447.372489:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572447.373589:0:116863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788572447.373723:0:6548:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788572447.373751:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788572447.373763:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a800/0xdb7edb52b833a1b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1bf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.373774:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a800/0xdb7edb52b833a1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1bf expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572447.373783:0:6548:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788572447.373786:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94e506b20000 from 7 10000000:01000000:1.0:1788572447.373789:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788572447.373825:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e641588600/0xdb7edb52b833a1c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.373833:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e641588600/0xdb7edb52b833a1c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.373844:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e641588600/0xdb7edb52b833a1c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572447.373868:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.373923:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572447.373969:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e504f77480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.374230:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639217152 00000100:00100000:2.0:1788572447.374237:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639217152 00000100:00100000:2.0:1788572447.374285:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788572447.374295:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+13:6548:x1875449639217152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.374410:0:116815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572447.374426:0:116815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ad1a600/0xdb7edb52b833a1cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a1c6 expref: -99 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.374451:0:116815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ad1a600/0xdb7edb52b833a1cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a1c6 expref: 14 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.374462:0:116815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ad1a600/0xdb7edb52b833a1cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a1c6 expref: 14 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.374471:0:116815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1a600, rc 0) 00000100:00100000:2.0:1788572447.374519:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+14:6548:x1875449639217152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.374525:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788572447.374606:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572447.374622:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e641588600/0xdb7edb52b833a1c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1cd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.374631:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e641588600/0xdb7edb52b833a1c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a1cd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572447.374688:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.374715:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572447.374744:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e504f77480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.374784:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639217280 00000100:00100000:2.0:1788572447.374789:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639217280 00000100:00100000:2.0:1788572447.374845:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788572447.374853:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+14:6548:x1875449639217280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.374968:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+14:6548:x1875449639217280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.374975:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788572447.375816:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.375857:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.375914:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572447.376042:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e504f77480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.379555:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639217408 00000100:00100000:2.0:1788572447.379575:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639217408 00000100:00100000:2.0:1788572447.379648:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788572447.379658:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+14:6548:x1875449639217408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.379840:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+14:6548:x1875449639217408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (3924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.379848:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788572447.379972:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788572447.381099:0:116864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788572447.381445:0:6548:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788572447.381470:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788572447.381482:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e641588600/0xdb7edb52b833a1c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1cd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.381494:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e641588600/0xdb7edb52b833a1c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1cd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572447.381503:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788572447.381506:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94e502de0000 from 52 10000000:01000000:1.0:1788572447.381510:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788572447.381558:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e641588c00/0xdb7edb52b833a1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.381566:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e641588c00/0xdb7edb52b833a1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.381575:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e641588c00/0xdb7edb52b833a1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572447.381600:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.381660:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572447.381703:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e504f77480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.381791:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639217536 00000100:00100000:2.0:1788572447.381799:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639217536 00000100:00100000:2.0:1788572447.381844:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788572447.381854:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+14:6548:x1875449639217536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.381868:0:116821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572447.381883:0:116821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ad1ac00/0xdb7edb52b833a1db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a1d4 expref: -99 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.381910:0:116821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ad1ac00/0xdb7edb52b833a1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a1d4 expref: 15 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.381921:0:116821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ad1ac00/0xdb7edb52b833a1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a1d4 expref: 15 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.381931:0:116821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1ac00, rc 0) 00000100:00100000:2.0:1788572447.381969:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+15:6548:x1875449639217536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.381975:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788572447.382179:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572447.382197:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e641588c00/0xdb7edb52b833a1d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1db expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.382207:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e641588c00/0xdb7edb52b833a1d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a1db expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572447.382266:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.382293:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572447.382396:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e504f77480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.382466:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639217664 00000100:00100000:2.0:1788572447.382470:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639217664 00000100:00100000:2.0:1788572447.382501:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788572447.382508:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+15:6548:x1875449639217664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.382621:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+15:6548:x1875449639217664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.382628:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788572447.382692:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.382719:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.382766:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572447.382788:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e504f77480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.382828:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639217792 00000100:00100000:2.0:1788572447.382832:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639217792 00000100:00100000:2.0:1788572447.382859:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788572447.382865:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+15:6548:x1875449639217792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.382943:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+15:6548:x1875449639217792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.382950:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788572447.383307:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572447.385744:0:116865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788572447.386418:0:6548:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788572447.386446:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788572447.386457:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e641588c00/0xdb7edb52b833a1d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1db expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.386470:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e641588c00/0xdb7edb52b833a1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1db expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572447.386479:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788572447.386482:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788572447.386486:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788572447.386530:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e641588e00/0xdb7edb52b833a1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.386539:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e641588e00/0xdb7edb52b833a1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.386551:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e641588e00/0xdb7edb52b833a1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572447.386578:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.386647:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572447.386687:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e504f77480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.387241:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639217920 00000100:00100000:2.0:1788572447.387252:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639217920 00000100:00100000:2.0:1788572447.387306:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788572447.387433:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+15:6548:x1875449639217920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.387450:0:116821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572447.387466:0:116821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ad1b400/0xdb7edb52b833a1e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a1e2 expref: -99 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.387491:0:116821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ad1b400/0xdb7edb52b833a1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a1e2 expref: 16 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.387502:0:116821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ad1b400/0xdb7edb52b833a1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a1e2 expref: 16 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.387510:0:116821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1b400, rc 0) 00000100:00100000:2.0:1788572447.387572:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+16:6548:x1875449639217920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.387579:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788572447.389417:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639217920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572447.389444:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e641588e00/0xdb7edb52b833a1e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1e9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.389455:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e641588e00/0xdb7edb52b833a1e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a1e9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572447.389542:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.389599:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572447.389634:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d29fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.389915:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639218048 00000100:00100000:2.0:1788572447.389922:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639218048 00000100:00100000:2.0:1788572447.389972:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788572447.389982:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+16:6548:x1875449639218048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.390216:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+16:6548:x1875449639218048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.390225:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788572447.390268:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.390304:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.390523:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.390554:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e502c3a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572447.391840:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639218176 00000100:00100000:3.0:1788572447.391853:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639218176 00000100:00100000:3.0:1788572447.391911:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788572447.391921:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+16:6548:x1875449639218176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.392917:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+16:6548:x1875449639218176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 994us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572447.392927:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788572447.393089:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572447.395539:0:116866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788572447.395919:0:6548:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788572447.395953:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788572447.395966:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e641588e00/0xdb7edb52b833a1e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1e9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.395978:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e641588e00/0xdb7edb52b833a1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1e9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572447.395991:0:6548:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788572447.395995:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94e502de0000 from 7 10000000:01000000:3.0:1788572447.395998:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572447.396085:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8e00/0xdb7edb52b833a1f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.396094:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8e00/0xdb7edb52b833a1f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.400139:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8e00/0xdb7edb52b833a1f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572447.400203:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.400295:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572447.400348:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d29f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.400536:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639218304 00000100:00100000:2.0:1788572447.400547:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639218304 00000100:00100000:2.0:1788572447.400608:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572447.400617:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+16:6548:x1875449639218304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.400635:0:116817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572447.400656:0:116817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ad1a200/0xdb7edb52b833a1f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a1f0 expref: -99 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.400684:0:116817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ad1a200/0xdb7edb52b833a1f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a1f0 expref: 17 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.400696:0:116817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ad1a200/0xdb7edb52b833a1f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a1f0 expref: 17 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.400707:0:116817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1a200, rc 0) 00000100:00100000:2.0:1788572447.400758:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+17:6548:x1875449639218304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.400765:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788572447.400811:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.400826:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8e00/0xdb7edb52b833a1f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1f7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.400837:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8e00/0xdb7edb52b833a1f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a1f7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572447.400903:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.400930:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.400951:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e502c3a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.400964:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639218432 00000100:00100000:2.0:1788572447.400967:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639218432 00000100:00100000:2.0:1788572447.400993:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788572447.400999:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+17:6548:x1875449639218432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.401162:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+17:6548:x1875449639218432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.401169:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788572447.401213:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.401246:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.401292:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.401310:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e502c3a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.401321:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639218560 00000100:00100000:2.0:1788572447.401325:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639218560 00000100:00100000:2.0:1788572447.401344:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788572447.401349:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+17:6548:x1875449639218560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.401424:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+17:6548:x1875449639218560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.401430:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788572447.401470:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572447.402123:0:116867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788572447.402192:0:6548:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788572447.402209:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788572447.402218:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8e00/0xdb7edb52b833a1f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1f7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.402230:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8e00/0xdb7edb52b833a1f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a1f7 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572447.402239:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788572447.402241:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94e63ad0e800 from 52 10000000:01000000:2.0:1788572447.402244:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788572447.402267:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a400/0xdb7edb52b833a1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.402274:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a400/0xdb7edb52b833a1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.402282:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a400/0xdb7edb52b833a1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572447.402297:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.402330:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.402356:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e502c3ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.402372:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639218688 00000100:00100000:2.0:1788572447.402376:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639218688 00000100:00100000:2.0:1788572447.402404:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788572447.402412:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+17:6548:x1875449639218688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.402424:0:116818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572447.402436:0:116818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ad1b200/0xdb7edb52b833a205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a1fe expref: -99 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.402454:0:116818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ad1b200/0xdb7edb52b833a205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a1fe expref: 18 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.402468:0:116818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ad1b200/0xdb7edb52b833a205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a1fe expref: 18 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.402475:0:116818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1b200, rc 0) 00000100:00100000:2.0:1788572447.402505:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+18:6548:x1875449639218688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.402511:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788572447.402546:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.402557:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a400/0xdb7edb52b833a1fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a205 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.402566:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a400/0xdb7edb52b833a1fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a205 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572447.402609:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.402633:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.402648:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e502c3ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.402660:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639218816 00000100:00100000:2.0:1788572447.402663:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639218816 00000100:00100000:2.0:1788572447.402684:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788572447.402689:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+18:6548:x1875449639218816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.402776:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+18:6548:x1875449639218816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.402782:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788572447.402812:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.402837:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.402874:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.402888:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e502c3ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.402898:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639218944 00000100:00100000:2.0:1788572447.402901:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639218944 00000100:00100000:2.0:1788572447.402921:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788572447.402927:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+18:6548:x1875449639218944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.402996:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+18:6548:x1875449639218944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.403027:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788572447.403087:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639218944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572447.410239:0:116868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788572447.411487:0:6548:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788572447.411519:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788572447.411531:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a400/0xdb7edb52b833a1fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a205 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.411544:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e63ad1a400/0xdb7edb52b833a1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a205 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788572447.411556:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788572447.411559:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94e63ad0e800 from 209 10000000:01000000:2.0:1788572447.411562:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788572447.411603:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ad1aa00/0xdb7edb52b833a20c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.411611:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e63ad1aa00/0xdb7edb52b833a20c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.411625:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e63ad1aa00/0xdb7edb52b833a20c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572447.411650:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.411719:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.411767:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61184b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572447.411900:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639219072 00000100:00100000:3.0:1788572447.411908:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639219072 00000100:00100000:3.0:1788572447.411969:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788572447.411980:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+18:6548:x1875449639219072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572447.411994:0:116818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572447.412034:0:116818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e61a3f8c00/0xdb7edb52b833a213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a20c expref: -99 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.412080:0:116818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e61a3f8c00/0xdb7edb52b833a213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a20c expref: 19 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.412091:0:116818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e61a3f8c00/0xdb7edb52b833a213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a20c expref: 19 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.412100:0:116818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61a3f8c00, rc 0) 00000100:00100000:3.0:1788572447.412330:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+19:6548:x1875449639219072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 351us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572447.412337:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788572447.412413:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.412428:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e63ad1aa00/0xdb7edb52b833a20c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a213 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.412436:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e63ad1aa00/0xdb7edb52b833a20c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a213 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788572447.412492:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.412523:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572447.412555:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61184b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788572447.412594:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639219200 00000100:00100000:3.0:1788572447.412599:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639219200 00000100:00100000:3.0:1788572447.412633:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788572447.412640:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50596a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+19:6548:x1875449639219200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788572447.412655:0:116821:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788572447.412672:0:116821:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788572447.412676:0:116821:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788572447.412679:0:116821:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788572447.412682:0:116821:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788572447.412685:0:116821:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 212 00000100:00100000:3.0:1788572447.412770:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50596a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+19:6548:x1875449639219200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572447.412776:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788572447.412838:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788572447.412912:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788572447.412919:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ad1aa00/0xdb7edb52b833a20c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a213 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572447.412926:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e63ad1aa00/0xdb7edb52b833a20c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a213 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788572447.412934:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788572447.412936:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1788572447.412938:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788572447.412960:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ac9c200/0xdb7edb52b833a21a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572447.412967:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e63ac9c200/0xdb7edb52b833a21a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572447.412974:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e63ac9c200/0xdb7edb52b833a21a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572447.412986:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788572447.413052:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572447.413082:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61f03c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.413241:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639219328 00000100:00100000:2.0:1788572447.413246:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639219328 00000100:00100000:2.0:1788572447.413279:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788572447.413286:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50596bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+19:6548:x1875449639219328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.413294:0:116815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572447.413306:0:116815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ad1a000/0xdb7edb52b833a221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a21a expref: -99 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.413322:0:116815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ad1a000/0xdb7edb52b833a221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a21a expref: 20 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.413336:0:116815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ad1a000/0xdb7edb52b833a221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a21a expref: 20 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.413343:0:116815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1a000, rc 0) 00000100:00100000:2.0:1788572447.413371:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50596bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+20:6548:x1875449639219328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.413377:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788572447.413439:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572447.413451:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e63ac9c200/0xdb7edb52b833a21a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a221 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572447.413459:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e63ac9c200/0xdb7edb52b833a21a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a221 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788572447.413511:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572447.413535:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572447.413562:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61f03c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.413600:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639219456 00000100:00100000:2.0:1788572447.413604:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639219456 00000100:00100000:2.0:1788572447.413634:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788572447.413641:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+20:6548:x1875449639219456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572447.413764:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+20:6548:x1875449639219456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.413771:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788572447.413832:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788572447.413859:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788572447.413900:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572447.413924:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61f03c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572447.413979:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639219584 00000100:00100000:3.0:1788572447.413983:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639219584 00000100:00100000:3.0:1788572447.414034:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788572447.414041:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+20:6548:x1875449639219584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.419779:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+20:6548:x1875449639219584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5720us (5859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572447.419796:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788572447.419924:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618493100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788572447.422880:0:116869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788572447.423307:0:6548:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788572447.423334:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788572447.423346:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e63ac9c200/0xdb7edb52b833a21a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a221 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.423358:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e63ac9c200/0xdb7edb52b833a21a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a221 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572447.423367:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788572447.423370:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94e63ad0e800 from 1 10000000:01000000:3.0:1788572447.423373:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788572447.423419:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9e00/0xdb7edb52b833a228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.423427:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9e00/0xdb7edb52b833a228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.423437:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9e00/0xdb7edb52b833a228 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572447.423465:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.423535:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572447.423586:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d29fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788572447.423635:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639219712 00000100:00100000:2.0:1788572447.423642:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639219712 00000100:00100000:2.0:1788572447.423971:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788572447.423982:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+20:6548:x1875449639219712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788572447.423999:0:116815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572447.424056:0:116815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ad1b800/0xdb7edb52b833a22f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a228 expref: -99 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.424090:0:116815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ad1b800/0xdb7edb52b833a22f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a228 expref: 21 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.424105:0:116815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ad1b800/0xdb7edb52b833a22f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a228 expref: 21 pid: 116815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572447.424270:0:116815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1b800, rc 0) 00000100:00100000:2.0:1788572447.424322:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+21:6548:x1875449639219712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 343us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572447.424329:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788572447.424680:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572447.424699:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9e00/0xdb7edb52b833a228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a22f expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.424709:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9e00/0xdb7edb52b833a228 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a22f expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572447.424726:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788572447.424731:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9e00/0xdb7edb52b833a228 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a22f expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.424737:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9e00/0xdb7edb52b833a228 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a22f expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788572447.424745:0:6548:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788572447.424748:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff94e62d25b380 from 1 10000000:01000000:1.0:1788572447.424750:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788572447.424772:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e641588400/0xdb7edb52b833a236 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.424780:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e641588400/0xdb7edb52b833a236 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572447.424788:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e641588400/0xdb7edb52b833a236 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788572447.424804:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.424837:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572447.425425:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e504f77780 going to sleep for 11 seconds 00000100:00100000:3.0:1788572447.425613:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639219840 00000100:00100000:3.0:1788572447.425621:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639219840 00000100:00100000:3.0:1788572447.425672:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788572447.425679:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+21:6548:x1875449639219840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572447.425692:0:116821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572447.425707:0:116821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e61a3f8800/0xdb7edb52b833a23d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a236 expref: -99 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.425726:0:116821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e61a3f8800/0xdb7edb52b833a23d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a236 expref: 22 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.425746:0:116821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e61a3f8800/0xdb7edb52b833a23d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a236 expref: 22 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.425755:0:116821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61a3f8800, rc 0) 00000100:00100000:3.0:1788572447.425796:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+22:6548:x1875449639219840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572447.425802:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788572447.425836:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572447.425848:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e641588400/0xdb7edb52b833a236 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a23d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.425856:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e641588400/0xdb7edb52b833a236 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a23d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572447.425872:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788572447.425876:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e641588400/0xdb7edb52b833a236 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a23d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.425883:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e641588400/0xdb7edb52b833a236 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a23d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572447.425890:0:6548:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788572447.425891:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94e63ad0e800 from 7 10000000:01000000:3.0:1788572447.425894:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788572447.425909:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8000/0xdb7edb52b833a244 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.425916:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8000/0xdb7edb52b833a244 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.425924:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8000/0xdb7edb52b833a244 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572447.425938:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.425960:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572447.425976:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d29fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572447.425985:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639219968 00000100:00100000:3.0:1788572447.425988:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639219968 00000100:00100000:3.0:1788572447.426025:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788572447.426031:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+22:6548:x1875449639219968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572447.426037:0:116821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572447.426292:0:116821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e61a3f8400/0xdb7edb52b833a24b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a244 expref: -99 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.426308:0:116821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e61a3f8400/0xdb7edb52b833a24b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a244 expref: 23 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.426317:0:116821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e61a3f8400/0xdb7edb52b833a24b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a244 expref: 23 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.426323:0:116821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61a3f8400, rc 0) 00000100:00100000:3.0:1788572447.426352:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+23:6548:x1875449639219968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 321us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572447.426357:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788572447.426385:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639219968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572447.426394:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8000/0xdb7edb52b833a244 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a24b expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.426403:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8000/0xdb7edb52b833a244 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a24b expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572447.426451:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639220096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.426472:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572447.426483:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d29fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572447.426492:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639220096 00000100:00100000:3.0:1788572447.426495:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639220096 00000100:00100000:3.0:1788572447.426511:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788572447.426516:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+23:6548:x1875449639220096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.426612:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+23:6548:x1875449639220096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572447.426618:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788572447.426640:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639220096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.426682:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639220224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.426720:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572447.426730:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d29fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788572447.426739:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639220224 00000100:00100000:3.0:1788572447.426742:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639220224 00000100:00100000:3.0:1788572447.426756:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788572447.426761:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+23:6548:x1875449639220224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.426823:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+23:6548:x1875449639220224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572447.426830:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788572447.426861:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639220224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788572447.427818:0:116870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788572447.427905:0:6548:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788572447.427931:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788572447.427939:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8000/0xdb7edb52b833a244 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a24b expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.427949:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e61a3f8000/0xdb7edb52b833a244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a24b expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788572447.427957:0:6548:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788572447.427959:0:6548:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff94e62d25b380 from 1 10000000:01000000:3.0:1788572447.427962:0:6548:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788572447.427987:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9400/0xdb7edb52b833a252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.427995:0:6548:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9400/0xdb7edb52b833a252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.428024:0:6548:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9400/0xdb7edb52b833a252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572447.428041:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639220352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.437697:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572447.437738:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d29f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788572447.437778:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639220352 00000100:00100000:3.0:1788572447.437785:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639220352 00000100:00100000:3.0:1788572447.437832:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788572447.437843:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+23:6548:x1875449639220352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572447.437867:0:116821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572447.437888:0:116821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e61a3f9a00/0xdb7edb52b833a259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb7edb52b833a252 expref: -99 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.437917:0:116821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e61a3f9a00/0xdb7edb52b833a259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb7edb52b833a252 expref: 24 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.437930:0:116821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e61a3f9a00/0xdb7edb52b833a259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb7edb52b833a252 expref: 24 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.437940:0:116821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e61a3f9a00, rc 0) 00000100:00100000:3.0:1788572447.437978:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:6548:x1875449639220352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572447.437985:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788572447.438339:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639220352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572447.438357:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9400/0xdb7edb52b833a252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a259 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.438367:0:6548:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9400/0xdb7edb52b833a252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb7edb52b833a259 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788572447.438453:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639220480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572447.438481:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572447.438507:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e62d29f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788572447.438862:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639220480 00000100:00100000:1.0:1788572447.438868:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639220480 00000100:00100000:1.0:1788572447.438904:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788572447.438913:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:6548:x1875449639220480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572447.439023:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:6548:x1875449639220480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (520us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572447.439031:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788572447.440485:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d74e0a07-d05f-49a8-aa32-40b653992526:6548:1875449639220480:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788572447.440586:0:6548:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788572447.440598:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9400/0xdb7edb52b833a252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a259 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572447.440610:0:6548:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.113@tcp lock: ffff94e61a3f9400/0xdb7edb52b833a252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb7edb52b833a259 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572447.446941:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572448.451568:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572449.283342:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639220608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572449.283443:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572449.283588:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639220608 00000100:00100000:1.0:1788572449.283601:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639220608 00000100:00100000:1.0:1788572449.283690:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938 00000100:00100000:1.0:1788572449.283712:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639220608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572449.283753:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572449.283813:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639220608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572449.283821:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938 00000100:00100000:1.0:1788572449.283898:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639220608:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788572449.284418:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572449.475272:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572449.795617:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572449.795650:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639220736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572449.795764:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572449.796119:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639220736 00000100:00100000:1.0:1788572449.796131:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639220736 00000100:00100000:1.0:1788572449.796215:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:1.0:1788572449.796227:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639220736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572449.796268:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1788572449.796539:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572449.796628:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639220736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 402us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572449.796637:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00100000:2.0:1788572449.796744:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639220736:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572450.501461:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572450.720627:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572450.720682:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572450.720769:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616259072 00000100:00100000:0.0:1788572450.720782:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616259072 00000100:00100000:0.0:1788572450.720874:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616258944 00000100:00100000:0.0:1788572450.720877:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616258944 00000100:00100000:0.0:1788572450.720901:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4697 00000100:00100000:0.0:1788572450.720914:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616259072:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572450.721045:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616259072:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 134us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572450.721054:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4697 00000100:00100000:0.0:1788572450.721104:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15523 00000100:00100000:0.0:1788572450.721110:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2382:x1875449616258944:12345-192.168.202.13@tcp:38:kworker.0 00010000:00080000:0.0:1788572450.721142:0:6550:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID '35eb2d60-2de0-4b00-9815-d5153edd0057' at ffff94e633e09800, cookie 0xdb7edb52b833a0e6 00010000:00080000:0.0:1788572450.721149:0:6550:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp recovering/t219043334909 exp ffff94e633e09800 cur 4367 last 1788572446 00010000:02000400:0.0:1788572450.721158:0:6550:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1788572450.721166:0:6550:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1788572450.721199:0:6550:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788572450.721390:0:6550:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572450.721432:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2382:x1875449616258944:12345-192.168.202.13@tcp:38:kworker.0 Request processed in 321us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572450.721439:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15523 00000100:00080000:3.0:1788572450.722373:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572450.722483:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572450.722599:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616259200 00000100:00100000:3.0:1788572450.722609:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616259200 00000100:00100000:3.0:1788572450.722656:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:3.0:1788572450.722664:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2382:x1875449616259200:12345-192.168.202.13@tcp:250:kworker.0 00010000:00080000:3.0:1788572450.722688:0:116821:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 90fa6266-5a39-4f6d-b3cf-5043b0cc0e22@192.168.202.13@tcp t0 exp 0000000000000000 cur 4367 last 0 00000020:00000080:3.0:1788572450.722725:0:116821:0:(genops.c:1385:class_connect()) connect: client 90fa6266-5a39-4f6d-b3cf-5043b0cc0e22, cookie 0xdb7edb52b833a260 00000100:00080000:3.0:1788572450.722897:0:116821:0:(import.c:65:import_set_state_nolock()) ffff94e6056ef000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572450.722971:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+5:2382:x1875449616259200:12345-192.168.202.13@tcp:250:kworker.0 Request processed in 305us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572450.722980:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 61 00000100:00100000:0.0:1788572450.749976:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572450.750320:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616254080 00000100:00100000:1.0:1788572450.750335:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616254080 00000100:00100000:1.0:1788572450.750426:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15524 00000100:00100000:1.0:1788572450.750449:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2382:x1875449616254080:12345-192.168.202.13@tcp:36:mcreate.0 00010000:00080000:1.0:1788572450.750480:0:9276:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 219043334909, current: 219043334909, replaying 00000100:00100000:1.0:1788572450.750502:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2382:x1875449616254080:12345-192.168.202.13@tcp:36:mcreate.0 Request processed in 65us (544us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572450.750510:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15524 00010000:00080000:0.0:1788572450.750807:0:116843:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1788572451.535564:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572451.843821:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572451.843854:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639220864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572451.843962:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572451.844099:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639220864 00000100:00100000:2.0:1788572451.844118:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639220864 00000100:00100000:2.0:1788572451.844190:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821 00000100:00100000:2.0:1788572451.844202:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449639220864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572451.844267:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572451.844333:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875449639220864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572451.844342:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821 00000100:00100000:2.0:1788572451.844404:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639220864:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788572451.848252:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572451.848262:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572451.848267:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572451.848279:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4363 00000100:00080000:2.0:1788572451.848286:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788572451.848296:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff94e607732800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572451.848331:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e5038c3800 x1875449639221120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572451.848349:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572451.848353:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572451.848354:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572451.848357:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4363 00000100:00080000:2.0:1788572451.848360:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788572451.848364:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94e63c3af800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572451.848377:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e5038c2a00 x1875449639221248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572451.848408:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572451.848412:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572451.848414:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572451.848419:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4363 00000100:00080000:2.0:1788572451.848422:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788572451.848426:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff94e50222f800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572451.848441:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e5038c0700 x1875449639221504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572451.848478:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572451.848483:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572451.848484:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572451.848488:0:93352:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4363 00000100:00100000:1.0:1788572451.848491:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639221120:0@lo:38:kworker.0 00000100:00080000:2.0:1788572451.848491:0:93352:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788572451.848495:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94e6056e8000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572451.848505:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e634be8a80 x1875449639221888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788572451.848531:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788572451.848535:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788572451.848537:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e501f3b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572451.848541:0:93352:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff94e501f3b800 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572451.848550:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e61e634a80 x1875449639222400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572451.848582:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639221376:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.848598:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572451.855539:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572451.855651:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639222144:0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.855739:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572451.855780:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788572451.855788:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639221632:0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.855818:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572451.855841:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639222272:0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.855866:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572451.855925:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639221376 00000100:00100000:2.0:1788572451.855937:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639221376 00000100:00100000:1.0:1788572451.857305:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639221248:0@lo:38:kworker.0 00000100:00100000:1.0:1788572451.857372:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.857407:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639221504:0@lo:38:kworker.0 00000100:00100000:1.0:1788572451.857433:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.857464:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639221888:0@lo:38:kworker.0 00000100:00100000:1.0:1788572451.857491:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.857513:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875449639222400:0@lo:38:kworker.0 00000100:00100000:1.0:1788572451.857535:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.857581:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639221120 00000100:00100000:1.0:1788572451.857590:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639221120 00000100:00100000:1.0:1788572451.857635:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000100:00100000:1.0:1788572451.857644:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1875449639221120:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572451.857685:0:7860:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff94e63ebc7800, cookie 0xdb7edb52b833a0ed 00010000:00080000:1.0:1788572451.857692:0:7860:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff94e63ebc7800 cur 4368 last 1788572446 00000004:00100000:1.0:1788572451.857718:0:7860:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572451.857905:0:7860:0:(import.c:65:import_set_state_nolock()) ffff94e604fd7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572451.858521:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3649:x1875449639221120:12345-0@lo:38:kworker.0 Request processed in 352us (9398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572451.858534:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00000100:00100000:1.0:1788572451.858585:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639221632 00000100:00100000:1.0:1788572451.858591:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639221632 00000100:00100000:1.0:1788572451.858643:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639221248 00000100:00100000:1.0:1788572451.858647:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639221248 00000100:00100000:1.0:1788572451.858657:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639221504 00000100:00100000:1.0:1788572451.858660:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639221504 00000100:00100000:1.0:1788572451.858670:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639221888 00000100:00100000:1.0:1788572451.858673:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639221888 00000100:00100000:1.0:1788572451.858681:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639222400 00000100:00100000:1.0:1788572451.858683:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639222400 00000100:00100000:1.0:1788572451.858695:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4698 00000100:00100000:1.0:1788572451.858703:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639221632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.858769:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639221632:12345-0@lo:400:kworker.0 Request processed in 68us (2949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572451.858776:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4698 00000100:00100000:1.0:1788572451.858793:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15525 00000100:00100000:1.0:1788572451.858796:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875449639221248:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572451.858815:0:10390:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4368 last 0 00000020:00000080:1.0:1788572451.858857:0:10390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdb7edb52b833a267 00000004:00100000:1.0:1788572451.858870:0:10390:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572451.858896:0:10390:0:(import.c:65:import_set_state_nolock()) ffff94e6349be800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572451.858929:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875449639221248:12345-0@lo:38:kworker.0 Request processed in 131us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572451.858936:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15525 00000100:00100000:1.0:1788572451.858967:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15526 00000100:00100000:1.0:1788572451.858972:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875449639221504:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788572451.858984:0:10390:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4368 last 0 00000100:00100000:2.0:1788572451.859161:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639222144 00000100:00100000:2.0:1788572451.859167:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639222144 00000100:00100000:2.0:1788572451.859189:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639222272 00000100:00100000:2.0:1788572451.859192:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639222272 00000100:00100000:2.0:1788572451.859215:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:2.0:1788572451.859222:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639221376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.859277:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639221376:12345-0@lo:400:kworker.0 Request processed in 56us (3754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572451.859284:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:2.0:1788572451.859295:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1788572451.859300:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639222144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.859326:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639222144:12345-0@lo:400:kworker.0 Request processed in 27us (3588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572451.859332:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:2.0:1788572451.859342:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1788572451.859347:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639222272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.859373:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639222272:12345-0@lo:400:kworker.0 Request processed in 26us (3507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572451.859378:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:2.0:1788572451.859429:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15527 00000100:00100000:2.0:1788572451.859434:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875449639221888:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788572451.859447:0:6550:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4368 last 0 00000020:00000080:2.0:1788572451.859474:0:6550:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdb7edb52b833a275 00000004:00100000:2.0:1788572451.859481:0:6550:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788572451.859503:0:6550:0:(import.c:65:import_set_state_nolock()) ffff94e6056f2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572451.859535:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875449639221888:12345-0@lo:38:kworker.0 Request processed in 101us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572451.859543:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15527 00000100:00100000:2.0:1788572451.859568:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15528 00000100:00100000:2.0:1788572451.859572:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875449639222400:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788572451.859584:0:6550:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 4368 last 0 00000020:00000080:2.0:1788572451.859615:0:6550:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdb7edb52b833a27c 00000004:00100000:2.0:1788572451.859621:0:6550:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788572451.859634:0:6550:0:(import.c:65:import_set_state_nolock()) ffff94e6056f5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572451.859662:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875449639222400:12345-0@lo:38:kworker.0 Request processed in 89us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572451.859669:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15528 00000020:00000080:1.0:1788572451.859914:0:10390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdb7edb52b833a26e 00000004:00100000:1.0:1788572451.859922:0:10390:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788572451.859940:0:10390:0:(import.c:65:import_set_state_nolock()) ffff94e6349b9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572451.859973:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875449639221504:12345-0@lo:38:kworker.0 Request processed in 1000us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572451.859979:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15526 00010000:00080000:1.0:1788572451.861373:0:116843:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788572451.861387:0:116843:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 219043334909 00000020:00080000:1.0:1788572451.861397:0:116843:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572451.861402:0:116843:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 219043334909, next_transno: 219043334909 00010000:00080000:1.0:1788572451.861408:0:116843:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (219043334909) 00000020:00080000:1.0:1788572451.861411:0:116843:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572451.861430:0:116843:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449616254080 t219043334909 from 192.168.202.13@tcp req@ffff94e618490380 x1875449616254080/t0(219043334909) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:111/0 lens 528/0 e 0 to 0 dl 1788572461 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572451.861580:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572451.861588:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572451.861593:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572451.861640:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639221760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.861731:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.861789:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788572451.861796:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639220992:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.861832:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.861871:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639222016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.861898:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.861929:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639220992 00000100:00100000:1.0:1788572451.861938:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639220992 00000100:00100000:1.0:1788572451.861994:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000001:00100000:0.0:1788572451.862781:0:9546:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788572451.866645:0:114775:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788572451.866689:0:7482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788572451.867292:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639220992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.867516:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639220992:12345-0@lo:400:kworker.0 Request processed in 246us (5681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572451.867525:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788572451.867663:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639220992:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.867730:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639221632:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.867748:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639222272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.867763:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639221376:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.867776:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639222144:0@lo:400:kworker.0 00010000:00080000:1.0:1788572451.867822:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94e634be8a80 x1875449639221888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572451.867843:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 52 00000100:00100000:2.0:1788572451.869064:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639221760 00000100:00100000:2.0:1788572451.869081:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639221760 00000100:00100000:2.0:1788572451.869201:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:2.0:1788572451.869213:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639221760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.869313:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639221760:12345-0@lo:400:kworker.0 Request processed in 103us (7582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572451.869321:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:2.0:1788572451.869364:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639222016 00000100:00100000:2.0:1788572451.869368:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639222016 00000100:00100000:2.0:1788572451.869404:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4699 00000100:00100000:2.0:1788572451.869411:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639222016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572451.869454:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639222016:12345-0@lo:400:kworker.0 Request processed in 44us (7556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572451.869461:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4699 00000100:00080000:2.0:1788572451.869489:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572451.869496:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572451.873881:0:3649:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff94e634be8a80 x1875449639221888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572476 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572451.873903:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788572451.873912:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e6056e8000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788572451.873918:0:3649:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788572451.896441:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1875449639221888:0@lo:38:kworker.0 00000004:00080000:1.0:1788572451.896482:0:116843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34940us 00000100:00100000:1.0:1788572451.919530:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639222016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572451.919556:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639221760:0@lo:400:kworker.0 00010000:00080000:1.0:1788572451.919823:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94e61e634a80 x1875449639222400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788572451.921976:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 52 00000100:00080000:1.0:1788572451.922254:0:3649:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788572451.922265:0:3649:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788572451.922271:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e501f3b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788572451.922287:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875449639222400:0@lo:38:kworker.0 00010000:00010000:1.0:1788572451.923574:0:116843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a283 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.923601:0:116843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a283 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.923620:0:116843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a283 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.923636:0:116843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.923644:0:116843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.923651:0:116843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.928561:0:116843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a283 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.928586:0:116843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a283 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.928594:0:116843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a283 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.928602:0:116843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572451.928608:0:116843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a283 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.928617:0:116843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a283 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.928638:0:116843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e6053c7b00) 00010000:00010000:1.0:1788572451.928642:0:116843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572451.928648:0:116843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a283 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.928655:0:116843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a283 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572451.928684:0:116843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ef50a42 reply state 00000000ab245e5f transno 219043334909 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.928699:0:116843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.928707:0:116843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e6053c7200) 00010000:00010000:1.0:1788572451.928709:0:116843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572451.928713:0:116843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572451.928910:0:116843:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1788572451.928945:0:116843:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572451.928948:0:116843:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 219043334910 00000020:00080000:1.0:1788572451.928954:0:116843:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572451.928956:0:116843:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 219043334910 00000100:00080000:3.0:1788572451.930127:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 52 00000100:00080000:3.0:1788572451.930151:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788572451.930157:0:3649:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788572451.930161:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 7 00000100:00080000:3.0:1788572451.930166:0:3649:0:(recover.c:53:ptlrpc_replay_next()) import ffff94e607732800 from lustre-MDT0000_UUID committed 4294967298 last 0 00000100:00080000:3.0:1788572451.930170:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788572451.934553:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572451.935238:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616254592 00000100:00100000:1.0:1788572451.935260:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616254592 00000100:00100000:1.0:1788572451.935344:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15529 00000100:00100000:1.0:1788572451.935357:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+8:2382:x1875449616254592:12345-192.168.202.13@tcp:36:rm.0 00010000:00080000:1.0:1788572451.935388:0:10390:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 219043334910, current: 219043334910, replaying 00000100:00100000:1.0:1788572451.935403:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+8:2382:x1875449616254592:12345-192.168.202.13@tcp:36:rm.0 Request processed in 49us (864us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788572451.935410:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15529 00000020:00080000:1.0:1788572451.935452:0:116843:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572451.935458:0:116843:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 219043334910, next_transno: 219043334910 00010000:00080000:1.0:1788572451.935463:0:116843:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (219043334910) 00000020:00080000:1.0:1788572451.935467:0:116843:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572451.935501:0:116843:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875449616254592 t219043334910 from 192.168.202.13@tcp req@ffff94e62dac7800 x1875449616254592/t0(219043334910) o36->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:112/0 lens 512/0 e 0 to 0 dl 1788572462 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788572451.935625:0:116843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a291 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.935645:0:116843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a291 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.935659:0:116843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a291 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.935673:0:116843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.935682:0:116843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.935689:0:116843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.935813:0:116843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a29f lrc: 3/0,1 mode: --/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.935822:0:116843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a29f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.935829:0:116843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a29f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.940818:0:116843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a29f lrc: 3/0,1 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941531:0:116843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a29f lrc: 2/0,0 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941547:0:116843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a29f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941554:0:116843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589600 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572451.941562:0:116843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a29f lrc: 3/0,0 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941573:0:116843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a29f lrc: 4/0,0 mode: EX/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941596:0:116843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000182d1:0x966:0x0].0x0 (ffff94e61e6d1c00) 00010000:00010000:1.0:1788572451.941599:0:116843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788572451.941605:0:116843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a29f lrc: 2/0,0 mode: --/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941612:0:116843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589600/0xdb7edb52b833a29f lrc: 0/0,0 mode: --/EX res: [0x2000182d1:0x966:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941654:0:116843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a291 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941662:0:116843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a291 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941669:0:116843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a291 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941674:0:116843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589200 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572451.941678:0:116843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a291 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941685:0:116843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a291 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941693:0:116843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e61e6d1f00) 00010000:00010000:1.0:1788572451.941695:0:116843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572451.941698:0:116843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a291 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941705:0:116843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589200/0xdb7edb52b833a291 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788572451.941719:0:116843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae7b2dec reply state 00000000079261d1 transno 219043334910 ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941736:0:116843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.941746:0:116843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e6053c7200) 00010000:00010000:1.0:1788572451.941748:0:116843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788572451.941752:0:116843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788572451.943209:0:116843:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788572451.943263:0:116843:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572451.943268:0:116843:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 219043334911 00000020:00080000:1.0:1788572451.943273:0:116843:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788572451.943275:0:116843:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 219043334911 00000100:00100000:3.0:1788572451.945453:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639221120:0@lo:38:kworker.0 00010000:00080000:3.0:1788572451.945520:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94e5038c2a00 x1875449639221248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.945545:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 52 00000001:00080000:1.0:1788572451.945676:0:116811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 219043334909 is committed 00010000:00010000:1.0:1788572451.945731:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.945751:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.945760:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.945766:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589400 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:1.0:1788572451.945772:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.945781:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.945802:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e6053c7200) 00010000:00010000:1.0:1788572451.945806:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788572451.945812:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572451.945819:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589400/0xdb7edb52b833a28a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788572451.953133:0:3649:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff94e5038c2a00 x1875449639221248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572476 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.953154:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788572451.953162:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e63c3af800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788572451.953168:0:3649:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788572451.953177:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875449639221248:0@lo:38:kworker.0 00010000:00080000:3.0:1788572451.953236:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff94e5038c0700 x1875449639221504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.953258:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 52 00010000:00080000:2.0:1788572451.955770:0:117040:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1788572451.955780:0:117040:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1788572451.955788:0:117040:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1788572451.956332:0:117040:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:3.0:1788572451.957376:0:3649:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff94e5038c0700 x1875449639221504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788572476 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.957390:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788572451.957398:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e50222f800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788572451.957404:0:3649:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788572451.957411:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1875449639221504:0@lo:38:kworker.0 00000100:00100000:3.0:1788572451.957469:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639222528:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788572451.957565:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572451.957885:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572451.957960:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616259328 00000100:00100000:3.0:1788572451.957972:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616259328 00000100:00100000:3.0:1788572451.958224:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4700 00000100:00100000:3.0:1788572451.958237:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+8:2382:x1875449616259328:12345-192.168.202.13@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788572451.958270:0:6552:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff94e61e636d80 x1875449616259328/t0(0) o400->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:112/0 lens 224/0 e 0 to 0 dl 1788572462 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788572451.958290:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+8:2382:x1875449616259328:12345-192.168.202.13@tcp:400:ldlm_lock_repla.0 Request processed in 57us (409us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572451.958297:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4700 00000020:00080000:3.0:1788572451.958318:0:116843:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572451.958323:0:116843:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 219043334911 00000100:00100000:0.0:1788572451.961068:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639222528 00000100:00100000:0.0:1788572451.961086:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639222528 00000100:00100000:0.0:1788572451.961180:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823 00000100:00100000:0.0:1788572451.961195:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875449639222528:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788572451.961225:0:6556:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff94e62dac4700 x1875449639222528/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:112/0 lens 224/0 e 0 to 0 dl 1788572462 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572451.961249:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875449639222528:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 59us (3686us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788572451.961256:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823 00000020:00080000:3.0:1788572451.961303:0:116843:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572451.961314:0:116843:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 219043334911 00010000:00080000:3.0:1788572451.961319:0:116843:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788572451.961323:0:116843:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788572451.961334:0:116843:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788572451.961338:0:116843:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788572451.961510:0:116843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 52, last_transno is 223338299392 00000001:00100000:2.0:1788572451.964749:0:116811:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788572451.964766:0:116811:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000001:00080000:2.0:1788572451.964801:0:116811:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 219043334910 is committed 00000001:00080000:0.0:1788572451.964891:0:116843:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1788572451.965059:0:116843:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00010000:3.0:1788572451.965076:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788572451.965081:0:116843:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.202.13@tcp: req@ffff94e61e636d80 x1875449616259328/t0(0) o400->35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp:112/0 lens 224/0 e 0 to 0 dl 1788572462 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788572451.965122:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.965134:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.965142:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589a00 already unused, calling callback (ffffffffc17dd4f0) 00010000:00010000:3.0:1788572451.965148:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.965159:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.965191:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc234b7d (ffff94e6053c7200) 00010000:00010000:3.0:1788572451.965196:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788572451.965203:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572451.965210:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e641589a00/0xdb7edb52b833a298 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc234b7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 116843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788572451.965256:0:116843:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff94e62dac4700 x1875449639222528/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:112/0 lens 224/0 e 0 to 0 dl 1788572462 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1788572451.965334:0:116843:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:01, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788572451.965467:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788572451.965481:0:3649:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff94e61e636680 x1875449639222528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572467 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.965492:0:3649:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff94e61e636680 x1875449639222528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788572467 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788572451.965499:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e607732800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788572451.965517:0:3649:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788572451.965523:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1875449639222528:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788572451.968238:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639222656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572451.968331:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572451.970476:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639222656 00000100:00100000:1.0:1788572451.970493:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639222656 00000100:00100000:1.0:1788572451.970576:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824 00000100:00100000:1.0:1788572451.971742:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639222656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572451.971784:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:1.0:1788572451.971884:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639222656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (3552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572451.974101:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639222656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572451.977028:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824 00000004:00000080:1.0:1788572451.999345:0:116843:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa895c8687e10 00100000:10000000:1.0:1788572451.999366:0:116843:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1788572452.000822:0:116831:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0xb31:0x0] 00000100:00100000:3.0:1788572452.000900:0:116831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:116831:1875449639222784:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788572452.001027:0:116831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788572452.001148:0:116829:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0xb32:0x0] 00000100:00100000:3.0:1788572452.001188:0:116831:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e641382b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788572452.001206:0:116829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:116829:1875449639222912:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788572452.001634:0:116829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572452.001687:0:116829:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61f03c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572452.005989:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639222784 00000100:00100000:3.0:1788572452.006040:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639222784 00000100:00100000:3.0:1788572452.006140:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639222912 00000100:00100000:3.0:1788572452.006145:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639222912 00000100:00100000:3.0:1788572452.006202:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4503 00000100:00100000:3.0:1788572452.006217:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:116831:x1875449639222784:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:3.0:1788572452.006239:0:43973:0:(tgt_handler.c:403:tgt_handle_request0()) *** cfs_fail_loc=204, val=2147483648*** 00000100:00100000:0.0:1788572452.006249:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4504 00000100:00100000:0.0:1788572452.006281:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:116829:x1875449639222912:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788572452.006325:0:8466:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 2913 -> diff = -47 00002000:02000040:0.0:1788572452.006331:0:8466:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:2867 to 0x280000401:2913) 00000100:00100000:3.0:1788572452.012731:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:116831:x1875449639222784:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6510us (11719us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788572452.012747:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4503 00002000:00010000:1.0:1788572452.025290:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.025305:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b833a2a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.025325:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb61:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.025331:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.025409:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b833a2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.025430:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b833a2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.025442:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b833a2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.025451:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b833a2a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.025513:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572452.025639:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.025645:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b833a2ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.025653:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb60:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.025656:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.025661:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b833a2ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.025670:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b833a2ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.025678:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b833a2ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.025685:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b833a2ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.025713:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572452.025721:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b833a2a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.025729:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.025734:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b833a2a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.025744:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b833a2a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.025764:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b833a2a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.025771:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3e34177/0xdb7edb52b833a2a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.025791:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.025794:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b833a2ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.025801:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.025804:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b833a2ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.025812:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b833a2ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.025822:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b833a2ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.025828:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.025830:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.025831:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.025892:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.025897:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004833a039/0xdb7edb52b833a2ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.025988:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.025993:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000911288d5/0xdb7edb52b833a2b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026027:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5f:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.026032:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.026038:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000911288d5/0xdb7edb52b833a2b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026049:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000911288d5/0xdb7edb52b833a2b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026063:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000911288d5/0xdb7edb52b833a2b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026070:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000911288d5/0xdb7edb52b833a2b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026188:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.026196:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000911288d5/0xdb7edb52b833a2b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026205:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.026209:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000911288d5/0xdb7edb52b833a2b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026219:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000911288d5/0xdb7edb52b833a2b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026235:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000911288d5/0xdb7edb52b833a2b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026246:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.026252:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.026254:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.026319:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.026324:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000911288d5/0xdb7edb52b833a2b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.026414:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.026420:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b06ad6/0xdb7edb52b833a2bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026427:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5e:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.026430:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.026434:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b06ad6/0xdb7edb52b833a2bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026444:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b06ad6/0xdb7edb52b833a2bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026452:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039b06ad6/0xdb7edb52b833a2bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026465:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039b06ad6/0xdb7edb52b833a2bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026552:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.026558:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039b06ad6/0xdb7edb52b833a2bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026571:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.026575:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b06ad6/0xdb7edb52b833a2bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026583:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039b06ad6/0xdb7edb52b833a2bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026595:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039b06ad6/0xdb7edb52b833a2bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026604:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.026606:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.026607:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.026667:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.026671:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b06ad6/0xdb7edb52b833a2bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.026746:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.026752:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b833a2c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026760:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5d:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.026763:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.026767:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b833a2c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026777:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b833a2c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026785:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b833a2c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.026793:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b833a2c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026826:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.026831:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b833a2c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026840:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.026843:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b833a2c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026853:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b833a2c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026863:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b833a2c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.026872:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.026874:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.026876:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.026999:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.027024:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c8efbf6/0xdb7edb52b833a2c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.027117:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.027123:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a5eff2a/0xdb7edb52b833a2c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027132:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5c:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.027134:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.027138:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a5eff2a/0xdb7edb52b833a2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027148:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a5eff2a/0xdb7edb52b833a2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027156:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a5eff2a/0xdb7edb52b833a2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027164:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a5eff2a/0xdb7edb52b833a2c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027215:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.027221:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a5eff2a/0xdb7edb52b833a2c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027230:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.027233:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a5eff2a/0xdb7edb52b833a2c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027241:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a5eff2a/0xdb7edb52b833a2c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027253:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a5eff2a/0xdb7edb52b833a2c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027261:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.027263:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.027264:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.027318:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.027323:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a5eff2a/0xdb7edb52b833a2c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.027426:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.027431:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b833a2d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027440:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5b:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.027443:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.027447:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b833a2d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027456:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b833a2d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027464:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b833a2d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027471:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b833a2d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027552:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.027557:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b833a2d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027566:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.027569:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b833a2d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027577:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b833a2d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027587:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b833a2d0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027596:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.027597:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.027599:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.027652:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.027657:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecdf3df1/0xdb7edb52b833a2d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.027741:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.027747:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b833a2d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027760:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5a:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.027763:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.027767:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b833a2d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027776:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b833a2d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027783:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b833a2d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.027789:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b833a2d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027819:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.027824:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b833a2d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027831:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.027834:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b833a2d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027842:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b833a2d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027854:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b833a2d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.027862:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.027864:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.027865:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.027992:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.027998:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c426f26b/0xdb7edb52b833a2d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.028106:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.028112:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b04dac/0xdb7edb52b833a2de lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028120:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb59:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.028123:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.028127:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006b04dac/0xdb7edb52b833a2de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028138:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006b04dac/0xdb7edb52b833a2de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028146:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b04dac/0xdb7edb52b833a2de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028153:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006b04dac/0xdb7edb52b833a2de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.028198:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.028203:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006b04dac/0xdb7edb52b833a2de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.028211:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.028214:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b04dac/0xdb7edb52b833a2de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.028222:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b04dac/0xdb7edb52b833a2de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.028231:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006b04dac/0xdb7edb52b833a2de lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.028240:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.028242:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.028243:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.028300:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.028305:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006b04dac/0xdb7edb52b833a2de lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.028392:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.028398:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b833a2e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028406:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb58:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.028410:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.028413:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b833a2e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028423:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b833a2e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028437:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b833a2e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028443:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b833a2e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.028535:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.028541:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b833a2e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.028550:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.028553:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b833a2e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.028561:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b833a2e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.028577:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b833a2e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.028585:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.028587:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.028589:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.028617:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.028622:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000478bd794/0xdb7edb52b833a2e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.028702:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.028708:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4128b55/0xdb7edb52b833a2ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028716:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb57:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.028719:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.028723:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4128b55/0xdb7edb52b833a2ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028732:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4128b55/0xdb7edb52b833a2ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028741:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4128b55/0xdb7edb52b833a2ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028751:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4128b55/0xdb7edb52b833a2ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028772:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788572452.028799:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788572452.028807:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4128b55/0xdb7edb52b833a2ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572452.028817:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641589e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:3.0:1788572452.028821:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4128b55/0xdb7edb52b833a2ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572452.028830:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4128b55/0xdb7edb52b833a2ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.028837:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788572452.028843:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4128b55/0xdb7edb52b833a2ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028844:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a5cc95/0xdb7edb52b833a2f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572452.028865:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4128b55/0xdb7edb52b833a2ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.028867:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb56:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.028875:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.028884:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a5cc95/0xdb7edb52b833a2f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572452.028894:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.028895:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a5cc95/0xdb7edb52b833a2f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572452.028897:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788572452.028901:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.028908:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a5cc95/0xdb7edb52b833a2f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.028994:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.029060:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a5cc95/0xdb7edb52b833a2f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.029115:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572452.029182:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.029188:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000193a2921/0xdb7edb52b833a2fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.029197:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb55:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.029201:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.029205:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000193a2921/0xdb7edb52b833a2fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.029216:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000193a2921/0xdb7edb52b833a2fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.029225:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000193a2921/0xdb7edb52b833a2fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.029232:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000193a2921/0xdb7edb52b833a2fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029278:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572452.029284:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a5cc95/0xdb7edb52b833a2f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029292:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e641588800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.029296:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a5cc95/0xdb7edb52b833a2f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029304:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a5cc95/0xdb7edb52b833a2f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029316:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a5cc95/0xdb7edb52b833a2f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029324:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a5cc95/0xdb7edb52b833a2f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029409:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.029414:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000193a2921/0xdb7edb52b833a2fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029422:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa53a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.029425:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000193a2921/0xdb7edb52b833a2fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029434:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000193a2921/0xdb7edb52b833a2fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029444:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000193a2921/0xdb7edb52b833a2fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029452:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.029453:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.029455:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.029518:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.029524:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000193a2921/0xdb7edb52b833a2fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.029605:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.029611:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000844ed83f/0xdb7edb52b833a301 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.029620:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb54:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.029623:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.029628:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000844ed83f/0xdb7edb52b833a301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.029638:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000844ed83f/0xdb7edb52b833a301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.029647:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000844ed83f/0xdb7edb52b833a301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.029654:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000844ed83f/0xdb7edb52b833a301 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029680:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.029684:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000844ed83f/0xdb7edb52b833a301 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029691:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa53800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.029695:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000844ed83f/0xdb7edb52b833a301 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029704:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000844ed83f/0xdb7edb52b833a301 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029715:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000844ed83f/0xdb7edb52b833a301 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.029725:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.029727:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.029729:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.029782:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.029787:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000844ed83f/0xdb7edb52b833a301 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.029862:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.029868:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065daef38/0xdb7edb52b833a308 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.029877:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb53:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.029880:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.029885:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065daef38/0xdb7edb52b833a308 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.029896:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065daef38/0xdb7edb52b833a308 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.030207:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065daef38/0xdb7edb52b833a308 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.030218:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065daef38/0xdb7edb52b833a308 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.030268:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.030274:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065daef38/0xdb7edb52b833a308 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.030283:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.030288:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065daef38/0xdb7edb52b833a308 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.030297:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065daef38/0xdb7edb52b833a308 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.030311:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065daef38/0xdb7edb52b833a308 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.030320:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.030322:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.030324:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.032675:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.032694:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065daef38/0xdb7edb52b833a308 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.032952:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.032960:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940ff546/0xdb7edb52b833a30f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.032976:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb52:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.032980:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.032987:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940ff546/0xdb7edb52b833a30f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.033027:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000940ff546/0xdb7edb52b833a30f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.033038:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940ff546/0xdb7edb52b833a30f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.033052:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000940ff546/0xdb7edb52b833a30f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.033443:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.033452:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000940ff546/0xdb7edb52b833a30f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.033461:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa53c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.033465:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000940ff546/0xdb7edb52b833a30f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.033476:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000940ff546/0xdb7edb52b833a30f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.033493:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000940ff546/0xdb7edb52b833a30f lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.033502:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.033504:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.033506:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.033571:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.033577:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000940ff546/0xdb7edb52b833a30f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.033686:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.033692:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a891bd52/0xdb7edb52b833a316 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.033701:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb51:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.033705:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.033709:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a891bd52/0xdb7edb52b833a316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.033719:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a891bd52/0xdb7edb52b833a316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.033728:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a891bd52/0xdb7edb52b833a316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.033735:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a891bd52/0xdb7edb52b833a316 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.033768:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.033773:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a891bd52/0xdb7edb52b833a316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.033781:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.033785:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a891bd52/0xdb7edb52b833a316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.033794:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a891bd52/0xdb7edb52b833a316 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.033805:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a891bd52/0xdb7edb52b833a316 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.033813:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.033815:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.033817:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.033874:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.033880:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a891bd52/0xdb7edb52b833a316 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.033961:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.033968:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d568bb81/0xdb7edb52b833a31d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.033977:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb50:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.033980:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.033984:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d568bb81/0xdb7edb52b833a31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.033993:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d568bb81/0xdb7edb52b833a31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034001:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d568bb81/0xdb7edb52b833a31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034028:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d568bb81/0xdb7edb52b833a31d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034124:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.034129:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d568bb81/0xdb7edb52b833a31d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034137:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa53400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.034141:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d568bb81/0xdb7edb52b833a31d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034150:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d568bb81/0xdb7edb52b833a31d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034162:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d568bb81/0xdb7edb52b833a31d lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034171:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.034173:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.034174:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.034227:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.034233:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d568bb81/0xdb7edb52b833a31d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.034314:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.034320:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5bb2eb2/0xdb7edb52b833a324 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034328:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4f:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.034332:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.034405:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5bb2eb2/0xdb7edb52b833a324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034417:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5bb2eb2/0xdb7edb52b833a324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034426:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5bb2eb2/0xdb7edb52b833a324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034433:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5bb2eb2/0xdb7edb52b833a324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034457:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.034463:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5bb2eb2/0xdb7edb52b833a324 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034470:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.034473:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5bb2eb2/0xdb7edb52b833a324 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034482:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5bb2eb2/0xdb7edb52b833a324 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034498:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5bb2eb2/0xdb7edb52b833a324 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034506:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.034507:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.034509:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.034564:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.034569:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5bb2eb2/0xdb7edb52b833a324 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.034646:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.034651:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b62fe8a/0xdb7edb52b833a32b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034665:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4e:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.034668:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.034673:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b62fe8a/0xdb7edb52b833a32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034682:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b62fe8a/0xdb7edb52b833a32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034689:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b62fe8a/0xdb7edb52b833a32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034696:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b62fe8a/0xdb7edb52b833a32b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034722:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.034728:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b62fe8a/0xdb7edb52b833a32b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034735:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.034738:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b62fe8a/0xdb7edb52b833a32b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034746:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b62fe8a/0xdb7edb52b833a32b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034757:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b62fe8a/0xdb7edb52b833a32b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.034765:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.034766:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.034768:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.034824:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.034829:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b62fe8a/0xdb7edb52b833a32b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.034900:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.034906:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbc55a45/0xdb7edb52b833a332 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034915:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4d:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.034931:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.034935:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbc55a45/0xdb7edb52b833a332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034946:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbc55a45/0xdb7edb52b833a332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034954:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbc55a45/0xdb7edb52b833a332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.034963:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbc55a45/0xdb7edb52b833a332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.036631:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.036643:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbc55a45/0xdb7edb52b833a332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.036661:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.036665:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbc55a45/0xdb7edb52b833a332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.036676:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbc55a45/0xdb7edb52b833a332 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.036696:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbc55a45/0xdb7edb52b833a332 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.036707:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.036709:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.036711:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.036785:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.036794:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbc55a45/0xdb7edb52b833a332 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.037325:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572452.039043:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.039059:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e301e4b/0xdb7edb52b833a339 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039078:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4c:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.039083:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.039099:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e301e4b/0xdb7edb52b833a339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039114:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e301e4b/0xdb7edb52b833a339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039131:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e301e4b/0xdb7edb52b833a339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039140:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e301e4b/0xdb7edb52b833a339 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039174:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572452.039307:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.039313:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5310dd5/0xdb7edb52b833a340 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039321:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4b:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.039325:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.039329:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5310dd5/0xdb7edb52b833a340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039788:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5310dd5/0xdb7edb52b833a340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039801:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5310dd5/0xdb7edb52b833a340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039809:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5310dd5/0xdb7edb52b833a340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039865:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572452.039967:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.039972:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099a153bc/0xdb7edb52b833a347 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039981:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4a:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.039984:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.039989:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099a153bc/0xdb7edb52b833a347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.039997:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099a153bc/0xdb7edb52b833a347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.040024:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099a153bc/0xdb7edb52b833a347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.040031:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099a153bc/0xdb7edb52b833a347 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040149:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572452.040159:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e301e4b/0xdb7edb52b833a339 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040169:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa53200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.040175:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e301e4b/0xdb7edb52b833a339 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040185:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e301e4b/0xdb7edb52b833a339 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040206:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e301e4b/0xdb7edb52b833a339 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572452.040208:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572452.040231:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5310dd5/0xdb7edb52b833a340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040232:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e301e4b/0xdb7edb52b833a339 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572452.040251:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa53600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572452.040261:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5310dd5/0xdb7edb52b833a340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572452.040276:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5310dd5/0xdb7edb52b833a340 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040291:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.040297:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099a153bc/0xdb7edb52b833a347 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572452.040300:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5310dd5/0xdb7edb52b833a340 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040332:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572452.040336:0:92610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5310dd5/0xdb7edb52b833a340 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040349:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099a153bc/0xdb7edb52b833a347 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040361:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099a153bc/0xdb7edb52b833a347 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572452.040376:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.040378:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099a153bc/0xdb7edb52b833a347 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572452.040381:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572452.040385:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.040395:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.040399:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.040402:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.040626:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.040633:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099a153bc/0xdb7edb52b833a347 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.040743:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.040750:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d8bd0c/0xdb7edb52b833a34e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.040760:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb49:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.040763:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.040767:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d8bd0c/0xdb7edb52b833a34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.040777:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060d8bd0c/0xdb7edb52b833a34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.040785:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d8bd0c/0xdb7edb52b833a34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.040793:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060d8bd0c/0xdb7edb52b833a34e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040820:0:6539:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.040826:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060d8bd0c/0xdb7edb52b833a34e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040833:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.040838:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d8bd0c/0xdb7edb52b833a34e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040847:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d8bd0c/0xdb7edb52b833a34e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040865:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060d8bd0c/0xdb7edb52b833a34e lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.040874:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.040876:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.040878:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.041021:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.041027:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060d8bd0c/0xdb7edb52b833a34e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.041120:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.041125:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdef2516/0xdb7edb52b833a355 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.041133:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb48:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.041136:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.041141:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdef2516/0xdb7edb52b833a355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.041150:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdef2516/0xdb7edb52b833a355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.041159:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdef2516/0xdb7edb52b833a355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.041166:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdef2516/0xdb7edb52b833a355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.041220:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.041225:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdef2516/0xdb7edb52b833a355 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.041232:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa53000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.041236:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdef2516/0xdb7edb52b833a355 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.041244:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdef2516/0xdb7edb52b833a355 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.041255:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdef2516/0xdb7edb52b833a355 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.041264:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.041265:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.041267:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.041449:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.041454:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdef2516/0xdb7edb52b833a355 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.041548:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.041554:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a2246bc/0xdb7edb52b833a35c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.041563:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb47:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.041566:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.041570:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a2246bc/0xdb7edb52b833a35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.041580:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a2246bc/0xdb7edb52b833a35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.041594:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a2246bc/0xdb7edb52b833a35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.041601:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a2246bc/0xdb7edb52b833a35c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.041985:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.041993:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a2246bc/0xdb7edb52b833a35c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.042027:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e63aa52c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.042031:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a2246bc/0xdb7edb52b833a35c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.042038:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a2246bc/0xdb7edb52b833a35c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.042051:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a2246bc/0xdb7edb52b833a35c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.042059:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.042061:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.042062:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.042120:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.042126:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a2246bc/0xdb7edb52b833a35c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.042228:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.042234:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fcda39d/0xdb7edb52b833a363 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042242:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb46:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.042246:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.042250:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fcda39d/0xdb7edb52b833a363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042260:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fcda39d/0xdb7edb52b833a363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042268:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fcda39d/0xdb7edb52b833a363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042278:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fcda39d/0xdb7edb52b833a363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042300:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572452.042440:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.042446:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa7b360/0xdb7edb52b833a36a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042455:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb45:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.042458:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.042461:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa7b360/0xdb7edb52b833a36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042471:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aa7b360/0xdb7edb52b833a36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042477:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa7b360/0xdb7edb52b833a36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042485:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aa7b360/0xdb7edb52b833a36a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042498:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572452.042558:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.042564:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e14d4581/0xdb7edb52b833a371 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042571:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb44:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.042574:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.042577:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e14d4581/0xdb7edb52b833a371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042586:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e14d4581/0xdb7edb52b833a371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042593:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e14d4581/0xdb7edb52b833a371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042599:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e14d4581/0xdb7edb52b833a371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042612:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788572452.042671:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb43:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.042676:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c18b60b/0xdb7edb52b833a378 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb43:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042683:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb43:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.042686:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb43:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.042692:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c18b60b/0xdb7edb52b833a378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042701:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c18b60b/0xdb7edb52b833a378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042713:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c18b60b/0xdb7edb52b833a378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042720:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c18b60b/0xdb7edb52b833a378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042731:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788572452.042791:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.042797:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d5a8353/0xdb7edb52b833a37f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042806:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb42:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.042809:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.042813:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d5a8353/0xdb7edb52b833a37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042822:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d5a8353/0xdb7edb52b833a37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042830:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d5a8353/0xdb7edb52b833a37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042838:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d5a8353/0xdb7edb52b833a37f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.042850:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788572452.042906:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788572452.043035:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788572452.043041:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fcda39d/0xdb7edb52b833a363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043048:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.043052:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fcda39d/0xdb7edb52b833a363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043060:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fcda39d/0xdb7edb52b833a363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043073:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fcda39d/0xdb7edb52b833a363 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043080:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fcda39d/0xdb7edb52b833a363 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043120:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572452.043124:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aa7b360/0xdb7edb52b833a36a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043131:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.043134:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa7b360/0xdb7edb52b833a36a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043141:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa7b360/0xdb7edb52b833a36a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043151:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aa7b360/0xdb7edb52b833a36a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043158:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aa7b360/0xdb7edb52b833a36a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043171:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572452.043174:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e14d4581/0xdb7edb52b833a371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043181:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a0a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.043184:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e14d4581/0xdb7edb52b833a371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043191:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e14d4581/0xdb7edb52b833a371 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043201:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e14d4581/0xdb7edb52b833a371 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043208:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e14d4581/0xdb7edb52b833a371 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043221:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572452.043225:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c18b60b/0xdb7edb52b833a378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043231:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a1200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.043234:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c18b60b/0xdb7edb52b833a378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043242:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c18b60b/0xdb7edb52b833a378 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043251:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c18b60b/0xdb7edb52b833a378 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043259:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c18b60b/0xdb7edb52b833a378 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb43:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043270:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.043273:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d5a8353/0xdb7edb52b833a37f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043278:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e6013a0600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.043281:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d5a8353/0xdb7edb52b833a37f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043289:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d5a8353/0xdb7edb52b833a37f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043299:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d5a8353/0xdb7edb52b833a37f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043306:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d5a8353/0xdb7edb52b833a37f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.043317:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.043319:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.043322:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.043330:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.043421:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc3f45eb/0xdb7edb52b833a386 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043431:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb41:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.043435:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.043438:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc3f45eb/0xdb7edb52b833a386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043448:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc3f45eb/0xdb7edb52b833a386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043457:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc3f45eb/0xdb7edb52b833a386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043465:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc3f45eb/0xdb7edb52b833a386 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043481:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572452.043565:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.043570:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001100bc19/0xdb7edb52b833a38d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043578:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb40:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.043582:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.043587:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001100bc19/0xdb7edb52b833a38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043597:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001100bc19/0xdb7edb52b833a38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043606:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001100bc19/0xdb7edb52b833a38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043613:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001100bc19/0xdb7edb52b833a38d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043626:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572452.043681:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.043687:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e7d99f4/0xdb7edb52b833a394 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043694:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3f:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.043697:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.043701:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e7d99f4/0xdb7edb52b833a394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043710:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e7d99f4/0xdb7edb52b833a394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043719:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e7d99f4/0xdb7edb52b833a394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043728:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e7d99f4/0xdb7edb52b833a394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043737:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788572452.043787:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.043793:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015aabd97/0xdb7edb52b833a39b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043801:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3e:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.043804:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.043808:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015aabd97/0xdb7edb52b833a39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043817:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015aabd97/0xdb7edb52b833a39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043825:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015aabd97/0xdb7edb52b833a39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043833:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015aabd97/0xdb7edb52b833a39b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043840:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788572452.043892:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.043898:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000819e9883/0xdb7edb52b833a3a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.043907:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3d:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.043909:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788572452.043989:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.043999:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788572452.044023:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc3f45eb/0xdb7edb52b833a386 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044032:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.044035:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc3f45eb/0xdb7edb52b833a386 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044044:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc3f45eb/0xdb7edb52b833a386 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044056:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc3f45eb/0xdb7edb52b833a386 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044063:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc3f45eb/0xdb7edb52b833a386 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044079:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788572452.044082:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001100bc19/0xdb7edb52b833a38d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044099:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.044103:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001100bc19/0xdb7edb52b833a38d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044111:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001100bc19/0xdb7edb52b833a38d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044126:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001100bc19/0xdb7edb52b833a38d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044133:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001100bc19/0xdb7edb52b833a38d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044146:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572452.044150:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e7d99f4/0xdb7edb52b833a394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044156:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.044159:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e7d99f4/0xdb7edb52b833a394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044167:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e7d99f4/0xdb7edb52b833a394 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044176:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e7d99f4/0xdb7edb52b833a394 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044183:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e7d99f4/0xdb7edb52b833a394 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044195:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.044198:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015aabd97/0xdb7edb52b833a39b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044205:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.044208:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015aabd97/0xdb7edb52b833a39b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044216:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015aabd97/0xdb7edb52b833a39b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044225:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015aabd97/0xdb7edb52b833a39b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044233:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015aabd97/0xdb7edb52b833a39b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044243:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.044245:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.044247:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.044252:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.044257:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.044261:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.044308:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000819e9883/0xdb7edb52b833a3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.044320:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000819e9883/0xdb7edb52b833a3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.044328:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000819e9883/0xdb7edb52b833a3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.044402:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000819e9883/0xdb7edb52b833a3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.044457:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572452.044530:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.044536:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a9d184/0xdb7edb52b833a3a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.044544:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3c:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.044548:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.044553:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009a9d184/0xdb7edb52b833a3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.044561:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009a9d184/0xdb7edb52b833a3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.044574:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009a9d184/0xdb7edb52b833a3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.044582:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009a9d184/0xdb7edb52b833a3a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044651:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572452.044657:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000819e9883/0xdb7edb52b833a3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044667:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.044671:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000819e9883/0xdb7edb52b833a3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044684:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000819e9883/0xdb7edb52b833a3a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044698:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000819e9883/0xdb7edb52b833a3a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044706:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000819e9883/0xdb7edb52b833a3a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044728:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.044732:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009a9d184/0xdb7edb52b833a3a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572452.044739:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.044740:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.044748:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a9d184/0xdb7edb52b833a3a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044756:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009a9d184/0xdb7edb52b833a3a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044765:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009a9d184/0xdb7edb52b833a3a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044771:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.044772:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.044776:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.044835:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.044840:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009a9d184/0xdb7edb52b833a3a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.044995:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572452.045069:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.045075:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3d318ef/0xdb7edb52b833a3b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045083:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3b:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.045087:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.045102:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3d318ef/0xdb7edb52b833a3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045113:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3d318ef/0xdb7edb52b833a3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045121:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3d318ef/0xdb7edb52b833a3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045133:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3d318ef/0xdb7edb52b833a3b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045153:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572452.045221:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.045227:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044902be8/0xdb7edb52b833a3b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045236:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3a:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.045239:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.045243:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044902be8/0xdb7edb52b833a3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045251:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044902be8/0xdb7edb52b833a3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045259:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044902be8/0xdb7edb52b833a3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045266:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044902be8/0xdb7edb52b833a3b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045285:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788572452.045425:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572452.045431:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3d318ef/0xdb7edb52b833a3b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.045438:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.045442:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3d318ef/0xdb7edb52b833a3b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.045450:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3d318ef/0xdb7edb52b833a3b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.045462:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3d318ef/0xdb7edb52b833a3b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.045469:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3d318ef/0xdb7edb52b833a3b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.045485:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.045488:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044902be8/0xdb7edb52b833a3b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.045495:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.045498:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044902be8/0xdb7edb52b833a3b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.045511:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044902be8/0xdb7edb52b833a3b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.045522:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044902be8/0xdb7edb52b833a3b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.045528:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044902be8/0xdb7edb52b833a3b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.045540:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.045542:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.045544:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788572452.045592:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.045598:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050078ba4/0xdb7edb52b833a3be lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045605:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb39:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.045608:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.045613:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050078ba4/0xdb7edb52b833a3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045623:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050078ba4/0xdb7edb52b833a3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045631:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050078ba4/0xdb7edb52b833a3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045638:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050078ba4/0xdb7edb52b833a3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045661:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572452.045734:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.045741:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000535bf5f5/0xdb7edb52b833a3c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045749:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb38:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.045752:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.045756:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000535bf5f5/0xdb7edb52b833a3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045765:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000535bf5f5/0xdb7edb52b833a3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045778:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000535bf5f5/0xdb7edb52b833a3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045784:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000535bf5f5/0xdb7edb52b833a3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045796:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572452.045856:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.045861:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c895e8d8/0xdb7edb52b833a3cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045869:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb37:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.045873:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.045876:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c895e8d8/0xdb7edb52b833a3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045885:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c895e8d8/0xdb7edb52b833a3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045893:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c895e8d8/0xdb7edb52b833a3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.045899:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c895e8d8/0xdb7edb52b833a3cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046029:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572452.046035:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050078ba4/0xdb7edb52b833a3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046043:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.046046:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050078ba4/0xdb7edb52b833a3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046055:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050078ba4/0xdb7edb52b833a3be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046067:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050078ba4/0xdb7edb52b833a3be lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046079:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050078ba4/0xdb7edb52b833a3be lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046105:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.046108:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000535bf5f5/0xdb7edb52b833a3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046114:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.046118:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000535bf5f5/0xdb7edb52b833a3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046126:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000535bf5f5/0xdb7edb52b833a3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046136:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000535bf5f5/0xdb7edb52b833a3c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046142:0:17013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000535bf5f5/0xdb7edb52b833a3c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046153:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.046155:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.046157:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.046165:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.046237:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572452.046307:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.046315:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011b25610/0xdb7edb52b833a3d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.046324:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb36:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.046328:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.046334:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011b25610/0xdb7edb52b833a3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.046420:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011b25610/0xdb7edb52b833a3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.046429:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011b25610/0xdb7edb52b833a3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.046435:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011b25610/0xdb7edb52b833a3d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046495:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788572452.046501:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c895e8d8/0xdb7edb52b833a3cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046509:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.046512:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c895e8d8/0xdb7edb52b833a3cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046521:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c895e8d8/0xdb7edb52b833a3cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046532:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c895e8d8/0xdb7edb52b833a3cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046540:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c895e8d8/0xdb7edb52b833a3cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046555:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.046559:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011b25610/0xdb7edb52b833a3d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046565:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.046568:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b25610/0xdb7edb52b833a3d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046575:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011b25610/0xdb7edb52b833a3d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046584:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011b25610/0xdb7edb52b833a3d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.046591:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.046593:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.046595:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.048698:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.048712:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011b25610/0xdb7edb52b833a3d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.049175:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.049182:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0b49950/0xdb7edb52b833a3da lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.049197:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb35:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.049202:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.049207:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0b49950/0xdb7edb52b833a3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.049221:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0b49950/0xdb7edb52b833a3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.049231:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0b49950/0xdb7edb52b833a3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.049239:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0b49950/0xdb7edb52b833a3da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.049293:0:6538:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.049301:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0b49950/0xdb7edb52b833a3da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.049310:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.049315:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0b49950/0xdb7edb52b833a3da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572452.049322:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.049325:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0b49950/0xdb7edb52b833a3da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.049361:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0b49950/0xdb7edb52b833a3da lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.049373:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.049375:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.049378:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.049614:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.049620:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0b49950/0xdb7edb52b833a3da lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.049742:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.049747:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a3e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.049756:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb34:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.049759:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.049763:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.049774:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.049782:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.049790:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a3e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.049821:0:17013:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.049827:0:17013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a3e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.049835:0:17013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.049838:0:17013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a3e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.049847:0:17013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a3e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.049859:0:17013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a3e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.049867:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.049868:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.049870:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.049991:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.049996:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a3e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572452.050120:0:8466:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572452.050125:0:8466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a53b145/0xdb7edb52b833a3e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.050134:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb33:0x0].0x0 since=4369s v=(0 0) 00010000:00010000:1.0:1788572452.050138:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572452.050142:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a53b145/0xdb7edb52b833a3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.050151:0:8466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a53b145/0xdb7edb52b833a3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.050164:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a53b145/0xdb7edb52b833a3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.050171:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a53b145/0xdb7edb52b833a3e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.050219:0:92610:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788572452.050226:0:92610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a53b145/0xdb7edb52b833a3e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.050234:0:92610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:0.0:1788572452.050238:0:92610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a53b145/0xdb7edb52b833a3e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.050247:0:92610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a53b145/0xdb7edb52b833a3e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.050260:0:92610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a53b145/0xdb7edb52b833a3e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.050267:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.050269:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572452.050271:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572452.050344:0:8466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788572452.050349:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a53b145/0xdb7edb52b833a3e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788572452.050398:0:8466:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:2866 00000100:00100000:1.0:1788572452.050516:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:116829:x1875449639222912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 44244us (48879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572452.050528:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4504 00010000:00010000:0.0:1788572452.050648:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572452.050692:0:116829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:116829:1875449639222912:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788572452.050711:0:116829:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0xb61:0x0] from OST, last_created [0x280000401:0xb61:0x0]last_used is [0x280000401:0xb32:0x0] 00000100:00100000:0.0:1788572452.050798:0:116829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:116829:1875449639223168:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788572452.050841:0:116829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572452.050873:0:116829:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e61f03c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788572452.050878:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639223168 00000100:00100000:3.0:1788572452.050887:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639223168 00000100:00100000:0.0:1788572452.050889:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572452.050903:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639223040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572452.051210:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572452.051299:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639223040 00000100:00100000:0.0:1788572452.051304:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639223040 00000100:00100000:0.0:1788572452.051437:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00100000:0.0:1788572452.051450:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639223040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572452.051486:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572452.051498:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4505 00000100:00100000:3.0:1788572452.051512:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:116829:x1875449639223168:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788572452.051534:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639223040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572452.051544:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00002000:00080000:3.0:1788572452.051552:0:43972:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2914 00000100:00100000:1.0:1788572452.051653:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639223040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572452.054401:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:116829:x1875449639223168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2887us (3552us total) trans 12884902113 rc 0/0 00000100:00100000:3.0:1788572452.054415:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4505 00000100:00100000:0.0:1788572452.054473:0:116829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:116829:1875449639223168:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788572452.054496:0:116829:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0xb61:0x0]-[0x280000401:0xb81:0x0] 00000100:00100000:3.0:1788572452.515778:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572452.515872:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616259456 00000100:00100000:1.0:1788572452.515886:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616259456 00000100:00100000:1.0:1788572452.515962:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:1.0:1788572452.515973:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+5:15207:x1875449616259456:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572452.515997:0:116821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572452.516046:0:116821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e612b12000/0xdb7edb52b833a3ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4b261 expref: -99 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.516086:0:116821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e612b12000/0xdb7edb52b833a3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b261 expref: 6 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.516111:0:116821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e612b12000/0xdb7edb52b833a3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b261 expref: 6 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.516124:0:116821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e612b12000, rc 0) 00000100:00100000:1.0:1788572452.516198:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+6:15207:x1875449616259456:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 225us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572452.516205:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 63 00000100:00100000:3.0:1788572452.520663:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572452.520819:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616259584 00000100:00100000:0.0:1788572452.520836:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616259584 00000100:00100000:0.0:1788572452.520916:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:0.0:1788572452.520929:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+6:15207:x1875449616259584:12345-192.168.202.13@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788572452.520969:0:116815:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788572452.520994:0:116815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788572452.520998:0:116815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788572452.521029:0:116815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788572452.521033:0:116815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788572452.521035:0:116815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 212 00000100:00100000:0.0:1788572452.532940:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+6:15207:x1875449616259584:12345-192.168.202.13@tcp:256:ll_cfg_requeue.0 Request processed in 11996us (12287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572452.532962:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 64 00000100:00100000:0.0:1788572452.543692:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572452.543781:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616259712 00000100:00100000:1.0:1788572452.543797:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616259712 00000100:00100000:1.0:1788572452.543882:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:1.0:1788572452.543897:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+6:15207:x1875449616259712:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788572452.543924:0:116821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788572452.543951:0:116821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e612b13000/0xdb7edb52b833a3f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4b268 expref: -99 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.543996:0:116821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e612b13000/0xdb7edb52b833a3f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b268 expref: 7 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.544067:0:116821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e612b13000/0xdb7edb52b833a3f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b268 expref: 7 pid: 116821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572452.544079:0:116821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e612b13000, rc 0) 00000100:00100000:1.0:1788572452.544174:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+7:15207:x1875449616259712:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 280us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572452.544182:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 65 00000100:00100000:1.0:1788572452.548610:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572452.548698:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616259840 00000100:00100000:3.0:1788572452.548715:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616259840 00000100:00100000:3.0:1788572452.548796:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 66 00000100:00100000:3.0:1788572452.548809:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+7:15207:x1875449616259840:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788572452.549049:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+8:15207:x1875449616259840:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 242us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572452.549059:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 66 00010000:00010000:2.0:1788572452.553926:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572452.569634:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572452.579143:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616259968 00000100:00100000:1.0:1788572452.579166:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616259968 00000100:00100000:1.0:1788572452.579315:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:1.0:1788572452.579327:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+8:15207:x1875449616259968:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572452.579561:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+8:15207:x1875449616259968:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 Request processed in 235us (9945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572452.579570:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 67 00000100:00100000:3.0:1788572452.597077:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572452.598844:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616260096 00000100:00100000:0.0:1788572452.598865:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616260096 00000100:00100000:0.0:1788572452.598950:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:0.0:1788572452.598963:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+8:15207:x1875449616260096:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788572452.598989:0:116818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788572452.599034:0:116818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e63ac9ce00/0xdb7edb52b833a3fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4b26f expref: -99 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.599076:0:116818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e63ac9ce00/0xdb7edb52b833a3fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b26f expref: 9 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.599108:0:116818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e63ac9ce00/0xdb7edb52b833a3fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b26f expref: 9 pid: 116818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788572452.599128:0:116818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ac9ce00, rc 0) 00000100:00100000:0.0:1788572452.599235:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+9:15207:x1875449616260096:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 274us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572452.599243:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 68 00000100:00100000:0.0:1788572452.614605:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572452.614739:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616260224 00000100:00100000:2.0:1788572452.614757:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616260224 00000100:00100000:2.0:1788572452.614845:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:2.0:1788572452.614858:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+9:15207:x1875449616260224:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788572452.615090:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+9:15207:x1875449616260224:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 233us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572452.615132:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 69 00000100:00100000:3.0:1788572452.618863:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572452.619953:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616260352 00000100:00100000:1.0:1788572452.619969:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616260352 00000100:00100000:1.0:1788572452.620057:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00100000:1.0:1788572452.620070:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+9:15207:x1875449616260352:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788572452.620292:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+9:15207:x1875449616260352:12345-192.168.202.13@tcp:503:ll_cfg_requeue.0 Request processed in 224us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572452.620303:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 70 00000100:00100000:0.0:1788572452.650673:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572452.656332:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616260480 00000100:00100000:2.0:1788572452.656432:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616260480 00000100:00100000:3.0:1788572452.656655:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:3.0:1788572452.656670:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+9:15207:x1875449616260480:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788572452.656696:0:116817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788572452.657358:0:116817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94e6136adc00/0xdb7edb52b833a404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4b276 expref: -99 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572452.657408:0:116817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94e6136adc00/0xdb7edb52b833a404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b276 expref: 10 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572452.657426:0:116817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94e6136adc00/0xdb7edb52b833a404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b276 expref: 10 pid: 116817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788572452.657440:0:116817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e6136adc00, rc 0) 00000100:00100000:3.0:1788572452.657554:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:15207:x1875449616260480:12345-192.168.202.13@tcp:101:ll_cfg_requeue.0 Request processed in 885us (6892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572452.657562:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 71 00000100:00100000:2.0:1788572452.665885:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572452.666126:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616260608 00000100:00100000:1.0:1788572452.666142:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616260608 00000100:00100000:1.0:1788572452.666210:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 72 00000100:00100000:1.0:1788572452.666223:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:15207:x1875449616260608:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788572452.666397:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:15207:x1875449616260608:12345-192.168.202.13@tcp:501:ll_cfg_requeue.0 Request processed in 176us (524us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788572452.666406:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 72 00000001:02000400:2.0:1788572452.803402:0:117097:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788572453.573858:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788572454.099399:0:117149:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788572454.099777:0:117149:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788572454.410320:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572454.410344:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639223296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572454.410414:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572454.410462:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639223296 00000100:00100000:0.0:1788572454.410470:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639223296 00000100:00100000:0.0:1788572454.410521:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00100000:0.0:1788572454.410530:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639223296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572454.410560:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572454.410604:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639223296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572454.410612:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00080000:0.0:1788572454.410633:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572454.410672:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639223296:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788572454.595333:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572454.915740:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639223424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572454.915832:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572454.915990:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639223424 00000100:00100000:1.0:1788572454.915998:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639223424 00000100:00100000:1.0:1788572454.916077:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:1.0:1788572454.916085:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639223424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572454.916124:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 198464 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572454.916179:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639223424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572454.916186:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00080000:0.0:1788572454.916297:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572454.916343:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639223424:0@lo:13:osp-pre-1-1.0 00000020:00000004:2.0:1788572455.162753:0:117199:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788572455.163116:0:117199:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788572455.619717:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572455.840932:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572455.840979:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572455.841050:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572455.841251:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616260992 00000100:00100000:3.0:1788572455.841262:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616260992 00000100:00100000:3.0:1788572455.841347:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616260864 00000100:00100000:3.0:1788572455.841350:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616260864 00000100:00100000:3.0:1788572455.841389:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4701 00000100:00100000:3.0:1788572455.841405:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616260992:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572455.841483:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616260992:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 84us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572455.841491:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4701 00000100:00100000:3.0:1788572455.841509:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4702 00000100:00100000:3.0:1788572455.841518:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616260864:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572455.841543:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616260864:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572455.841550:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4702 00000100:00100000:2.0:1788572455.841904:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616260736 00000100:00100000:2.0:1788572455.841910:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616260736 00000100:00100000:2.0:1788572455.841950:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00100000:2.0:1788572455.841957:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616260736:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572455.841987:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616260736:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 31us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572455.841994:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 73 00000100:00080000:0.0:1788572455.842580:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572455.842596:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788572456.648708:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572456.965423:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572456.965448:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639223552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572456.965522:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.965761:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639223936:0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.965773:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639224064:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.965798:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572456.965799:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.965822:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639224448:0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.965822:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639224576:0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.965842:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.965843:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572456.965856:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639224960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.965856:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639225088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.965873:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572456.965873:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572456.965935:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639223552 00000100:00100000:2.0:1788572456.965944:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639223552 00000100:00100000:2.0:1788572456.965994:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:2.0:1788572456.966024:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639223552:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572456.966043:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572456.966049:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639223680:0@lo:400:kworker.0 00000004:00000024:2.0:1788572456.966078:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572456.966082:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572456.966103:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639224192:0@lo:400:kworker.0 00000100:00100000:2.0:1788572456.966134:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639223552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572456.966136:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572456.966143:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00000100:00100000:1.0:1788572456.966152:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639224704:0@lo:400:kworker.0 00000100:00100000:2.0:1788572456.966165:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639223808:0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.966173:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572456.966187:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572456.966199:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639224064 00000100:00100000:1.0:1788572456.966202:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639224064 00000100:00100000:2.0:1788572456.966202:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639224320:0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.966243:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639224448 00000100:00100000:1.0:1788572456.966246:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639224448 00000100:00100000:1.0:1788572456.966264:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639224960 00000100:00100000:1.0:1788572456.966267:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639224960 00000100:00100000:1.0:1788572456.966286:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:1.0:1788572456.966292:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639224064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572456.966308:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639223936 00000100:00100000:3.0:1788572456.966312:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639223936 00000100:00100000:1.0:1788572456.966329:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639224064:12345-0@lo:400:kworker.0 Request processed in 37us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572456.966337:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1788572456.966341:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639224576 00000100:00100000:3.0:1788572456.966344:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639224576 00000100:00100000:1.0:1788572456.966347:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:1.0:1788572456.966352:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639224448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572456.966357:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639225088 00000100:00100000:3.0:1788572456.966359:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639225088 00000100:00100000:3.0:1788572456.966370:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639224192 00000100:00100000:3.0:1788572456.966372:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639224192 00000100:00100000:1.0:1788572456.966378:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639224448:12345-0@lo:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572456.966383:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:3.0:1788572456.966384:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639224704 00000100:00100000:3.0:1788572456.966386:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639224704 00000100:00100000:1.0:1788572456.966393:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:1.0:1788572456.966398:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639224960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572456.966398:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4703 00000100:00100000:3.0:1788572456.966404:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639223936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.966422:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639224960:12345-0@lo:400:kworker.0 Request processed in 24us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572456.966428:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1788572456.966430:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639223936:12345-0@lo:400:kworker.0 Request processed in 27us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572456.966436:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4703 00000100:00100000:3.0:1788572456.966447:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4704 00000100:00100000:3.0:1788572456.966454:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639224576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572456.966483:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639224576:12345-0@lo:400:kworker.0 Request processed in 30us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572456.966488:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4704 00000100:00100000:3.0:1788572456.966499:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4705 00000100:00100000:3.0:1788572456.966505:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639225088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572456.966532:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639225088:12345-0@lo:400:kworker.0 Request processed in 28us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572456.966537:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4705 00000100:00100000:3.0:1788572456.966548:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4706 00000100:00100000:3.0:1788572456.966554:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639224192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572456.966578:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639224192:12345-0@lo:400:kworker.0 Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572456.966584:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4706 00000100:00100000:3.0:1788572456.966594:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4707 00000100:00100000:3.0:1788572456.966600:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639224704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572456.966625:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639224704:12345-0@lo:400:kworker.0 Request processed in 25us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572456.966630:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4707 00000100:00100000:3.0:1788572456.966674:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639223552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572456.966712:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639223808 00000100:00100000:3.0:1788572456.966716:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639223808 00000100:00100000:2.0:1788572456.966775:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572456.966797:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639224832:0@lo:400:kworker.0 00000100:00100000:2.0:1788572456.966819:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572456.966871:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639223680 00000100:00100000:1.0:1788572456.966876:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639223680 00000100:00100000:1.0:1788572456.966914:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788572456.966921:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639223680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.966953:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639223680:12345-0@lo:400:kworker.0 Request processed in 33us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572456.966959:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788572456.972647:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639224960:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.972694:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639223936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.972707:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639224448:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.972753:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639224832 00000100:00100000:0.0:1788572456.972761:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639224832 00000100:00100000:3.0:1788572456.972942:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826 00000100:00100000:3.0:1788572456.972961:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639223808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572456.973099:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639223808:12345-0@lo:400:kworker.0 Request processed in 146us (6911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572456.973107:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826 00000100:00100000:1.0:1788572456.980971:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639224320 00000100:00100000:1.0:1788572456.980987:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639224320 00000100:00100000:1.0:1788572456.981054:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4708 00000100:00100000:1.0:1788572456.981066:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639224320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.981177:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639224320:12345-0@lo:400:kworker.0 Request processed in 112us (14400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572456.981184:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4708 00000100:00080000:1.0:1788572456.981213:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572456.981218:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572456.981222:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572456.981225:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572456.981259:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639223680:0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.981276:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639224192:0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.981288:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639224704:0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.981300:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639224064:0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.981311:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639224576:0@lo:400:kworker.0 00000100:00100000:1.0:1788572456.981325:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639225088:0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.982604:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:0.0:1788572456.982626:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639224832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572456.982704:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639224832:12345-0@lo:400:kworker.0 Request processed in 89us (15883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572456.982711:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00100000:2.0:1788572456.989749:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639223808:0@lo:400:kworker.0 00000100:00100000:2.0:1788572456.989772:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639224320:0@lo:400:kworker.0 00000100:00100000:2.0:1788572456.989786:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639224832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572457.423133:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572457.429828:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616261120 00000100:00100000:2.0:1788572457.429846:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616261120 00000100:00100000:2.0:1788572457.430043:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15530 00000100:00100000:2.0:1788572457.430057:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:90306:x1875449616261120:12345-192.168.202.13@tcp:101:lfs.0 00010000:00010000:2.0:1788572457.430078:0:6551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788572457.430113:0:6551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ae00/0xdb7edb52b833a40b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xef30c340bfb4b27d expref: -99 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.430212:0:6551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b833a412 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.430229:0:6551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b833a412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.430246:0:6551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b833a412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788572457.430300:0:6551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1788572457.430304:0:6551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788572457.430343:0:6551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b833a412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.430369:0:6551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1ae00/0xdb7edb52b833a40b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b27d expref: 8 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.430388:0:6551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94e63ad1bc00/0xdb7edb52b833a412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.13@tcp remote: 0xef30c340bfb4b27d expref: 7 pid: 6551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572457.430409:0:6551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94e506975300) 00010000:00010000:2.0:1788572457.430411:0:6551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788572457.430414:0:6551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94e63ad1bc00, rc 0) 00000100:00100000:2.0:1788572457.430490:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:90306:x1875449616261120:12345-192.168.202.13@tcp:101:lfs.0 Request processed in 436us (7379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572457.430497:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15530 00000100:00080000:1.0:1788572457.437568:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572457.438095:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572457.438193:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616261248 00000100:00100000:3.0:1788572457.438203:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616261248 00000100:00100000:3.0:1788572457.438266:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15531 00000100:00100000:3.0:1788572457.438277:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+7:90306:x1875449616261248:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:3.0:1788572457.438314:0:95742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:3.0:1788572457.438401:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+7:90306:x1875449616261248:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 118us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572457.438408:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15531 00000100:00100000:0.0:1788572457.441575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572457.446171:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616261376 00000100:00100000:3.0:1788572457.446193:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616261376 00000100:00100000:3.0:1788572457.446332:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15532 00000100:00100000:3.0:1788572457.446347:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:90306:x1875449616261376:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:3.0:1788572457.446408:0:9276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572457.446483:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:90306:x1875449616261376:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 139us (4918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572457.446491:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15532 00000100:00080000:1.0:1788572457.448236:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572457.452563:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572457.453051:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616261504 00000100:00100000:1.0:1788572457.453063:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616261504 00000100:00100000:1.0:1788572457.453166:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4506 00000100:00100000:1.0:1788572457.453175:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2382:x1875449616261504:12345-192.168.202.13@tcp:8:lfs.0 00010000:00080000:1.0:1788572457.453211:0:8464:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t0 exp 0000000000000000 cur 4374 last 0 00000020:00000080:1.0:1788572457.453243:0:8464:0:(genops.c:1385:class_connect()) connect: client 35eb2d60-2de0-4b00-9815-d5153edd0057, cookie 0xdb7edb52b833a419 00002000:00100000:1.0:1788572457.453255:0:8464:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35eb2d60-2de0-4b00-9815-d5153edd0057/ffff94e61e72c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788572457.453273:0:8464:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788572457.453358:0:8464:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788572457.453385:0:8464:0:(import.c:65:import_set_state_nolock()) ffff94e61e72b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572457.453462:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2382:x1875449616261504:12345-192.168.202.13@tcp:8:lfs.0 Request processed in 286us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572457.453470:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4506 00000001:00100000:0.0:1788572457.457412:0:114775:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000001:00080000:0.0:1788572457.457430:0:114775:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884902113 is committed 00000100:00100000:3.0:1788572457.459427:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572457.459685:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616261632 00000100:00100000:0.0:1788572457.459698:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616261632 00000100:00100000:0.0:1788572457.459794:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2943 00000100:00100000:0.0:1788572457.459807:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:90306:x1875449616261632:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:0.0:1788572457.459837:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572457.459959:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:90306:x1875449616261632:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 155us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572457.459968:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2943 00000100:00080000:1.0:1788572457.459994:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572457.463302:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572457.463496:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616261760 00000100:00100000:2.0:1788572457.463507:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616261760 00000100:00100000:2.0:1788572457.463559:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4507 00000100:00100000:2.0:1788572457.463569:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2382:x1875449616261760:12345-192.168.202.13@tcp:8:lfs.0 00010000:00080000:2.0:1788572457.463703:0:43974:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t0 exp 0000000000000000 cur 4374 last 0 00000020:00000080:2.0:1788572457.463744:0:43974:0:(genops.c:1385:class_connect()) connect: client 35eb2d60-2de0-4b00-9815-d5153edd0057, cookie 0xdb7edb52b833a420 00002000:00100000:2.0:1788572457.463760:0:43974:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35eb2d60-2de0-4b00-9815-d5153edd0057/ffff94e6056f6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788572457.463784:0:43974:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788572457.463865:0:43974:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788572457.463897:0:43974:0:(import.c:65:import_set_state_nolock()) ffff94e6056f1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572457.463971:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2382:x1875449616261760:12345-192.168.202.13@tcp:8:lfs.0 Request processed in 402us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572457.463979:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4507 00000100:00100000:3.0:1788572457.466880:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572457.467186:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616261888 00000100:00100000:1.0:1788572457.467198:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616261888 00000100:00100000:1.0:1788572457.467282:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2944 00000100:00100000:1.0:1788572457.467294:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:90306:x1875449616261888:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572457.467328:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572457.467484:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:90306:x1875449616261888:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 192us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572457.467492:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2944 00000100:00080000:0.0:1788572457.467570:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572457.476633:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572457.476660:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639225216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572457.476764:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572457.478362:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639225216 00000100:00100000:2.0:1788572457.478387:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639225216 00000100:00100000:2.0:1788572457.478496:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827 00000100:00100000:2.0:1788572457.478506:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639225216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572457.478538:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572457.478607:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639225216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572457.478614:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827 00000100:00100000:1.0:1788572457.478688:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639225216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572457.480403:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572457.480424:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639225344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572457.480499:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572457.482830:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639225344 00000100:00100000:0.0:1788572457.482849:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639225344 00000100:00100000:0.0:1788572457.482920:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945 00000100:00100000:0.0:1788572457.482930:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639225344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572457.482958:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572457.483100:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639225344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (2600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572457.483107:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945 00000100:00100000:1.0:1788572457.483738:0:3653:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884902113 gen 2 00000100:00100000:1.0:1788572457.483772:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639225344:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572457.667475:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572458.691628:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572459.526811:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639225472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572459.526890:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572459.526951:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639225472 00000100:00100000:2.0:1788572459.526960:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639225472 00000100:00100000:2.0:1788572459.527037:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946 00000100:00100000:2.0:1788572459.527046:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639225472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572459.527074:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572459.527118:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639225472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572459.527124:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946 00000100:00080000:2.0:1788572459.527154:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572459.527190:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639225472:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788572459.727223:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572460.035497:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572460.035527:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639225600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572460.035615:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572460.035774:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639225600 00000100:00100000:1.0:1788572460.035782:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639225600 00000100:00100000:1.0:1788572460.035848:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:1.0:1788572460.035860:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639225600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572460.035910:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572460.035962:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639225600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572460.035969:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000100:00080000:0.0:1788572460.036301:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572460.036347:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639225600:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572460.744745:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572460.964666:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572460.964712:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572460.964748:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572460.964774:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572460.964964:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616262400 00000100:00100000:0.0:1788572460.964975:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616262400 00000100:00100000:0.0:1788572460.965068:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3797 00000100:00100000:0.0:1788572460.965080:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616262400:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572460.965170:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616262400:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 92us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572460.965178:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3797 00000100:00080000:0.0:1788572460.965201:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572460.965266:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616262144 00000100:00100000:3.0:1788572460.965273:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616262144 00000100:00100000:3.0:1788572460.965318:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616262272 00000100:00100000:3.0:1788572460.965322:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616262272 00000100:00100000:3.0:1788572460.965350:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4709 00000100:00100000:3.0:1788572460.965358:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2385:x1875449616262144:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572460.965391:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2385:x1875449616262144:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 35us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572460.965397:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4709 00000100:00100000:3.0:1788572460.965410:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4710 00000100:00100000:3.0:1788572460.965416:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616262272:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572460.965437:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616262272:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 22us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572460.965443:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4710 00000100:00100000:3.0:1788572460.965480:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616262016 00000100:00100000:3.0:1788572460.965483:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616262016 00000100:00100000:3.0:1788572460.965509:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00100000:3.0:1788572460.965517:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616262016:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572460.965547:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616262016:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 31us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572460.965554:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 75 00000100:00080000:0.0:1788572460.965624:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572460.965628:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572460.965694:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572460.966091:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616262528 00000100:00100000:3.0:1788572460.966096:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616262528 00000100:00100000:3.0:1788572460.966151:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3798 00000100:00100000:3.0:1788572460.966159:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616262528:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572460.966197:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616262528:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 39us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572460.966203:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3798 00000100:00080000:0.0:1788572460.966376:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788572461.764093:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572462.097511:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639225728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572462.097624:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572462.097724:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639225728 00000100:00100000:1.0:1788572462.097733:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639225728 00000100:00100000:1.0:1788572462.097785:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:1.0:1788572462.097794:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639225728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572462.097832:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572462.097882:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639225728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572462.097890:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00000100:00100000:1.0:1788572462.097955:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639225728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572462.102321:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639225856:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.102399:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.102467:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639225856 00000100:00100000:3.0:1788572462.102474:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639225856 00000100:00100000:3.0:1788572462.102533:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788572462.106621:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639225856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.106762:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639225856:12345-0@lo:400:kworker.0 Request processed in 4219us (4360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.106774:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788572462.106877:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639225984:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.106915:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.106964:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639225984 00000100:00100000:3.0:1788572462.106972:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639225984 00000100:00100000:3.0:1788572462.107035:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:3.0:1788572462.107047:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639225984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107088:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639225984:12345-0@lo:400:kworker.0 Request processed in 45us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.107095:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00100000:3.0:1788572462.107136:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639225984:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107196:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639226112:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107226:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.107259:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639226112 00000100:00100000:3.0:1788572462.107262:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639226112 00000100:00100000:3.0:1788572462.107292:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4711 00000100:00100000:3.0:1788572462.107299:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639226112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107334:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639226112:12345-0@lo:400:kworker.0 Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.107340:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4711 00000100:00100000:3.0:1788572462.107367:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639226112:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107401:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639226240:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107426:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.107474:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572462.107482:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639226368:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107505:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.107528:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639226368 00000100:00100000:3.0:1788572462.107531:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639226368 00000100:00100000:3.0:1788572462.107568:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4712 00000100:00100000:3.0:1788572462.107575:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639226368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107609:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639226368:12345-0@lo:400:kworker.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.107618:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4712 00000100:00080000:3.0:1788572462.107633:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572462.107652:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639226368:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107679:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639226496:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107700:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.107724:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639226496 00000100:00100000:3.0:1788572462.107727:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639226496 00000100:00100000:3.0:1788572462.107753:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4713 00000100:00100000:3.0:1788572462.107759:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639226496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107789:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639226496:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.107794:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4713 00000100:00080000:3.0:1788572462.107807:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572462.107822:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639226496:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107850:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639226624:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107871:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.107897:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639226240 00000100:00100000:3.0:1788572462.107901:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639226240 00000100:00100000:3.0:1788572462.107935:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639226624 00000100:00100000:3.0:1788572462.107938:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639226624 00000100:00100000:3.0:1788572462.107960:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:3.0:1788572462.107967:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639226240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.107998:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639226240:12345-0@lo:400:kworker.0 Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.108026:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00100000:3.0:1788572462.108040:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:3.0:1788572462.108048:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639226624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.108080:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639226624:12345-0@lo:400:kworker.0 Request processed in 34us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.108086:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00080000:3.0:1788572462.108100:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572462.108102:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572462.108121:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639226624:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.108142:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639226240:0@lo:400:kworker.0 00000100:00100000:0.0:1788572462.108419:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639225856:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.115221:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572462.115236:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639226752:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.115308:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.115353:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639226752 00000100:00100000:3.0:1788572462.115361:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639226752 00000100:00100000:3.0:1788572462.115419:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4714 00000100:00100000:3.0:1788572462.115427:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639226752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.115473:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639226752:12345-0@lo:400:kworker.0 Request processed in 46us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.115480:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4714 00000100:00080000:3.0:1788572462.115499:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572462.115528:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639226752:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.116683:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572462.116698:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639226880:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.116740:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.116777:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639226880 00000100:00100000:3.0:1788572462.116782:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639226880 00000100:00100000:3.0:1788572462.116826:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4715 00000100:00100000:3.0:1788572462.116835:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639226880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.116883:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639226880:12345-0@lo:400:kworker.0 Request processed in 49us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.116890:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4715 00000100:00080000:3.0:1788572462.116908:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572462.116933:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639226880:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.116965:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639227008:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.116992:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.117037:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639227008 00000100:00100000:3.0:1788572462.117041:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639227008 00000100:00100000:3.0:1788572462.117084:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:3.0:1788572462.117092:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639227008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.117128:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639227008:12345-0@lo:400:kworker.0 Request processed in 37us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.117133:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00080000:3.0:1788572462.117161:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572462.117178:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639227008:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.117212:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639227136:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.117235:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.117264:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639227136 00000100:00100000:3.0:1788572462.117267:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639227136 00000100:00100000:3.0:1788572462.117296:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:3.0:1788572462.117301:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639227136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.117334:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639227136:12345-0@lo:400:kworker.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.117343:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00080000:3.0:1788572462.117356:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572462.117373:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639227136:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.117401:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572462.117406:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639227264:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.117432:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.117457:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639227264 00000100:00100000:3.0:1788572462.117461:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639227264 00000100:00100000:3.0:1788572462.117486:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4716 00000100:00100000:3.0:1788572462.117492:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639227264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.117522:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639227264:12345-0@lo:400:kworker.0 Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572462.117528:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4716 00000100:00100000:3.0:1788572462.119690:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639227264:0@lo:400:kworker.0 00000100:00100000:3.0:1788572462.597927:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639227520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572462.598033:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572462.598089:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572462.598095:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639227392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572462.598122:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572462.599028:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639227520 00000100:00100000:2.0:1788572462.599039:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639227520 00000100:00100000:2.0:1788572462.599099:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:2.0:1788572462.599109:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639227520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572462.599139:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572462.599207:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639227520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572462.599214:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00000100:00100000:2.0:1788572462.599265:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639227520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572462.599409:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639227392 00000100:00100000:0.0:1788572462.599413:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639227392 00000100:00100000:0.0:1788572462.599451:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830 00000100:00100000:0.0:1788572462.599458:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639227392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572462.599481:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572462.599522:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639227392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572462.599528:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830 00000100:00100000:2.0:1788572462.600197:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639227392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788572462.799113:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572463.107193:0:116831:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e641382b40 going to sleep for 1 seconds 00000001:00100000:0.0:1788572463.108812:0:9546:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00010000:00010000:0.0:1788572463.811774:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572464.131884:0:116831:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e641382b40 going to sleep for 1 seconds 00000100:00100000:3.0:1788572464.644897:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639227648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572464.644999:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572464.645317:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639227648 00000100:00100000:0.0:1788572464.645329:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639227648 00000100:00100000:0.0:1788572464.645419:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949 00000100:00100000:0.0:1788572464.645431:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639227648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572464.645472:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572464.645543:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639227648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572464.645551:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949 00000100:00100000:2.0:1788572464.645717:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639227648:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572464.645787:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572464.840712:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572465.157435:0:116831:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e641382b40 going to sleep for 1 seconds 00000100:00100000:3.0:1788572465.165521:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639227776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572465.165634:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572465.165747:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639227776 00000100:00100000:3.0:1788572465.165758:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639227776 00000100:00100000:3.0:1788572465.165829:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:3.0:1788572465.165841:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639227776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572465.165882:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572465.165936:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639227776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572465.165944:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00000100:00080000:3.0:1788572465.165969:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572465.166042:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639227776:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788572465.383979:0:117392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg213-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1788572465.859637:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572466.086977:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572466.087281:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616262656 00000100:00100000:3.0:1788572466.087296:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616262656 00000100:00100000:3.0:1788572466.087382:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00100000:3.0:1788572466.087396:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616262656:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572466.087868:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572466.087921:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572466.088105:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616262656:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 710us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572466.088116:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 77 00000100:00100000:2.0:1788572466.088446:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572466.088477:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572466.088516:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616262912 00000100:00100000:3.0:1788572466.088522:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616262912 00000100:00100000:3.0:1788572466.088572:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616262784 00000100:00100000:3.0:1788572466.088574:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616262784 00000100:00100000:3.0:1788572466.088595:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4717 00000100:00100000:3.0:1788572466.088604:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616262912:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572466.088647:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616262912:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 44us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572466.088658:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4717 00000100:00100000:3.0:1788572466.088672:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4718 00000100:00100000:3.0:1788572466.088680:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2383:x1875449616262784:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572466.088705:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2383:x1875449616262784:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572466.088711:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4718 00000100:00080000:3.0:1788572466.088728:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572466.088732:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572466.092983:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616263168 00000100:00100000:1.0:1788572466.093024:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616263168 00000100:00100000:1.0:1788572466.093192:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616263040 00000100:00100000:1.0:1788572466.093196:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616263040 00000100:00080000:3.0:1788572466.093205:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572466.093211:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572466.093258:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3803 00000100:00100000:2.0:1788572466.093274:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616263168:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572466.093964:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616263168:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 690us (6038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572466.093976:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3803 00000100:00100000:2.0:1788572466.094032:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3804 00000100:00100000:2.0:1788572466.094044:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616263040:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572466.094086:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616263040:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 45us (5607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572466.094092:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3804 00000100:00100000:2.0:1788572466.179239:0:116831:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e641382b40 going to sleep for 1 seconds 00010000:00010000:2.0:1788572466.890359:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572467.203472:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572467.203499:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639227904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572467.203581:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572467.203650:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639227904 00000100:00100000:2.0:1788572467.203658:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639227904 00000100:00100000:2.0:1788572467.203707:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:2.0:1788572467.203715:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639227904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572467.203757:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572467.203817:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639227904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.203824:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00100000:2.0:1788572467.203873:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639227904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572467.204035:0:116831:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e641382b40 going to sleep for 1 seconds 00000100:00100000:2.0:1788572467.220647:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572467.220672:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639228160:0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.220747:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572467.220828:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639228288:0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.220856:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572467.220892:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639228288 00000100:00100000:2.0:1788572467.220900:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639228288 00000100:00100000:2.0:1788572467.220954:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4719 00000100:00100000:2.0:1788572467.220963:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639228288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.221038:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639228288:12345-0@lo:400:kworker.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.221046:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4719 00000100:00100000:2.0:1788572467.221101:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639228288:0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.221146:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572467.221152:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639228672:0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.221187:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572467.221214:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639228672 00000100:00100000:2.0:1788572467.221218:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639228672 00000100:00100000:2.0:1788572467.221252:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4720 00000100:00100000:2.0:1788572467.221258:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639228672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.221293:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639228672:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.221298:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4720 00000100:00080000:2.0:1788572467.221312:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572467.221330:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639228672:0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.221356:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639228800:0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.221378:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572467.221402:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639228800 00000100:00100000:2.0:1788572467.221405:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639228800 00000100:00100000:2.0:1788572467.221669:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:2.0:1788572467.221676:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639228800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.221711:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639228800:12345-0@lo:400:kworker.0 Request processed in 36us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572467.221717:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00080000:2.0:1788572467.221730:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572467.221746:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639228800:0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.221785:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572467.221803:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639229184:0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.221826:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572467.221871:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639229312:0@lo:400:kworker.0 00000100:00100000:2.0:1788572467.221893:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572467.222131:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639228160 00000100:00100000:0.0:1788572467.222137:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639228160 00000100:00100000:0.0:1788572467.222188:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:0.0:1788572467.222197:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639228160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222242:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639228160:12345-0@lo:400:kworker.0 Request processed in 46us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.222247:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00000100:00100000:0.0:1788572467.222266:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639229184 00000100:00100000:0.0:1788572467.222269:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639229184 00000100:00100000:0.0:1788572467.222303:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639229312 00000100:00100000:0.0:1788572467.222306:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639229312 00000100:00100000:0.0:1788572467.222323:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:0.0:1788572467.222329:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639229184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222374:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639229184:12345-0@lo:400:kworker.0 Request processed in 30us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.222381:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:0.0:1788572467.222392:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:0.0:1788572467.222399:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639229312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222439:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639229312:12345-0@lo:400:kworker.0 Request processed in 41us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.222444:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00080000:0.0:1788572467.222464:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572467.222467:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572467.222481:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639228032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222512:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572467.222540:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639228544:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222562:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572467.222578:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639229056:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222597:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572467.222614:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572467.222620:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639228416:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222638:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572467.222652:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639228928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222668:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572467.222683:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639229440:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222704:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572467.222727:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639228032 00000100:00100000:0.0:1788572467.222730:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639228032 00000100:00100000:0.0:1788572467.222755:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788572467.222761:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639228032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222799:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639228032:12345-0@lo:400:kworker.0 Request processed in 32us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.222804:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788572467.222830:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639228544 00000100:00100000:0.0:1788572467.222834:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639228544 00000100:00100000:0.0:1788572467.222857:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639229056 00000100:00100000:0.0:1788572467.222859:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639229056 00000100:00100000:0.0:1788572467.222874:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639228928 00000100:00100000:0.0:1788572467.222876:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639228928 00000100:00100000:0.0:1788572467.222885:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639229440 00000100:00100000:0.0:1788572467.222887:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639229440 00000100:00100000:0.0:1788572467.222897:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4721 00000100:00100000:0.0:1788572467.222901:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639228544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222926:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639228544:12345-0@lo:400:kworker.0 Request processed in 25us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.222932:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4721 00000100:00100000:0.0:1788572467.222941:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4722 00000100:00100000:0.0:1788572467.222946:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639229056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.222968:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639229056:12345-0@lo:400:kworker.0 Request processed in 22us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.222973:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4722 00000100:00100000:0.0:1788572467.222984:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4723 00000100:00100000:0.0:1788572467.222989:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639228928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.223050:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639228928:12345-0@lo:400:kworker.0 Request processed in 61us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.223056:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4723 00000100:00100000:0.0:1788572467.223068:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4724 00000100:00100000:0.0:1788572467.223074:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639229440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.223100:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639229440:12345-0@lo:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.223105:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4724 00000100:00100000:0.0:1788572467.223124:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639228416 00000100:00100000:0.0:1788572467.223128:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639228416 00000100:00100000:0.0:1788572467.223153:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:0.0:1788572467.223158:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639228416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.223221:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639228416:12345-0@lo:400:kworker.0 Request processed in 61us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.223226:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00080000:0.0:1788572467.223245:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572467.223248:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572467.223250:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572467.223284:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639228416:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.223295:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639228928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.223304:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639229440:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.223312:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639228032:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.223320:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639228544:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.223329:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639229056:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.223365:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639229312:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.223376:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639229184:0@lo:400:kworker.0 00000100:00100000:0.0:1788572467.223387:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639228160:0@lo:400:kworker.0 00000001:02000400:3.0:1788572467.378949:0:117441:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:3.0:1788572467.715267:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639229568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572467.715355:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572467.715487:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572467.715504:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639229696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572467.715536:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572467.715574:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639229696 00000100:00100000:0.0:1788572467.715582:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639229696 00000100:00100000:0.0:1788572467.715646:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951 00000100:00100000:0.0:1788572467.715657:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639229696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572467.715697:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572467.715746:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639229696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572467.715754:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951 00000100:00100000:0.0:1788572467.715829:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639229696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572467.717277:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639229568 00000100:00100000:1.0:1788572467.717291:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639229568 00000100:00100000:1.0:1788572467.717360:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833 00000100:00100000:1.0:1788572467.717371:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639229568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572467.717417:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:1.0:1788572467.717488:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639229568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572467.717496:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833 00000100:00100000:0.0:1788572467.720331:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639229568:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788572467.919650:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788572468.227174:0:116831:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788572452/real 1788572452] req@ffff94e62dac5880 x1875449639222784/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 1 dl 1788572468 ref 2 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788572468.227230:0:116831:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff94e62dac5880 x1875449639222784/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 1 dl 1788572468 ref 2 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788572468.227239:0:116831:0:(import.c:65:import_set_state_nolock()) ffff94e618476000 lustre-OST0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788572468.227242:0:116831:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:0.0:1788572468.227251:0:116831:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1788572468.227253:0:116831:0:(import.c:418:ptlrpc_pinger_force()) lustre-OST0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1788572468.227263:0:116831:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e641382b40 going to sleep for 0 seconds 00000100:00100000:0.0:1788572468.227272:0:116831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:116831:1875449639222784:0@lo:5:osp-pre-1-0.0 00000004:00020000:0.0:1788572468.227297:0:116831:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -11 00000100:00080000:2.0:1788572468.227784:0:93352:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788572468.227789:0:93352:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788572468.227792:0:93352:0:(import.c:65:import_set_state_nolock()) ffff94e618476000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788572468.227797:0:93352:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 4363 00000100:00080000:2.0:1788572468.227805:0:93352:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff94e618476000 using connection 192.168.202.113@tcp/0@lo 00000100:00100000:2.0:1788572468.227827:0:93352:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94e641355500 x1875449639231232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788572468.227869:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639229952:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.227948:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.227980:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639230464:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228035:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.228056:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639230976:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228078:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.228103:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788572468.228109:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639230080:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228129:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.228147:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639230592:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228170:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.228197:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639231104:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228217:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.228252:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639229952 00000100:00100000:2.0:1788572468.228259:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639229952 00000100:00100000:2.0:1788572468.228301:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639230976 00000100:00100000:2.0:1788572468.228305:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639230976 00000100:00100000:2.0:1788572468.228323:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834 00000100:00100000:2.0:1788572468.228331:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639229952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228383:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639229952:12345-0@lo:400:kworker.0 Request processed in 52us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.228393:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834 00000100:00100000:2.0:1788572468.228411:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835 00000100:00100000:2.0:1788572468.228417:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639230976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228444:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639230976:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.228449:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835 00000100:00100000:2.0:1788572468.228470:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639230592 00000100:00100000:2.0:1788572468.228473:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639230592 00000100:00100000:2.0:1788572468.228493:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639231104 00000100:00100000:2.0:1788572468.228496:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639231104 00000100:00100000:2.0:1788572468.228511:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:2.0:1788572468.228517:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639230592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228548:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639230592:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.228553:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:2.0:1788572468.228565:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:2.0:1788572468.228570:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639231104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228597:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639231104:12345-0@lo:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.228603:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:2.0:1788572468.228643:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639230592:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228653:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639231104:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228662:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639229952:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228671:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639230976:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228723:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639230464 00000100:00100000:2.0:1788572468.228727:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639230464 00000100:00100000:2.0:1788572468.228753:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639230080 00000100:00100000:2.0:1788572468.228756:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639230080 00000100:00100000:2.0:1788572468.228773:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4725 00000100:00100000:2.0:1788572468.228779:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639230464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228869:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639230464:12345-0@lo:400:kworker.0 Request processed in 35us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.228875:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4725 00000100:00100000:2.0:1788572468.228889:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4726 00000100:00100000:2.0:1788572468.228895:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639230080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228926:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639230080:12345-0@lo:400:kworker.0 Request processed in 32us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.228931:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4726 00000100:00100000:2.0:1788572468.228950:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639230208:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.228974:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.228992:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639230720:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229035:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.229053:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639231360:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229076:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.229095:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572468.229102:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639229824:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229128:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.229158:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639230336:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229189:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.229208:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639230848:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229228:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572468.229260:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639230720 00000100:00100000:2.0:1788572468.229264:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639230720 00000100:00100000:2.0:1788572468.229280:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639231360 00000100:00100000:2.0:1788572468.229283:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639231360 00000100:00100000:2.0:1788572468.229291:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639230336 00000100:00100000:2.0:1788572468.229292:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639230336 00000100:00100000:2.0:1788572468.229301:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639230848 00000100:00100000:2.0:1788572468.229303:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639230848 00000100:00100000:2.0:1788572468.229315:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4727 00000100:00100000:2.0:1788572468.229321:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639230720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229352:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639230720:12345-0@lo:400:kworker.0 Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.229358:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4727 00000100:00100000:2.0:1788572468.229369:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4728 00000100:00100000:2.0:1788572468.229374:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639231360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229399:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639231360:12345-0@lo:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.229405:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4728 00000100:00100000:2.0:1788572468.229416:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4729 00000100:00100000:2.0:1788572468.229422:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639230336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229448:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639230336:12345-0@lo:400:kworker.0 Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.229453:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4729 00000100:00100000:2.0:1788572468.229464:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4730 00000100:00100000:2.0:1788572468.229469:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639230848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229495:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639230848:12345-0@lo:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.229501:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4730 00000100:00100000:2.0:1788572468.229525:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639230336:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229535:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639230848:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229543:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639230720:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229551:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639231360:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229583:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639230080:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229595:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639230464:0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229667:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639229824 00000100:00100000:2.0:1788572468.229671:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639229824 00000100:00100000:2.0:1788572468.229696:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788572468.229702:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639229824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572468.229737:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639229824:12345-0@lo:400:kworker.0 Request processed in 35us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572468.229743:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788572468.229777:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639229824:0@lo:400:kworker.0 00000100:00100000:3.0:1788572468.230651:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639231232:0@lo:8:kworker.0 00000100:00100000:3.0:1788572468.230701:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572468.230762:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639230208 00000100:00100000:3.0:1788572468.230767:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639230208 00000100:00100000:3.0:1788572468.230815:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639231232 00000100:00100000:3.0:1788572468.230819:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639231232 00000100:00100000:3.0:1788572468.230844:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:3.0:1788572468.230852:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639230208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572468.230901:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639230208:12345-0@lo:400:kworker.0 Request processed in 51us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572468.231035:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:1.0:1788572468.231046:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3649:x1875449639231232:12345-0@lo:8:kworker.0 00010000:02000400:1.0:1788572468.231081:0:43975:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-OST0001: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting 00000100:00100000:3.0:1788572468.231152:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:3.0:1788572468.231228:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639230208:0@lo:400:kworker.0 00010000:00080000:1.0:1788572468.246839:0:43975:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp ffff94e618473000 cur 4385 last 1788572468 00002000:00100000:1.0:1788572468.246864:0:43975:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94e618473000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788572468.246869:0:43975:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788572468.246873:0:43975:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli 0@lo does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1788572468.246892:0:43975:0:(import.c:65:import_set_state_nolock()) ffff94e618471800 : changing import state from FULL to RECOVER 00000100:00080000:1.0:1788572468.246900:0:43975:0:(import.c:65:import_set_state_nolock()) ffff94e618471800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572468.247032:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3649:x1875449639231232:12345-0@lo:8:kworker.0 Request processed in 15987us (16329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572468.247042:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00080000:3.0:1788572468.248249:0:3649:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788572468.248270:0:3649:0:(import.c:1341:ptlrpc_connect_interpret()) reconnected to lustre-OST0001_UUID@0@lo after partition 00000100:00080000:3.0:1788572468.248274:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e618476000 lustre-OST0001_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788572468.248280:0:3649:0:(import.c:65:import_set_state_nolock()) ffff94e618476000 lustre-OST0001_UUID: changing import state from RECOVER to FULL 00000004:00080000:3.0:1788572468.248284:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:02000000:3.0:1788572468.248287:0:3649:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-OST0001-osc-MDT0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788572468.248293:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1875449639231232:0@lo:8:kworker.0 00010000:00010000:0.0:1788572468.931198:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788572469.251512:0:116831:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0xb31:0x0] 00000100:00100000:2.0:1788572469.251552:0:116831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:116831:1875449639231616:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788572469.251633:0:116831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572469.251687:0:116831:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e641382b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788572469.251767:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639231488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572469.251801:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572469.251897:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639231488 00000100:00100000:2.0:1788572469.251907:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639231488 00000100:00100000:2.0:1788572469.251997:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952 00000100:00100000:2.0:1788572469.252036:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639231488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572469.252069:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8636224 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572469.252114:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639231488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572469.252122:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952 00000100:00080000:3.0:1788572469.252320:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572469.252368:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639231488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572469.253514:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639231616 00000100:00100000:1.0:1788572469.253526:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639231616 00000100:00100000:1.0:1788572469.253601:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4508 00000100:00100000:1.0:1788572469.253613:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:116831:x1875449639231616:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788572469.253657:0:8464:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 2881 -> diff = -16 00002000:02000040:1.0:1788572469.253664:0:8464:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:2866 to 0x2c0000401:2881) 00002000:00010000:1.0:1788572469.269743:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.269758:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6a48956/0xdb7edb52b833a427 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.269776:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb41:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.269780:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.269786:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6a48956/0xdb7edb52b833a427 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.269807:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6a48956/0xdb7edb52b833a427 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.269818:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6a48956/0xdb7edb52b833a427 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.269827:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6a48956/0xdb7edb52b833a427 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.269856:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788572469.269957:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.269962:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003632ef77/0xdb7edb52b833a42e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.269970:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb40:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.269972:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.269977:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003632ef77/0xdb7edb52b833a42e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.269985:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003632ef77/0xdb7edb52b833a42e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.269992:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003632ef77/0xdb7edb52b833a42e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270043:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003632ef77/0xdb7edb52b833a42e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270420:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788572469.270474:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.270479:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6aeb62f/0xdb7edb52b833a435 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270487:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3f:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.270490:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.270494:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6aeb62f/0xdb7edb52b833a435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270503:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6aeb62f/0xdb7edb52b833a435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270511:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6aeb62f/0xdb7edb52b833a435 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270519:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6aeb62f/0xdb7edb52b833a435 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270531:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788572469.270560:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.270564:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065831c36/0xdb7edb52b833a43c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270572:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3e:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.270575:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.270588:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065831c36/0xdb7edb52b833a43c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270597:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065831c36/0xdb7edb52b833a43c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270605:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065831c36/0xdb7edb52b833a43c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270612:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065831c36/0xdb7edb52b833a43c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270623:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788572469.270651:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.270656:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f343db/0xdb7edb52b833a443 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270663:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3d:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.270665:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.270669:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016f343db/0xdb7edb52b833a443 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270677:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016f343db/0xdb7edb52b833a443 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270690:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f343db/0xdb7edb52b833a443 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270698:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016f343db/0xdb7edb52b833a443 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270707:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788572469.270733:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.270738:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ff1a54f/0xdb7edb52b833a44a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270744:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3c:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.270746:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.270750:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff1a54f/0xdb7edb52b833a44a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270759:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ff1a54f/0xdb7edb52b833a44a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270767:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ff1a54f/0xdb7edb52b833a44a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270774:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ff1a54f/0xdb7edb52b833a44a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270786:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788572469.270812:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.270817:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b25a1562/0xdb7edb52b833a451 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270824:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3b:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.270826:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.270830:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b25a1562/0xdb7edb52b833a451 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270838:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b25a1562/0xdb7edb52b833a451 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270847:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b25a1562/0xdb7edb52b833a451 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270854:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b25a1562/0xdb7edb52b833a451 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270861:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788572469.270888:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.270893:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c09d5b/0xdb7edb52b833a458 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270899:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3a:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.270903:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.270907:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036c09d5b/0xdb7edb52b833a458 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270916:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036c09d5b/0xdb7edb52b833a458 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270923:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c09d5b/0xdb7edb52b833a458 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270930:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036c09d5b/0xdb7edb52b833a458 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270937:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1788572469.270975:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.270979:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008efa6e8/0xdb7edb52b833a45f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.270986:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb39:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.270989:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.270993:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008efa6e8/0xdb7edb52b833a45f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271031:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008efa6e8/0xdb7edb52b833a45f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271039:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008efa6e8/0xdb7edb52b833a45f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271048:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008efa6e8/0xdb7edb52b833a45f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271527:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788572469.271588:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.271593:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdf66e6/0xdb7edb52b833a466 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271602:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb38:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.271605:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.271610:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fdf66e6/0xdb7edb52b833a466 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271619:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fdf66e6/0xdb7edb52b833a466 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271627:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdf66e6/0xdb7edb52b833a466 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271634:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fdf66e6/0xdb7edb52b833a466 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271642:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1788572469.271671:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.271676:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b8abf44/0xdb7edb52b833a46d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271684:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb37:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.271687:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.271690:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b8abf44/0xdb7edb52b833a46d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271699:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b8abf44/0xdb7edb52b833a46d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271706:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b8abf44/0xdb7edb52b833a46d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271713:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b8abf44/0xdb7edb52b833a46d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271720:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1788572469.271746:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.271751:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a474 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271757:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb36:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.271759:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.271763:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a474 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271771:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a474 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271785:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a474 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271801:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a474 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271808:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1788572469.271839:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.271844:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c895e8d8/0xdb7edb52b833a47b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271852:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb35:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.271855:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.271858:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c895e8d8/0xdb7edb52b833a47b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271867:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c895e8d8/0xdb7edb52b833a47b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271875:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c895e8d8/0xdb7edb52b833a47b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271882:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c895e8d8/0xdb7edb52b833a47b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271895:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1788572469.271921:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.271925:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000535bf5f5/0xdb7edb52b833a482 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271933:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb34:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.271935:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.271939:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000535bf5f5/0xdb7edb52b833a482 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271947:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000535bf5f5/0xdb7edb52b833a482 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.271954:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000535bf5f5/0xdb7edb52b833a482 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272271:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000535bf5f5/0xdb7edb52b833a482 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272282:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00010000:00010000:2.0:1788572469.272325:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1788572469.272334:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6a48956/0xdb7edb52b833a427 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272342:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.272346:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6a48956/0xdb7edb52b833a427 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272356:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6a48956/0xdb7edb52b833a427 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272374:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6a48956/0xdb7edb52b833a427 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272382:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6a48956/0xdb7edb52b833a427 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572469.272387:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.272392:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050078ba4/0xdb7edb52b833a489 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272398:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb33:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.272402:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788572469.272405:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050078ba4/0xdb7edb52b833a489 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272407:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1788572469.272411:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003632ef77/0xdb7edb52b833a42e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272415:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050078ba4/0xdb7edb52b833a489 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272423:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050078ba4/0xdb7edb52b833a489 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272424:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.272427:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003632ef77/0xdb7edb52b833a42e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272434:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003632ef77/0xdb7edb52b833a42e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272445:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003632ef77/0xdb7edb52b833a42e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272451:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003632ef77/0xdb7edb52b833a42e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272463:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1788572469.272467:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6aeb62f/0xdb7edb52b833a435 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272473:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.272476:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6aeb62f/0xdb7edb52b833a435 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272484:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6aeb62f/0xdb7edb52b833a435 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272493:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6aeb62f/0xdb7edb52b833a435 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272500:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6aeb62f/0xdb7edb52b833a435 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272512:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1788572469.272515:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065831c36/0xdb7edb52b833a43c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272520:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13e00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.272523:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065831c36/0xdb7edb52b833a43c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272530:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065831c36/0xdb7edb52b833a43c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272539:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065831c36/0xdb7edb52b833a43c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272545:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065831c36/0xdb7edb52b833a43c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272556:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1788572469.272559:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016f343db/0xdb7edb52b833a443 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272564:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13200 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.272567:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f343db/0xdb7edb52b833a443 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272573:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f343db/0xdb7edb52b833a443 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272581:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016f343db/0xdb7edb52b833a443 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272587:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016f343db/0xdb7edb52b833a443 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272598:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788572469.272601:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ff1a54f/0xdb7edb52b833a44a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272607:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.272610:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ff1a54f/0xdb7edb52b833a44a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272618:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ff1a54f/0xdb7edb52b833a44a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272628:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ff1a54f/0xdb7edb52b833a44a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272635:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ff1a54f/0xdb7edb52b833a44a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272638:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050078ba4/0xdb7edb52b833a489 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272647:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1788572469.272647:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788572469.272650:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b25a1562/0xdb7edb52b833a451 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272656:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13400 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.272659:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b25a1562/0xdb7edb52b833a451 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272666:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b25a1562/0xdb7edb52b833a451 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272675:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b25a1562/0xdb7edb52b833a451 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272682:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b25a1562/0xdb7edb52b833a451 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788572469.272686:0:8464:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788572469.272690:0:8464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044902be8/0xdb7edb52b833a490 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272693:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788572469.272697:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036c09d5b/0xdb7edb52b833a458 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272698:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb32:0x0].0x0 since=4386s v=(0 0) 00010000:00010000:1.0:1788572469.272701:0:8464:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788572469.272704:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13c00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:1.0:1788572469.272705:0:8464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044902be8/0xdb7edb52b833a490 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272707:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c09d5b/0xdb7edb52b833a458 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272714:0:8464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044902be8/0xdb7edb52b833a490 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272721:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c09d5b/0xdb7edb52b833a458 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272722:0:8464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044902be8/0xdb7edb52b833a490 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272730:0:8464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044902be8/0xdb7edb52b833a490 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272731:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036c09d5b/0xdb7edb52b833a458 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788572469.272738:0:8464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1788572469.272739:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036c09d5b/0xdb7edb52b833a458 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272750:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788572469.272753:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008efa6e8/0xdb7edb52b833a45f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272759:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b13600 already unused, calling callback (ffffffffc0be44f0) 00002000:00080000:1.0:1788572469.272760:0:8464:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:2865 00010000:00010000:2.0:1788572469.272763:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008efa6e8/0xdb7edb52b833a45f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272769:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008efa6e8/0xdb7edb52b833a45f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272776:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008efa6e8/0xdb7edb52b833a45f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272782:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008efa6e8/0xdb7edb52b833a45f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272797:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788572469.272801:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fdf66e6/0xdb7edb52b833a466 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272807:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12a00 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.272809:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdf66e6/0xdb7edb52b833a466 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272816:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdf66e6/0xdb7edb52b833a466 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272825:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fdf66e6/0xdb7edb52b833a466 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272832:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fdf66e6/0xdb7edb52b833a466 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272843:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788572469.272846:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b8abf44/0xdb7edb52b833a46d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272852:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.272854:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b8abf44/0xdb7edb52b833a46d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272864:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b8abf44/0xdb7edb52b833a46d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272872:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b8abf44/0xdb7edb52b833a46d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272879:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b8abf44/0xdb7edb52b833a46d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272888:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788572469.272891:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a474 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272896:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e612b12800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.272898:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a474 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272904:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a474 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272925:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a474 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272932:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee5ffd34/0xdb7edb52b833a474 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272947:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788572469.272950:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c895e8d8/0xdb7edb52b833a47b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272955:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.272958:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c895e8d8/0xdb7edb52b833a47b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272964:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c895e8d8/0xdb7edb52b833a47b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272973:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c895e8d8/0xdb7edb52b833a47b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272980:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c895e8d8/0xdb7edb52b833a47b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.272991:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788572469.272994:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000535bf5f5/0xdb7edb52b833a482 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273000:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560600 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.273043:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000535bf5f5/0xdb7edb52b833a482 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273056:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000535bf5f5/0xdb7edb52b833a482 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273066:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000535bf5f5/0xdb7edb52b833a482 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273073:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000535bf5f5/0xdb7edb52b833a482 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273085:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788572469.273088:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050078ba4/0xdb7edb52b833a489 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273094:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613561800 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.273097:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050078ba4/0xdb7edb52b833a489 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273104:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050078ba4/0xdb7edb52b833a489 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273113:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050078ba4/0xdb7edb52b833a489 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273120:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050078ba4/0xdb7edb52b833a489 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273136:0:92609:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788572469.273139:0:92609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044902be8/0xdb7edb52b833a490 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273145:0:92609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94e613560000 already unused, calling callback (ffffffffc0be44f0) 00010000:00010000:2.0:1788572469.273147:0:92609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044902be8/0xdb7edb52b833a490 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273155:0:92609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044902be8/0xdb7edb52b833a490 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273165:0:92609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044902be8/0xdb7edb52b833a490 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273172:0:92609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044902be8/0xdb7edb52b833a490 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788572469.273193:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572469.273196:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572469.273198:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572469.273208:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572469.273315:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:116831:x1875449639231616:12345-0@lo:5:osp-pre-1-0.0 Request processed in 19700us (21677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572469.273441:0:116831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:116831:1875449639231616:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788572469.273459:0:116831:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0xb41:0x0] from OST, last_created [0x2c0000401:0xb41:0x0]last_used is [0x2c0000401:0xb31:0x0] 00000100:00100000:2.0:1788572469.273508:0:116831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:116831:1875449639231744:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788572469.273546:0:116831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572469.273583:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639231744 00000100:00100000:2.0:1788572469.273590:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639231744 00000100:00100000:2.0:1788572469.273639:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4509 00000100:00100000:2.0:1788572469.273648:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:116831:x1875449639231744:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788572469.273658:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4508 00002000:00080000:2.0:1788572469.273687:0:43974:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2882 00000100:00100000:1.0:1788572469.275101:0:116831:0:(client.c:2716:ptlrpc_set_wait()) set ffff94e641382b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788572469.275361:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572469.275376:0:116831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:116831:1875449639231744:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788572469.275392:0:116831:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0xb41:0x0]-[0x2c0000401:0xb61:0x0] 00010000:00010000:0.0:1788572469.275424:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788572469.275437:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572469.279092:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:116831:x1875449639231744:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1538us (1638us total) trans 4294968877 rc 0/0 00000100:00100000:2.0:1788572469.279110:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4509 00000100:00100000:3.0:1788572469.526128:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572469.526525:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616263296 00000100:00100000:2.0:1788572469.526539:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616263296 00000100:00100000:2.0:1788572469.526670:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15533 00000100:00100000:2.0:1788572469.526682:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+7:90774:x1875449616263296:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:2.0:1788572469.526723:0:10390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572469.526817:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+7:90774:x1875449616263296:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 137us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572469.526824:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15533 00000100:00080000:3.0:1788572469.526867:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572469.532248:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572469.534079:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616263424 00000100:00100000:0.0:1788572469.534095:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616263424 00000100:00100000:0.0:1788572469.534417:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15534 00000100:00100000:0.0:1788572469.534429:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:90774:x1875449616263424:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572469.534483:0:6551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572469.534564:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:90774:x1875449616263424:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 137us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572469.534571:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15534 00000100:00080000:3.0:1788572469.538531:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572469.538695:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572469.538783:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616263552 00000100:00100000:0.0:1788572469.538794:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616263552 00000100:00100000:0.0:1788572469.538931:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2953 00000100:00100000:0.0:1788572469.538941:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:90774:x1875449616263552:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:0.0:1788572469.538978:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572469.541793:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:90774:x1875449616263552:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 493us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572469.541820:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2953 00000100:00080000:3.0:1788572469.542127:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572469.542619:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572469.542699:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616263680 00000100:00100000:2.0:1788572469.542709:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616263680 00000100:00100000:2.0:1788572469.542779:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2954 00000100:00100000:2.0:1788572469.542791:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:90774:x1875449616263680:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:2.0:1788572469.542917:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572469.542996:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:90774:x1875449616263680:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 206us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572469.543039:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2954 00000100:00080000:3.0:1788572469.543118:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572469.763414:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572469.763449:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639231872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572469.763533:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572469.764042:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639231872 00000100:00100000:1.0:1788572469.764053:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639231872 00000100:00100000:1.0:1788572469.764141:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955 00000100:00100000:1.0:1788572469.764152:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639231872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572469.764179:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572469.764268:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639231872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572469.764274:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955 00000100:00100000:1.0:1788572469.764330:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639231872:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572469.764661:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572469.964056:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572470.277806:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572470.277830:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639232000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572470.277902:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572470.278683:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639232000 00000100:00100000:1.0:1788572470.278695:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639232000 00000100:00100000:1.0:1788572470.278775:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956 00000100:00100000:1.0:1788572470.278787:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639232000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572470.278817:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788572470.278953:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572470.279710:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639232000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 922us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572470.279720:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956 00000100:00100000:0.0:1788572470.283861:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639232000:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572470.979257:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572471.203666:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572471.203712:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572471.203744:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572471.203765:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616264064 00000100:00100000:1.0:1788572471.203775:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572471.203776:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616264064 00000100:00100000:1.0:1788572471.203799:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572471.203836:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616263936 00000100:00100000:2.0:1788572471.203839:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616263936 00000100:00100000:2.0:1788572471.203866:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4731 00000100:00100000:2.0:1788572471.203878:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616264064:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572471.203952:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616264064:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572471.203959:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4731 00000100:00100000:2.0:1788572471.203977:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4732 00000100:00100000:2.0:1788572471.203984:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2384:x1875449616263936:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572471.204032:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2384:x1875449616263936:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 48us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572471.204033:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616263808 00000100:00100000:0.0:1788572471.204038:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616263808 00000100:00100000:2.0:1788572471.204038:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4732 00000100:00080000:2.0:1788572471.204064:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572471.204066:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 80 00000100:00080000:2.0:1788572471.204068:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572471.204073:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616263808:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572471.204100:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616263808:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 28us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572471.204105:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 80 00000100:00100000:1.0:1788572471.204182:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616264320 00000100:00100000:1.0:1788572471.204186:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616264320 00000100:00100000:1.0:1788572471.204242:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616264192 00000100:00100000:1.0:1788572471.204246:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616264192 00000100:00100000:1.0:1788572471.204267:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3813 00000100:00100000:1.0:1788572471.204275:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616264320:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572471.204310:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616264320:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 36us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572471.204317:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3813 00000100:00100000:1.0:1788572471.204330:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3814 00000100:00100000:1.0:1788572471.204337:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616264192:12345-192.168.202.13@tcp:400:kworker.0 00000100:00080000:0.0:1788572471.205778:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572471.205788:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572471.206031:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616264192:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 1688us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572471.206043:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3814 00010000:00010000:3.0:1788572472.003549:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572472.325093:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572472.325119:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639232128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572472.325189:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572472.325654:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639232128 00000100:00100000:2.0:1788572472.325665:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639232128 00000100:00100000:2.0:1788572472.325755:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836 00000100:00100000:2.0:1788572472.325765:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639232128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572472.325802:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572472.325860:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639232128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572472.325867:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836 00000100:00100000:3.0:1788572472.326062:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639232128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572472.838647:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639232384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572472.838740:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572472.838819:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639232384 00000100:00100000:2.0:1788572472.838827:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639232384 00000100:00100000:2.0:1788572472.838886:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837 00000100:00100000:2.0:1788572472.838896:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639232384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572472.838931:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572472.838983:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639232384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572472.838989:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837 00000100:00100000:2.0:1788572472.839057:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639232384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572472.839711:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572472.839728:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639232256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572472.839771:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572472.841296:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639232256 00000100:00100000:0.0:1788572472.841310:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639232256 00000100:00100000:0.0:1788572472.841407:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:0.0:1788572472.841418:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639232256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572472.841455:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572472.841523:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639232256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572472.841533:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:1.0:1788572472.841649:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639232256:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788572472.841735:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788572473.028310:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572473.349970:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572473.349996:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639232512:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.350123:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572473.350181:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572473.350190:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639232640:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.350235:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572473.350489:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639232512 00000100:00100000:2.0:1788572473.350499:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639232512 00000100:00100000:2.0:1788572473.350555:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788572473.350565:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639232512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572473.350626:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639232512:12345-0@lo:400:kworker.0 Request processed in 63us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572473.350634:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788572473.350668:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639232640 00000100:00100000:2.0:1788572473.350672:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639232640 00000100:00100000:2.0:1788572473.350713:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:2.0:1788572473.350721:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639232640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572473.350765:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639232640:12345-0@lo:400:kworker.0 Request processed in 44us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572473.350771:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:2.0:1788572473.350811:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639232640:0@lo:400:kworker.0 00000100:00100000:2.0:1788572473.350853:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639232512:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.351338:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639232896:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.351374:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572473.351404:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639233408:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.351428:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572473.351445:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639233920:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.351464:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572473.351481:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788572473.351486:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639233024:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.351508:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572473.351522:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639233536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.351541:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572473.351555:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639234048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.351576:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572473.351648:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639233408 00000100:00100000:1.0:1788572473.351654:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639233408 00000100:00100000:1.0:1788572473.351722:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639233024 00000100:00100000:1.0:1788572473.351725:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639233024 00000100:00100000:1.0:1788572473.351747:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639233536 00000100:00100000:1.0:1788572473.351750:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639233536 00000100:00100000:1.0:1788572473.351765:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639234048 00000100:00100000:1.0:1788572473.351767:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639234048 00000100:00100000:1.0:1788572473.351782:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4733 00000100:00100000:1.0:1788572473.351789:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639233408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572473.351852:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639233408:12345-0@lo:400:kworker.0 Request processed in 64us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572473.351860:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4733 00000100:00100000:1.0:1788572473.351878:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4734 00000100:00100000:1.0:1788572473.351885:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639233024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572473.351914:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639233024:12345-0@lo:400:kworker.0 Request processed in 30us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572473.351920:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4734 00000100:00100000:1.0:1788572473.351930:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4735 00000100:00100000:1.0:1788572473.351935:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639233536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572473.351959:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639233536:12345-0@lo:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572473.351965:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4735 00000100:00100000:1.0:1788572473.351975:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4736 00000100:00100000:1.0:1788572473.351981:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639234048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352264:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639233024:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352275:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639233536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352283:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639234048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352291:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639233408:0@lo:400:kworker.0 00000100:00080000:0.0:1788572473.352314:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572473.352318:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572473.352344:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639233152:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352370:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572473.352387:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639233664:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352407:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572473.352423:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572473.352429:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639232768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352446:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572473.352455:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639233280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352472:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572473.352485:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639233792:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352501:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572473.352524:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639233152 00000100:00100000:0.0:1788572473.352527:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639233152 00000100:00100000:0.0:1788572473.352558:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639232768 00000100:00100000:0.0:1788572473.352561:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639232768 00000100:00100000:0.0:1788572473.352575:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4737 00000100:00100000:0.0:1788572473.352580:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639233152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352613:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639233152:12345-0@lo:400:kworker.0 Request processed in 34us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572473.352619:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4737 00000100:00100000:0.0:1788572473.352631:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4738 00000100:00100000:0.0:1788572473.352637:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639232768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352662:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639232768:12345-0@lo:400:kworker.0 Request processed in 27us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572473.352668:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4738 00000100:00100000:0.0:1788572473.352688:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639232768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572473.352709:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639233152:0@lo:400:kworker.0 00000100:00080000:0.0:1788572473.352725:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572473.352849:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639234048:12345-0@lo:400:kworker.0 Request processed in 867us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572473.352856:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4736 00000100:00100000:3.0:1788572473.353052:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639232896 00000100:00100000:3.0:1788572473.353057:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639232896 00000100:00100000:3.0:1788572473.353111:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639233920 00000100:00100000:3.0:1788572473.353115:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639233920 00000100:00100000:3.0:1788572473.353144:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639233280 00000100:00100000:3.0:1788572473.353147:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639233280 00000100:00100000:3.0:1788572473.353179:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639233792 00000100:00100000:3.0:1788572473.353183:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639233792 00000100:00100000:3.0:1788572473.353218:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:3.0:1788572473.353226:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639232896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572473.353290:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639232896:12345-0@lo:400:kworker.0 Request processed in 65us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572473.353297:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:3.0:1788572473.353317:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:3.0:1788572473.353324:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639233920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572473.353361:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3652:x1875449639233920:12345-0@lo:400:kworker.0 Request processed in 38us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572473.353367:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:3.0:1788572473.353384:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:3.0:1788572473.353391:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639233280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572473.353432:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639233280:12345-0@lo:400:kworker.0 Request processed in 42us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572473.353438:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:3.0:1788572473.353456:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:3.0:1788572473.353464:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639233792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572473.353491:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639233792:12345-0@lo:400:kworker.0 Request processed in 29us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572473.353498:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:3.0:1788572473.353544:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639233280:0@lo:400:kworker.0 00000100:00100000:3.0:1788572473.353556:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639233792:0@lo:400:kworker.0 00000100:00100000:3.0:1788572473.353582:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639232896:0@lo:400:kworker.0 00000100:00100000:3.0:1788572473.353594:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639233920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572473.354167:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639233664 00000100:00100000:2.0:1788572473.354174:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639233664 00000100:00100000:2.0:1788572473.354232:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839 00000100:00100000:2.0:1788572473.354240:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639233664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572473.354302:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639233664:12345-0@lo:400:kworker.0 Request processed in 63us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572473.354309:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839 00000100:00100000:3.0:1788572473.354420:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639233664:0@lo:400:kworker.0 00000100:00080000:0.0:1788572473.354984:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572473.354989:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788572474.051723:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572474.372393:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639234176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572474.372475:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572474.372602:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639234176 00000100:00100000:0.0:1788572474.372613:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639234176 00000100:00100000:0.0:1788572474.372677:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958 00000100:00100000:0.0:1788572474.372687:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639234176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572474.372718:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572474.372777:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875449639234176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572474.372785:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958 00000100:00100000:3.0:1788572474.373044:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639234176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572474.883310:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572474.883334:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639234304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572474.883400:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572474.883451:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639234304 00000100:00100000:2.0:1788572474.883459:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639234304 00000100:00100000:2.0:1788572474.883515:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:2.0:1788572474.883524:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639234304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572474.883555:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572474.883601:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639234304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572474.883609:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000100:00100000:2.0:1788572474.883656:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639234304:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1788572474.893763:0:9546:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968877 is committed 00010000:00010000:2.0:1788572475.075426:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572475.395412:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639234432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572475.395513:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572475.395866:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639234432 00000100:00100000:0.0:1788572475.395876:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639234432 00000100:00100000:0.0:1788572475.395949:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960 00000100:00100000:0.0:1788572475.395960:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639234432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572475.395983:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572475.396070:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639234432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572475.396077:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960 00000100:00080000:2.0:1788572475.396172:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572475.396246:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639234432:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788572476.099616:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572476.321730:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572476.321784:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572476.321831:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572476.321857:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616264704 00000100:00100000:1.0:1788572476.321868:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616264704 00000100:00100000:1.0:1788572476.321951:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4739 00000100:00100000:1.0:1788572476.321961:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616264704:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572476.322073:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616264704:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 112us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572476.322081:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4739 00000100:00100000:0.0:1788572476.322142:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616264448 00000100:00100000:0.0:1788572476.322148:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616264448 00000100:00100000:0.0:1788572476.322186:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 82 00000100:00100000:0.0:1788572476.322196:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616264448:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572476.322251:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616264448:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 57us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572476.322259:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 82 00000100:00100000:2.0:1788572476.322377:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616264960 00000100:00100000:2.0:1788572476.322383:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616264960 00000100:00100000:2.0:1788572476.322431:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3819 00000100:00100000:2.0:1788572476.322439:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616264960:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572476.322485:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616264960:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 48us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572476.322495:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3819 00000100:00080000:3.0:1788572476.322696:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572476.322701:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572476.335653:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572476.335710:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572476.337877:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616264576 00000100:00100000:2.0:1788572476.337898:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616264576 00000100:00100000:2.0:1788572476.338059:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4740 00000100:00100000:2.0:1788572476.338071:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2386:x1875449616264576:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572476.338175:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2386:x1875449616264576:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 107us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572476.338183:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4740 00000100:00100000:3.0:1788572476.339122:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616264832 00000100:00100000:3.0:1788572476.339132:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616264832 00000100:00100000:3.0:1788572476.339192:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3820 00000100:00100000:3.0:1788572476.339204:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616264832:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572476.339277:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616264832:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 77us (3565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572476.339286:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3820 00000100:00080000:0.0:1788572476.339835:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572476.339852:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788572477.129316:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572477.443395:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572477.443588:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639234560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572477.443683:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572477.444093:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639234560 00000100:00100000:2.0:1788572477.444105:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639234560 00000100:00100000:2.0:1788572477.444209:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:2.0:1788572477.444221:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639234560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572477.444276:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572477.444344:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639234560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572477.444352:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00100000:3.0:1788572477.444434:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639234560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572477.955345:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639234688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572477.955421:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572477.955863:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639234688 00000100:00100000:2.0:1788572477.955873:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639234688 00000100:00100000:2.0:1788572477.955933:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:2.0:1788572477.955944:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639234688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572477.955979:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572477.956064:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639234688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572477.956072:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:1.0:1788572477.956484:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639234688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572477.956931:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639234816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572477.956975:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572477.957887:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639234816 00000100:00100000:2.0:1788572477.957896:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639234816 00000100:00100000:2.0:1788572477.957948:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961 00000100:00100000:2.0:1788572477.957956:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639234816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572477.957983:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572477.958058:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639234816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572477.958064:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961 00000100:00080000:1.0:1788572477.958377:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572477.958420:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639234816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572478.147174:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572478.467435:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639235200:0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.467519:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572478.467566:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639235712:0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.467593:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572478.467615:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639236224:0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.467640:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572478.467663:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572478.467669:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639235328:0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.467692:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572478.467709:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639235840:0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.467731:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572478.467746:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639236352:0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.467793:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572478.467830:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639235712 00000100:00100000:1.0:1788572478.467838:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639235712 00000100:00100000:1.0:1788572478.467909:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639236224 00000100:00100000:1.0:1788572478.467914:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639236224 00000100:00100000:1.0:1788572478.467932:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639235328 00000100:00100000:1.0:1788572478.467934:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639235328 00000100:00100000:1.0:1788572478.467956:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639236352 00000100:00100000:1.0:1788572478.467959:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639236352 00000100:00100000:1.0:1788572478.467978:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:1.0:1788572478.467987:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639235712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.468096:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639235712:12345-0@lo:400:kworker.0 Request processed in 109us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572478.468104:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00100000:1.0:1788572478.468122:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:1.0:1788572478.468128:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639236224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.468156:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639236224:12345-0@lo:400:kworker.0 Request processed in 28us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572478.468162:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:1.0:1788572478.468173:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:1.0:1788572478.468180:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639235328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.468205:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639235328:12345-0@lo:400:kworker.0 Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572478.468211:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:1.0:1788572478.468222:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:1.0:1788572478.468228:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639236352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.468266:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639236352:12345-0@lo:400:kworker.0 Request processed in 38us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572478.468271:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00080000:1.0:1788572478.468290:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572478.468294:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572478.468327:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639235328:0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.468336:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968877 gen 2 00000100:00100000:1.0:1788572478.468351:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639236352:0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.468362:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639235712:0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.468370:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639236224:0@lo:400:kworker.0 00000100:00100000:2.0:1788572478.468961:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639235200 00000100:00100000:2.0:1788572478.468968:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639235200 00000100:00100000:2.0:1788572478.469046:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639235840 00000100:00100000:2.0:1788572478.469050:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639235840 00000100:00100000:2.0:1788572478.469095:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4741 00000100:00100000:2.0:1788572478.469103:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639235200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572478.469159:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639235200:12345-0@lo:400:kworker.0 Request processed in 58us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572478.469165:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4741 00000100:00100000:2.0:1788572478.469180:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4742 00000100:00100000:2.0:1788572478.469187:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639235840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572478.469215:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639235840:12345-0@lo:400:kworker.0 Request processed in 29us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572478.469220:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4742 00000100:00080000:2.0:1788572478.469263:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572478.469579:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639234944:0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.469625:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572478.469668:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639235456:0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.469692:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572478.469714:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639235968:0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.469738:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572478.469772:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639236480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.469804:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572478.469826:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572478.469833:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639235072:0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.470047:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572478.470192:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639235584:0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.470219:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572478.470251:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639236096:0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.470275:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572478.470322:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639235456 00000100:00100000:3.0:1788572478.470328:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639235456 00000100:00100000:3.0:1788572478.470375:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639235968 00000100:00100000:3.0:1788572478.470379:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639235968 00000100:00100000:3.0:1788572478.470393:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639236480 00000100:00100000:3.0:1788572478.470395:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639236480 00000100:00100000:3.0:1788572478.470405:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639235584 00000100:00100000:3.0:1788572478.470407:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639235584 00000100:00100000:3.0:1788572478.470423:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4743 00000100:00100000:3.0:1788572478.470429:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639235456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.470477:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639235456:12345-0@lo:400:kworker.0 Request processed in 47us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572478.470483:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4743 00000100:00100000:3.0:1788572478.470498:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4744 00000100:00100000:3.0:1788572478.470505:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639235968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.470532:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639235968:12345-0@lo:400:kworker.0 Request processed in 28us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572478.470537:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4744 00000100:00100000:3.0:1788572478.470548:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4745 00000100:00100000:3.0:1788572478.470554:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639236480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.470579:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639236480:12345-0@lo:400:kworker.0 Request processed in 26us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572478.470585:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4745 00000100:00100000:3.0:1788572478.470595:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4746 00000100:00100000:3.0:1788572478.470601:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639235584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.470626:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639235584:12345-0@lo:400:kworker.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572478.470632:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4746 00000100:00100000:3.0:1788572478.470652:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639235072 00000100:00100000:3.0:1788572478.470655:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639235072 00000100:00100000:3.0:1788572478.470678:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639236096 00000100:00100000:3.0:1788572478.470681:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639236096 00000100:00100000:3.0:1788572478.470696:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842 00000100:00100000:3.0:1788572478.470702:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639235072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.470733:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639235072:12345-0@lo:400:kworker.0 Request processed in 31us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572478.470739:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842 00000100:00100000:3.0:1788572478.470750:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843 00000100:00100000:3.0:1788572478.470755:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639236096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.470780:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639236096:12345-0@lo:400:kworker.0 Request processed in 25us (504us total) trans 0 rc 0/0 00000100:00080000:0.0:1788572478.471112:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572478.471117:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572478.471157:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639235072:0@lo:400:kworker.0 00000100:00100000:0.0:1788572478.471168:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639235584:0@lo:400:kworker.0 00000100:00100000:0.0:1788572478.471176:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639236096:0@lo:400:kworker.0 00000100:00100000:0.0:1788572478.471187:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639235456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572478.471196:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639235968:0@lo:400:kworker.0 00000100:00100000:0.0:1788572478.471205:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639236480:0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.471453:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639235840:0@lo:400:kworker.0 00000100:00100000:1.0:1788572478.471467:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639235200:0@lo:400:kworker.0 00000100:00100000:3.0:1788572478.471608:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843 00000100:00100000:2.0:1788572478.471687:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639234944 00000100:00100000:2.0:1788572478.471692:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639234944 00000100:00100000:2.0:1788572478.471736:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788572478.471744:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639234944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572478.471816:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639234944:12345-0@lo:400:kworker.0 Request processed in 74us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572478.471824:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788572478.472626:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639234944:0@lo:400:kworker.0 00010000:00010000:0.0:1788572479.171136:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572479.496906:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639236608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572479.496979:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572479.497188:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639236608 00000100:00100000:2.0:1788572479.497198:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639236608 00000100:00100000:2.0:1788572479.497266:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962 00000100:00100000:2.0:1788572479.497278:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639236608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572479.497320:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572479.497392:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639236608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572479.497399:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962 00000100:00100000:0.0:1788572479.497488:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639236608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572480.004465:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639236736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572480.004543:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572480.004600:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639236736 00000100:00100000:1.0:1788572480.004608:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639236736 00000100:00100000:1.0:1788572480.004666:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963 00000100:00100000:1.0:1788572480.004678:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639236736:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572480.004690:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788572480.004717:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572480.004768:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639236736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572480.004776:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963 00000100:00100000:1.0:1788572480.004848:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639236736:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788572480.195298:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572480.515200:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572480.515225:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639236864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572480.515320:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572480.515421:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639236864 00000100:00100000:3.0:1788572480.515433:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639236864 00000100:00100000:3.0:1788572480.515519:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2964 00000100:00100000:3.0:1788572480.515533:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639236864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788572480.515559:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572480.515634:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639236864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572480.515643:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2964 00000100:00100000:2.0:1788572480.515709:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639236864:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572480.518772:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788572481.219120:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572481.440710:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572481.440744:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572481.440768:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572481.440788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572481.440810:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572481.440836:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616265088 00000100:00100000:1.0:1788572481.440845:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616265088 00000100:00100000:1.0:1788572481.440896:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 84 00000100:00100000:1.0:1788572481.440905:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616265088:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572481.440979:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616265088:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 75us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572481.440987:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 84 00000100:00100000:1.0:1788572481.441044:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616265344 00000100:00100000:1.0:1788572481.441048:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616265344 00000100:00100000:1.0:1788572481.441084:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616265216 00000100:00100000:1.0:1788572481.441087:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616265216 00000100:00100000:1.0:1788572481.441109:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4747 00000100:00100000:1.0:1788572481.441116:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616265344:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572481.441147:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616265344:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 32us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572481.441153:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4747 00000100:00100000:1.0:1788572481.441165:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4748 00000100:00100000:1.0:1788572481.441170:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2386:x1875449616265216:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572481.441192:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2386:x1875449616265216:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572481.441197:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4748 00000100:00100000:1.0:1788572481.441215:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616265600 00000100:00100000:1.0:1788572481.441218:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616265600 00000100:00100000:1.0:1788572481.441243:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616265472 00000100:00100000:1.0:1788572481.441246:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616265472 00000100:00100000:1.0:1788572481.441291:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3825 00000100:00100000:1.0:1788572481.441298:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616265600:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572481.441323:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616265600:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572481.441330:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3825 00000100:00100000:1.0:1788572481.441341:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3826 00000100:00100000:1.0:1788572481.441348:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616265472:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572481.441370:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616265472:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572481.441376:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3826 00000100:00080000:1.0:1788572481.441527:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572481.441532:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572481.441534:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572481.441537:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788572482.243216:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572482.563537:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572482.563572:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639236992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572482.563679:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572482.564272:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639236992 00000100:00100000:2.0:1788572482.564285:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639236992 00000100:00100000:2.0:1788572482.564362:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:2.0:1788572482.564374:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639236992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572482.564421:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572482.564501:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639236992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572482.564619:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00000100:00100000:0.0:1788572482.564725:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639236992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572483.075467:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572483.075499:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639237248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572483.075610:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572483.075719:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639237248 00000100:00100000:2.0:1788572483.075730:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639237248 00000100:00100000:2.0:1788572483.075824:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965 00000100:00100000:2.0:1788572483.075836:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639237248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572483.075894:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572483.075968:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639237248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572483.075977:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965 00000100:00080000:2.0:1788572483.076045:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572483.076095:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639237248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572483.076589:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639237120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572483.076639:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572483.077329:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639237120 00000100:00100000:2.0:1788572483.077340:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639237120 00000100:00100000:2.0:1788572483.077403:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845 00000100:00100000:2.0:1788572483.077413:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639237120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572483.077451:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:1.0:1788572483.077726:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639237120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572483.077845:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639237120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 433us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572483.077853:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845 00010000:00010000:0.0:1788572483.267178:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572483.592651:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639237760:0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.592731:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572483.592763:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639238272:0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.592786:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572483.592810:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788572483.592816:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639237376:0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.592842:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572483.592866:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639237888:0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.592885:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572483.592900:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639238400:0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.592920:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572483.592945:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639237504:0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.592968:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572483.592987:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639238016:0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.593036:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572483.593063:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639238528:0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.593085:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572483.593105:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788572483.593110:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639237632:0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.593132:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572483.593151:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639238144:0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.593174:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572483.593191:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639238656:0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.593212:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572483.593248:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639237760 00000100:00100000:0.0:1788572483.593255:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639237760 00000100:00100000:0.0:1788572483.593327:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639238272 00000100:00100000:0.0:1788572483.593331:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639238272 00000100:00100000:0.0:1788572483.593346:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639237888 00000100:00100000:0.0:1788572483.593349:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639237888 00000100:00100000:0.0:1788572483.593366:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639237504 00000100:00100000:0.0:1788572483.593368:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639237504 00000100:00100000:0.0:1788572483.593378:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639238144 00000100:00100000:0.0:1788572483.593381:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639238144 00000100:00100000:0.0:1788572483.593392:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639238656 00000100:00100000:0.0:1788572483.593394:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639238656 00000100:00100000:0.0:1788572483.593408:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4749 00000100:00100000:0.0:1788572483.593416:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639237760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.593474:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639237760:12345-0@lo:400:kworker.0 Request processed in 58us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572483.593481:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4749 00000100:00100000:0.0:1788572483.593499:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4750 00000100:00100000:0.0:1788572483.593505:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639238272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.593531:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639238272:12345-0@lo:400:kworker.0 Request processed in 27us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572483.593536:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4750 00000100:00100000:0.0:1788572483.593546:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4751 00000100:00100000:0.0:1788572483.593553:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639237888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.593578:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639237888:12345-0@lo:400:kworker.0 Request processed in 26us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572483.593583:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4751 00000100:00100000:0.0:1788572483.593594:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4752 00000100:00100000:0.0:1788572483.593600:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639237504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.593629:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639237504:12345-0@lo:400:kworker.0 Request processed in 29us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572483.593635:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4752 00000100:00100000:0.0:1788572483.593646:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4753 00000100:00100000:0.0:1788572483.593652:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60faa1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639238144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.593677:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60faa1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639238144:12345-0@lo:400:kworker.0 Request processed in 26us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572483.593682:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4753 00000100:00100000:0.0:1788572483.594834:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4754 00000100:00100000:0.0:1788572483.594847:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639238656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.594901:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639238656:12345-0@lo:400:kworker.0 Request processed in 57us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572483.594907:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4754 00000100:00100000:0.0:1788572483.594946:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639237376 00000100:00100000:0.0:1788572483.594953:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639237376 00000100:00100000:0.0:1788572483.594988:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788572483.594996:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639237376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.595050:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639237376:12345-0@lo:400:kworker.0 Request processed in 55us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572483.595060:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788572483.595092:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639238400 00000100:00100000:0.0:1788572483.595096:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639238400 00000100:00100000:0.0:1788572483.595125:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846 00000100:00100000:0.0:1788572483.595132:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639238400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.595164:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639238400:12345-0@lo:400:kworker.0 Request processed in 33us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572483.595170:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846 00000100:00100000:0.0:1788572483.595193:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639238016 00000100:00100000:0.0:1788572483.595196:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639238016 00000100:00100000:0.0:1788572483.595228:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639238528 00000100:00100000:0.0:1788572483.595230:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639238528 00000100:00100000:0.0:1788572483.595248:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639237632 00000100:00100000:0.0:1788572483.595251:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639237632 00000100:00100000:0.0:1788572483.602359:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:0.0:1788572483.602383:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639238016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.602480:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639238016:12345-0@lo:400:kworker.0 Request processed in 107us (9441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572483.602488:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:0.0:1788572483.602508:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:0.0:1788572483.602516:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639238528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.602547:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639238528:12345-0@lo:400:kworker.0 Request processed in 32us (9461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572483.602553:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00100000:0.0:1788572483.602565:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:0.0:1788572483.602573:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639237632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572483.602607:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633de4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639237632:12345-0@lo:400:kworker.0 Request processed in 36us (9474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572483.602614:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00080000:3.0:1788572483.612231:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572483.612242:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572483.612246:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572483.612249:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572483.612334:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639237376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572483.612356:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639237888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572483.612370:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639238400:0@lo:400:kworker.0 00000100:00100000:3.0:1788572483.612383:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639237760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572483.612397:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639238272:0@lo:400:kworker.0 00000100:00100000:3.0:1788572483.612476:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639237632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572483.612488:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639238144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572483.612499:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639238656:0@lo:400:kworker.0 00000100:00100000:3.0:1788572483.612510:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639237504:0@lo:400:kworker.0 00000100:00100000:3.0:1788572483.612521:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639238016:0@lo:400:kworker.0 00000100:00100000:3.0:1788572483.612534:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639238528:0@lo:400:kworker.0 00010000:00010000:0.0:1788572484.291435:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572484.611381:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572484.611406:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639238784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572484.611491:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572484.611713:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639238784 00000100:00100000:0.0:1788572484.611723:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639238784 00000100:00100000:0.0:1788572484.611773:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966 00000100:00100000:0.0:1788572484.611782:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639238784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572484.611813:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572484.611865:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639238784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572484.611872:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966 00000100:00100000:3.0:1788572484.612341:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639238784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572485.123447:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572485.123475:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639238912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572485.123555:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572485.123714:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639238912 00000100:00100000:2.0:1788572485.123723:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639238912 00000100:00100000:2.0:1788572485.123801:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967 00000100:00100000:2.0:1788572485.123812:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639238912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572485.123844:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572485.123898:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639238912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572485.123905:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967 00000100:00080000:0.0:1788572485.124057:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572485.124099:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639238912:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788572485.326364:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572485.635380:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639239040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572485.635464:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572485.635600:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639239040 00000100:00100000:2.0:1788572485.635608:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639239040 00000100:00080000:0.0:1788572485.635722:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572485.635759:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:2.0:1788572485.635772:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639239040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572485.635796:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572485.635856:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639239040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572485.635863:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00000100:00100000:0.0:1788572485.635938:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639239040:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788572486.342098:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572486.572700:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572486.572756:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572486.572790:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572486.572814:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572486.572851:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572486.572884:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616266240 00000100:00100000:2.0:1788572486.572895:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616266240 00000100:00100000:2.0:1788572486.572957:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616266112 00000100:00100000:2.0:1788572486.572960:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616266112 00000100:00100000:2.0:1788572486.572984:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3830 00000100:00100000:2.0:1788572486.572993:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616266240:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572486.573177:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616265984 00000100:00100000:0.0:1788572486.573181:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616265984 00000100:00100000:0.0:1788572486.573215:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616265856 00000100:00100000:0.0:1788572486.573219:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616265856 00000100:00100000:0.0:1788572486.573242:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4755 00000100:00100000:0.0:1788572486.573250:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616265984:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572486.573991:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616265728 00000100:00100000:3.0:1788572486.574000:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616265728 00000100:00100000:3.0:1788572486.574054:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 86 00000100:00100000:3.0:1788572486.574072:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616265728:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572486.577719:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616265984:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 4455us (4948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572486.577736:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4755 00000100:00100000:0.0:1788572486.577791:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4756 00000100:00100000:0.0:1788572486.577805:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2383:x1875449616265856:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572486.577853:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2383:x1875449616265856:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 53us (5037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572486.577859:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4756 00000100:00080000:0.0:1788572486.577888:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572486.577893:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572486.577896:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572486.577899:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572486.580246:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616266240:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 7240us (7440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572486.580262:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3830 00000100:00100000:2.0:1788572486.580311:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3831 00000100:00100000:2.0:1788572486.580326:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616266112:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572486.580374:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616266112:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 55us (7523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572486.580383:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3831 00000100:00100000:3.0:1788572486.585988:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616265728:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 11893us (13276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572486.586028:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 86 00010000:00010000:3.0:1788572487.363266:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572487.684430:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639239168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572487.684512:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572487.684684:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639239168 00000100:00100000:2.0:1788572487.684694:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639239168 00000100:00100000:2.0:1788572487.684749:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:2.0:1788572487.684759:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639239168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572487.684794:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572487.684961:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639239168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 202us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572487.684969:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00100000:1.0:1788572487.685699:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639239168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572488.197754:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639239296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572488.197831:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572488.198043:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639239296 00000100:00100000:1.0:1788572488.198052:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639239296 00000100:00100000:1.0:1788572488.198109:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:1.0:1788572488.198119:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639239296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572488.198154:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:1.0:1788572488.198212:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639239296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572488.198219:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00100000:0.0:1788572488.198501:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639239296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572488.198532:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572488.198540:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639239424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572488.198569:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572488.198710:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639239424 00000100:00100000:2.0:1788572488.198716:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639239424 00000100:00100000:2.0:1788572488.198775:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:2.0:1788572488.198784:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639239424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572488.198810:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572488.198850:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639239424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572488.198856:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00080000:0.0:1788572488.199788:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572488.199838:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639239424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788572488.388135:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572488.707332:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639239808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.707406:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572488.707440:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639240320:0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.707463:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572488.707480:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639240832:0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.707498:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572488.707535:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788572488.707541:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639239936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.707563:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572488.707580:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639240448:0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.707597:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572488.707628:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639239808 00000100:00100000:0.0:1788572488.707636:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639239808 00000100:00100000:0.0:1788572488.707699:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:0.0:1788572488.707709:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50329f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639239808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.707763:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50329f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639239808:12345-0@lo:400:kworker.0 Request processed in 55us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572488.707770:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00100000:0.0:1788572488.707795:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639240320 00000100:00100000:0.0:1788572488.707798:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639240320 00000100:00100000:0.0:1788572488.707824:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639240832 00000100:00100000:0.0:1788572488.707827:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639240832 00000100:00100000:0.0:1788572488.707843:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639239936 00000100:00100000:0.0:1788572488.707846:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639239936 00000100:00100000:0.0:1788572488.707858:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639240448 00000100:00100000:0.0:1788572488.707860:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639240448 00000100:00100000:2.0:1788572488.708080:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639239552:0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708116:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572488.708146:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639240064:0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708168:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572488.708179:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639240576:0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708198:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572488.708216:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788572488.708222:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639239680:0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708241:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572488.708252:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639240192:0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708268:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572488.708296:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639240704:0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708316:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572488.708346:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639239552 00000100:00100000:2.0:1788572488.708350:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639239552 00000100:00100000:2.0:1788572488.708378:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788572488.708385:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6184f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639239552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708418:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6184f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639239552:12345-0@lo:400:kworker.0 Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572488.708424:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788572488.708450:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639240576 00000100:00100000:2.0:1788572488.708454:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639240576 00000100:00100000:2.0:1788572488.708478:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:2.0:1788572488.708485:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639240576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708529:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639240576:12345-0@lo:400:kworker.0 Request processed in 44us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572488.708535:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00100000:2.0:1788572488.708553:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639240192 00000100:00100000:2.0:1788572488.708556:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639240192 00000100:00100000:2.0:1788572488.708581:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639240704 00000100:00100000:2.0:1788572488.708583:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639240704 00000100:00100000:2.0:1788572488.708602:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:2.0:1788572488.708608:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639240192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708638:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639240192:12345-0@lo:400:kworker.0 Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572488.708644:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:2.0:1788572488.708655:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:2.0:1788572488.708661:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639240704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708687:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639240704:12345-0@lo:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572488.708693:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:2.0:1788572488.708759:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639240192:0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708771:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639240704:0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708778:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639239552:0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.708786:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639240576:0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.708999:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639240064 00000100:00100000:0.0:1788572488.709025:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639240064 00000100:00100000:0.0:1788572488.709043:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639239680 00000100:00100000:0.0:1788572488.709046:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639239680 00000100:00100000:0.0:1788572488.709060:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4757 00000100:00100000:0.0:1788572488.709066:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50329ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639240320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.709100:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50329ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639240320:12345-0@lo:400:kworker.0 Request processed in 35us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572488.709107:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4757 00000100:00100000:0.0:1788572488.709120:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4758 00000100:00100000:0.0:1788572488.709125:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50329c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639240832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.709151:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50329c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639240832:12345-0@lo:400:kworker.0 Request processed in 26us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572488.709156:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4758 00000100:00100000:0.0:1788572488.709167:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4759 00000100:00100000:0.0:1788572488.709173:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50329e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639239936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.709197:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50329e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639239936:12345-0@lo:400:kworker.0 Request processed in 24us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572488.709202:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4759 00000100:00100000:0.0:1788572488.709212:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4760 00000100:00100000:0.0:1788572488.709218:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50329f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639240448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.709242:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50329f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639240448:12345-0@lo:400:kworker.0 Request processed in 25us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572488.709248:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4760 00000100:00100000:0.0:1788572488.709258:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4761 00000100:00100000:0.0:1788572488.709265:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639240064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.709310:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639240064:12345-0@lo:400:kworker.0 Request processed in 46us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572488.709320:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4761 00000100:00100000:0.0:1788572488.709332:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4762 00000100:00100000:0.0:1788572488.709338:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639239680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.709364:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639239680:12345-0@lo:400:kworker.0 Request processed in 26us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572488.709369:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4762 00000100:00080000:0.0:1788572488.709400:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572488.709404:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572488.709406:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572488.709408:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572488.709457:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639239936:0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.709469:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639240448:0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.709482:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639239808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.709491:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639240320:0@lo:400:kworker.0 00000100:00100000:0.0:1788572488.709502:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50384df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639240832:0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.709844:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639239680:0@lo:400:kworker.0 00000100:00100000:2.0:1788572488.709856:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639240064:0@lo:400:kworker.0 00000001:02000400:3.0:1788572489.310371:0:117661:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 44a: race in target handle connect ========================================================== 21:41:27 (1788572487) 00010000:00010000:0.0:1788572489.411290:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572489.735052:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572489.735086:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639240960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572489.735164:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572489.735925:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639240960 00000100:00100000:3.0:1788572489.735936:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639240960 00000100:00100000:3.0:1788572489.736367:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970 00000100:00100000:3.0:1788572489.736379:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639240960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572489.736411:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572489.736484:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639240960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572489.736491:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970 00000100:00100000:0.0:1788572489.736576:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639240960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572490.247841:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572490.248159:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639241088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572490.248243:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572490.248338:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639241088 00000100:00100000:3.0:1788572490.248350:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639241088 00000100:00100000:3.0:1788572490.248421:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971 00000100:00100000:3.0:1788572490.248431:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50384df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639241088:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572490.248750:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788572490.248960:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572490.249349:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50384df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639241088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 917us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572490.249358:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971 00000100:00100000:2.0:1788572490.250047:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639241088:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788572490.435353:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572490.758588:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572490.758613:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639241216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572490.758689:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572490.758736:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639241216 00000100:00100000:1.0:1788572490.758744:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639241216 00000100:00100000:1.0:1788572490.758805:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972 00000100:00100000:1.0:1788572490.758814:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639241216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572490.758836:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572490.758880:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639241216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572490.758888:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972 00000100:00080000:1.0:1788572490.758910:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572490.758947:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639241216:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788572491.460222:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572491.684492:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572491.684548:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572491.684575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572491.684603:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572491.684632:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572491.684658:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616266752 00000100:00100000:1.0:1788572491.684667:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616266752 00000100:00100000:1.0:1788572491.684726:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616266880 00000100:00100000:1.0:1788572491.684729:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616266880 00000100:00100000:1.0:1788572491.684752:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4510 00000100:00100000:1.0:1788572491.684762:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2382:x1875449616266752:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:1.0:1788572491.684792:0:17011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b833a419 00000100:00080000:1.0:1788572491.684801:0:17011:0:(import.c:65:import_set_state_nolock()) ffff94e61e72b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572491.684849:0:17011:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884902113 00000100:00100000:1.0:1788572491.685025:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+2:2382:x1875449616266752:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 245us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572491.685033:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4510 00000100:00100000:1.0:1788572491.685050:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4511 00000100:00100000:1.0:1788572491.685057:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2382:x1875449616266880:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:1.0:1788572491.685068:0:17011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b833a420 00000100:00080000:1.0:1788572491.685074:0:17011:0:(import.c:65:import_set_state_nolock()) ffff94e6056f1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572491.685099:0:17011:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968877 00000100:00100000:1.0:1788572491.685169:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+2:2382:x1875449616266880:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 111us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572491.685176:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4511 00000100:00100000:1.0:1788572491.685196:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616266624 00000100:00100000:1.0:1788572491.685199:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616266624 00000100:00100000:1.0:1788572491.685228:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616266496 00000100:00100000:1.0:1788572491.685231:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616266496 00000100:00100000:1.0:1788572491.685254:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4763 00000100:00100000:1.0:1788572491.685261:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616266624:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572491.685302:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616266624:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 41us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572491.685308:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4763 00000100:00100000:1.0:1788572491.685577:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4764 00000100:00100000:1.0:1788572491.685586:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2384:x1875449616266496:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572491.685613:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2384:x1875449616266496:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572491.685618:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4764 00000100:00080000:1.0:1788572491.685639:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572491.685642:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572491.685644:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572491.685646:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572491.685660:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572491.686456:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572491.689672:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616266368 00000100:00100000:2.0:1788572491.689690:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616266368 00000100:00100000:2.0:1788572491.689770:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 88 00000100:00100000:2.0:1788572491.689782:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616266368:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572491.690486:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616266368:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 699us (5998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572491.690497:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 88 00010000:00010000:0.0:1788572492.483815:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572492.803403:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572492.803426:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639241344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572492.803497:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572492.803856:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639241344 00000100:00100000:2.0:1788572492.803866:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639241344 00000100:00100000:2.0:1788572492.803924:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850 00000100:00100000:2.0:1788572492.803935:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639241344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572492.803971:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572492.804287:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639241344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 354us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572492.804295:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850 00000100:00100000:3.0:1788572492.804479:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639241344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572493.316379:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50329d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639241472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572493.316449:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.317028:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639241600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572493.317063:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.317104:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639241600 00000100:00100000:2.0:1788572493.317104:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639241472 00000100:00100000:1.0:1788572493.317112:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639241600 00000100:00100000:2.0:1788572493.317112:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639241472 00000100:00100000:1.0:1788572493.317152:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2973 00000100:00100000:2.0:1788572493.317152:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:1.0:1788572493.317160:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639241600:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572493.317161:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50329c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639241472:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:1.0:1788572493.317186:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000004:00000024:2.0:1788572493.317186:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:1.0:1788572493.317228:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639241600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572493.317228:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50329c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639241472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572493.317235:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2973 00000100:00100000:2.0:1788572493.317235:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00080000:1.0:1788572493.317254:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572493.317291:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50329d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639241472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572493.317292:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639241600:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572493.510831:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572493.829383:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639241728:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829452:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.829493:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639242240:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829517:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.829534:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639242752:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829554:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.829575:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788572493.829580:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639242112:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829597:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.829610:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639242624:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829627:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.829652:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639241984:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829673:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.829692:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639242496:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829709:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.829723:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639243008:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829739:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.829753:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788572493.829758:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639241856:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829775:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.829789:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639242368:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829803:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.829816:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639242880:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829830:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572493.829873:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639241728 00000100:00100000:1.0:1788572493.829880:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639241728 00000100:00100000:1.0:1788572493.829926:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788572493.829933:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639241728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.829974:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639241728:12345-0@lo:400:kworker.0 Request processed in 42us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572493.829981:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788572493.830028:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639242752 00000100:00100000:1.0:1788572493.830031:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639242752 00000100:00100000:1.0:1788572493.833230:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:1.0:1788572493.833248:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639242752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.833352:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639242752:12345-0@lo:400:kworker.0 Request processed in 110us (3796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572493.833359:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:3.0:1788572493.833364:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639241984 00000100:00100000:3.0:1788572493.833371:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639241984 00000100:00100000:1.0:1788572493.833386:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639242240 00000100:00100000:1.0:1788572493.833388:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639242240 00000100:00100000:1.0:1788572493.833410:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639242112 00000100:00100000:1.0:1788572493.833413:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639242112 00000100:00100000:3.0:1788572493.833417:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639242368 00000100:00100000:3.0:1788572493.833419:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639242368 00000100:00100000:1.0:1788572493.833426:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639242624 00000100:00100000:1.0:1788572493.833428:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639242624 00000100:00100000:3.0:1788572493.833437:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639242880 00000100:00100000:1.0:1788572493.833439:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639242496 00000100:00100000:3.0:1788572493.833439:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639242880 00000100:00100000:1.0:1788572493.833441:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639242496 00000100:00100000:1.0:1788572493.833451:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639243008 00000100:00100000:1.0:1788572493.833454:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639243008 00000100:00100000:3.0:1788572493.833457:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:1.0:1788572493.833463:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639241856 00000100:00100000:3.0:1788572493.833463:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639241984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.833465:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639241856 00000100:00100000:1.0:1788572493.833477:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4765 00000100:00100000:1.0:1788572493.833482:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639242240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833505:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639241984:12345-0@lo:400:kworker.0 Request processed in 42us (3831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572493.833510:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639242240:12345-0@lo:400:kworker.0 Request processed in 29us (3993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572493.833512:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:1.0:1788572493.833516:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4765 00000100:00100000:1.0:1788572493.833526:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4766 00000100:00100000:3.0:1788572493.833528:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:1.0:1788572493.833532:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639242112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833533:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639242368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.833557:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639242112:12345-0@lo:400:kworker.0 Request processed in 25us (3958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572493.833557:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639242368:12345-0@lo:400:kworker.0 Request processed in 23us (3752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572493.833564:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4766 00000100:00100000:3.0:1788572493.833564:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:1.0:1788572493.833574:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4767 00000100:00100000:3.0:1788572493.833575:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:1.0:1788572493.833581:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639242624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833581:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639242880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.833605:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639242624:12345-0@lo:400:kworker.0 Request processed in 26us (3977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572493.833605:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639242880:12345-0@lo:400:kworker.0 Request processed in 25us (3774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572493.833611:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4767 00000100:00100000:3.0:1788572493.833611:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00100000:1.0:1788572493.833622:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4768 00000100:00100000:1.0:1788572493.833627:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639242496:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788572493.833627:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572493.833631:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572493.833633:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572493.833635:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572493.833653:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639242496:12345-0@lo:400:kworker.0 Request processed in 27us (3943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572493.833658:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4768 00000100:00100000:1.0:1788572493.833668:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4769 00000100:00100000:1.0:1788572493.833673:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639243008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833673:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639242368:0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833686:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639242880:0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833697:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639241984:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.833698:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639243008:12345-0@lo:400:kworker.0 Request processed in 25us (3958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572493.833704:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4769 00000100:00100000:3.0:1788572493.833709:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639242496:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.833713:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4770 00000100:00100000:1.0:1788572493.833718:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639241856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833720:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639243008:0@lo:400:kworker.0 00000100:00100000:1.0:1788572493.833742:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639241856:12345-0@lo:400:kworker.0 Request processed in 25us (3966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572493.833747:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4770 00000100:00100000:3.0:1788572493.833753:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639241856:0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833813:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639242112:0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833825:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639242624:0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833835:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639241728:0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833845:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639242240:0@lo:400:kworker.0 00000100:00100000:3.0:1788572493.833855:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639242752:0@lo:400:kworker.0 00010000:00010000:0.0:1788572494.531226:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572494.855114:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572494.855144:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50329d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639243136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572494.855218:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572494.855352:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639243136 00000100:00100000:0.0:1788572494.855359:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639243136 00000100:00100000:0.0:1788572494.855416:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974 00000100:00100000:0.0:1788572494.855426:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639243136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572494.855457:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 197568 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572494.855506:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639243136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572494.855513:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974 00000100:00100000:3.0:1788572494.855598:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50329d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639243136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572495.363290:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572495.373860:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639243264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572495.373941:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.374027:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639243264 00000100:00100000:1.0:1788572495.374036:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639243264 00000100:00100000:1.0:1788572495.374099:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975 00000100:00100000:1.0:1788572495.374111:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639243264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572495.374143:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572495.374191:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639243264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.374198:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975 00000100:00080000:1.0:1788572495.374220:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572495.374270:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639243264:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572495.557356:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572495.875214:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639243392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572495.875301:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572495.875423:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639243392 00000100:00100000:1.0:1788572495.875431:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639243392 00000100:00100000:1.0:1788572495.875499:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976 00000100:00100000:1.0:1788572495.875510:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50329d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639243392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572495.875532:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 197568 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572495.875585:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50329d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639243392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572495.875593:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976 00000100:00100000:1.0:1788572495.875637:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639243392:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788572495.875724:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572495.966606:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572495.969114:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616267008 00000100:00100000:3.0:1788572495.969131:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616267008 00000100:00100000:3.0:1788572495.969220:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4771 00000100:00100000:3.0:1788572495.969230:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616267008:12345-192.168.202.13@tcp:38:lctl.0 00010000:00020000:3.0:1788572495.969240:0:6552:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_race id 701 sleeping 00000100:00080000:1.0:1788572495.972073:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572496.579327:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572496.806131:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572496.806175:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572496.806624:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616267264 00000100:00100000:2.0:1788572496.806635:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616267264 00000100:00100000:2.0:1788572496.806714:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4772 00000100:00100000:2.0:1788572496.806725:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616267264:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572496.806814:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616267264:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 90us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572496.806821:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4772 00000100:00100000:3.0:1788572496.807264:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616267136 00000100:00100000:3.0:1788572496.807270:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616267136 00000100:00100000:3.0:1788572496.807306:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 90 00000100:00100000:3.0:1788572496.807312:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616267136:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572496.807345:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616267136:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 33us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572496.807351:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 90 00000100:00080000:1.0:1788572496.807763:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788572497.605562:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572497.923357:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639243520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572497.923457:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572497.923609:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639243520 00000100:00100000:2.0:1788572497.923617:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639243520 00000100:00100000:2.0:1788572497.923686:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:2.0:1788572497.923696:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639243520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572497.923735:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572497.923791:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639243520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572497.923798:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:0.0:1788572497.923895:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639243520:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788572497.933352:0:114775:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000020:00000080:2.0:1788572497.933364:0:114775:0:(genops.c:885:class_export_put()) final put ffff94e61e72c000/35eb2d60-2de0-4b00-9815-d5153edd0057 00000001:00100000:0.0:1788572497.933472:0:9546:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000020:00000080:0.0:1788572497.933477:0:9546:0:(genops.c:885:class_export_put()) final put ffff94e6056f6800/35eb2d60-2de0-4b00-9815-d5153edd0057 00000020:00000080:3.0:1788572497.933554:0:38320:0:(genops.c:844:class_export_destroy()) destroying export ffff94e61e72c000/35eb2d60-2de0-4b00-9815-d5153edd0057 for lustre-OST0000 00000020:00000080:3.0:1788572497.933609:0:38320:0:(genops.c:844:class_export_destroy()) destroying export ffff94e6056f6800/35eb2d60-2de0-4b00-9815-d5153edd0057 for lustre-OST0001 00000020:00000080:3.0:1788572497.933636:0:38320:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e61e72b000 for lustre-OST0000 00000020:00000080:3.0:1788572497.933641:0:38320:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94e6056f1000 for lustre-OST0001 00000100:00100000:3.0:1788572498.435316:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572498.435345:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639243648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572498.435429:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572498.435698:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572498.435708:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50329df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639243776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572498.435741:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572498.435947:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639243648 00000100:00100000:1.0:1788572498.435958:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639243648 00000100:00100000:1.0:1788572498.436057:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977 00000100:00100000:1.0:1788572498.436069:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639243648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572498.436101:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572498.436154:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639243648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572498.436161:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977 00000100:00100000:1.0:1788572498.436189:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639243776 00000100:00100000:1.0:1788572498.436204:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639243776 00000100:00100000:1.0:1788572498.436230:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854 00000100:00100000:1.0:1788572498.436237:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50329dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639243776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788572498.436272:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:1.0:1788572498.436307:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50329dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639243776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572498.436312:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854 00000100:00100000:2.0:1788572498.436456:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639243648:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788572498.436738:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572498.436765:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50329df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639243776:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788572498.627269:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572498.948567:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639244288:0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.948636:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572498.948669:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639244800:0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.948693:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572498.948716:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572498.948722:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50329d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639244160:0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.948746:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572498.948763:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639244672:0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.948782:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572498.948795:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e502d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639245184:0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.948813:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572498.948899:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639244160 00000100:00100000:2.0:1788572498.948907:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639244160 00000100:00100000:2.0:1788572498.948980:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:2.0:1788572498.948990:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639244160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572498.949074:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639244160:12345-0@lo:400:kworker.0 Request processed in 86us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572498.949081:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00100000:2.0:1788572498.949111:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639244288 00000100:00100000:2.0:1788572498.949114:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639244288 00000100:00100000:2.0:1788572498.949137:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639244800 00000100:00100000:2.0:1788572498.949139:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639244800 00000100:00100000:2.0:1788572498.949151:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639244672 00000100:00100000:2.0:1788572498.949153:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639244672 00000100:00100000:2.0:1788572498.949163:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639245184 00000100:00100000:2.0:1788572498.949165:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639245184 00000100:00100000:2.0:1788572498.949178:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4773 00000100:00100000:2.0:1788572498.949184:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639244288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572498.949214:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639244288:12345-0@lo:400:kworker.0 Request processed in 31us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572498.949220:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4773 00000100:00100000:2.0:1788572498.949231:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4774 00000100:00100000:2.0:1788572498.949237:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639244800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572498.949294:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639244800:12345-0@lo:400:kworker.0 Request processed in 57us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572498.949299:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4774 00000100:00100000:2.0:1788572498.949310:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4775 00000100:00100000:2.0:1788572498.949316:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639244672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572498.949341:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639244672:12345-0@lo:400:kworker.0 Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572498.949347:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4775 00000100:00100000:2.0:1788572498.949358:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4776 00000100:00100000:2.0:1788572498.949363:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639245184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572498.949387:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639245184:12345-0@lo:400:kworker.0 Request processed in 24us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572498.949392:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4776 00000100:00080000:0.0:1788572498.949543:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572498.949548:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572498.949550:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572498.949582:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50329d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639244160:0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.949593:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639244672:0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.949601:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e502d5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639245184:0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.949610:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639244288:0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.949619:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639244800:0@lo:400:kworker.0 00000100:00100000:3.0:1788572498.949780:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50329d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639244032:0@lo:400:kworker.0 00000100:00100000:3.0:1788572498.949813:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572498.949842:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639244544:0@lo:400:kworker.0 00000100:00100000:3.0:1788572498.949863:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572498.949883:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e502d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639245056:0@lo:400:kworker.0 00000100:00100000:3.0:1788572498.949903:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572498.949924:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788572498.949930:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50329df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639243904:0@lo:400:kworker.0 00000100:00100000:3.0:1788572498.949968:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572498.949993:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639244416:0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.950170:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639244544 00000100:00100000:0.0:1788572498.950176:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639244544 00000100:00100000:0.0:1788572498.950213:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639245056 00000100:00100000:0.0:1788572498.950216:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639245056 00000100:00100000:0.0:1788572498.950234:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:0.0:1788572498.950257:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639244544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.950297:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639244544:12345-0@lo:400:kworker.0 Request processed in 57us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572498.950303:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00100000:0.0:1788572498.950316:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:0.0:1788572498.950322:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639245056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.950348:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639245056:12345-0@lo:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572498.950354:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:00080000:0.0:1788572498.950367:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572498.950431:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572498.950455:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639244928:0@lo:400:kworker.0 00000100:00100000:3.0:1788572498.950479:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572498.950506:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639244544:0@lo:400:kworker.0 00000100:00100000:3.0:1788572498.950516:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e502d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639245056:0@lo:400:kworker.0 00000100:00100000:3.0:1788572498.950543:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639244928 00000100:00100000:3.0:1788572498.950547:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639244928 00000100:00100000:3.0:1788572498.950575:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:3.0:1788572498.950581:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639244928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572498.950619:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639244928:12345-0@lo:400:kworker.0 Request processed in 37us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572498.950626:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:3.0:1788572498.950652:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639244928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.950715:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639244032 00000100:00100000:0.0:1788572498.950719:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639244032 00000100:00100000:0.0:1788572498.950751:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639244416 00000100:00100000:0.0:1788572498.950754:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639244416 00000100:00100000:0.0:1788572498.950777:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4777 00000100:00100000:0.0:1788572498.950783:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639244032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.950816:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639244032:12345-0@lo:400:kworker.0 Request processed in 32us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572498.950822:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4777 00000100:00100000:0.0:1788572498.950833:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4778 00000100:00100000:0.0:1788572498.950839:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639244416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.950865:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639244416:12345-0@lo:400:kworker.0 Request processed in 26us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572498.950870:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4778 00000100:00080000:0.0:1788572498.950884:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572498.950969:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639243904 00000100:00100000:1.0:1788572498.950974:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639243904 00000100:00100000:0.0:1788572498.951314:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788572498.951324:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639243904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572498.951359:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639243904:12345-0@lo:400:kworker.0 Request processed in 37us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572498.951366:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788572498.952000:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50329df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639243904:0@lo:400:kworker.0 00000100:00100000:3.0:1788572498.952182:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639244416:0@lo:400:kworker.0 00000100:00100000:3.0:1788572498.952196:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50329d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639244032:0@lo:400:kworker.0 00010000:00010000:0.0:1788572499.652248:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572499.972836:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572499.972872:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639245312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572499.972952:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572499.973086:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639245312 00000100:00100000:1.0:1788572499.973095:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639245312 00000100:00100000:1.0:1788572499.973153:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978 00000100:00100000:1.0:1788572499.973163:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639245312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572499.973195:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 197568 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572499.973287:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639245312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572499.973295:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978 00000100:00100000:3.0:1788572499.973521:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639245312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572500.483464:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639245440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572500.483548:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572500.483646:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639245440 00000100:00100000:3.0:1788572500.483656:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639245440 00000100:00100000:3.0:1788572500.483782:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979 00000100:00100000:3.0:1788572500.483793:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639245440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788572500.483825:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572500.483896:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639245440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572500.483903:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979 00000100:00100000:1.0:1788572500.484344:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50384e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639245440:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572500.488828:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572500.676232:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00020000:3.0:1788572500.995865:0:6552:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 awake: rc=0 00000100:00100000:2.0:1788572500.996191:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572500.996217:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639245568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572500.996303:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572500.996704:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639245568 00000100:00100000:1.0:1788572500.996714:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639245568 00000100:00100000:1.0:1788572500.996788:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980 00000100:00100000:1.0:1788572500.996799:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50384e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639245568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572500.996845:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 197568 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572500.996900:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50384e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639245568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572500.996908:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980 00000100:00080000:2.0:1788572500.997053:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572500.997093:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639245568:0@lo:13:osp-pre-1-1.0 00010000:02000400:3.0:1788572501.004274:0:6552:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 35eb2d60-2de0-4b00-9815-d5153edd0057 (at 192.168.202.13@tcp) reconnecting 00010000:00080000:3.0:1788572501.009878:0:6552:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t219043334909 exp ffff94e633e09800 cur 4418 last 1788572495 00000004:00100000:3.0:1788572501.009928:0:6552:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.13@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1788572501.010411:0:6552:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1788572501.010422:0:6552:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572501.011543:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616267008:12345-192.168.202.13@tcp:38:lctl.0 Request processed in 5042306us (5044937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572501.011567:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4771 00000100:00100000:1.0:1788572501.064825:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572501.066417:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616267392 00000100:00100000:0.0:1788572501.066433:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616267392 00000100:00100000:0.0:1788572501.066544:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15535 00000100:00100000:0.0:1788572501.066558:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91508:x1875449616267392:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572501.066600:0:9276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572501.066701:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91508:x1875449616267392:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 147us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572501.066709:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15535 00000100:00080000:2.0:1788572501.067874:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572501.072260:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572501.072406:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616267520 00000100:00100000:2.0:1788572501.072416:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616267520 00000100:00100000:2.0:1788572501.072504:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15536 00000100:00100000:2.0:1788572501.072519:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91508:x1875449616267520:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:2.0:1788572501.072578:0:10390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572501.072699:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91508:x1875449616267520:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 183us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572501.072709:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15536 00000100:00080000:0.0:1788572501.073056:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572501.077106:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572501.077481:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616267648 00000100:00100000:2.0:1788572501.077496:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616267648 00000100:00100000:2.0:1788572501.077566:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4512 00000100:00100000:2.0:1788572501.077578:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2382:x1875449616267648:12345-192.168.202.13@tcp:8:lfs.0 00010000:00020000:2.0:1788572501.077590:0:8465:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 waking 00010000:00080000:2.0:1788572501.088074:0:8465:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t0 exp 0000000000000000 cur 4418 last 0 00000020:00000080:2.0:1788572501.088133:0:8465:0:(genops.c:1385:class_connect()) connect: client 35eb2d60-2de0-4b00-9815-d5153edd0057, cookie 0xdb7edb52b833a497 00002000:00100000:2.0:1788572501.088147:0:8465:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35eb2d60-2de0-4b00-9815-d5153edd0057/ffff94e618794000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788572501.088159:0:8465:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788572501.088259:0:8465:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788572501.088293:0:8465:0:(import.c:65:import_set_state_nolock()) ffff94e618791000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572501.088817:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2382:x1875449616267648:12345-192.168.202.13@tcp:8:lfs.0 Request processed in 11237us (11718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572501.088830:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4512 00000100:00100000:2.0:1788572501.092627:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572501.092863:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616267776 00000100:00100000:1.0:1788572501.092875:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616267776 00000100:00100000:1.0:1788572501.092969:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2981 00000100:00100000:1.0:1788572501.092981:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91508:x1875449616267776:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572501.093048:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572501.093142:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91508:x1875449616267776:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 162us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572501.093153:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2981 00000100:00080000:0.0:1788572501.094135:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572501.100701:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572501.101204:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616267904 00000100:00100000:2.0:1788572501.101213:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616267904 00000100:00100000:2.0:1788572501.101274:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4513 00000100:00100000:2.0:1788572501.101283:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2382:x1875449616267904:12345-192.168.202.13@tcp:8:lfs.0 00010000:00020000:2.0:1788572501.101293:0:17011:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 waking 00010000:00080000:2.0:1788572501.101329:0:17011:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t0 exp 0000000000000000 cur 4418 last 0 00000020:00000080:2.0:1788572501.101356:0:17011:0:(genops.c:1385:class_connect()) connect: client 35eb2d60-2de0-4b00-9815-d5153edd0057, cookie 0xdb7edb52b833a49e 00002000:00100000:2.0:1788572501.101367:0:17011:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35eb2d60-2de0-4b00-9815-d5153edd0057/ffff94e618795800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788572501.101374:0:17011:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788572501.101437:0:17011:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788572501.101460:0:17011:0:(import.c:65:import_set_state_nolock()) ffff94e618790800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572501.101535:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2382:x1875449616267904:12345-192.168.202.13@tcp:8:lfs.0 Request processed in 252us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572501.101541:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4513 00000100:00100000:2.0:1788572501.114227:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572501.114535:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616268032 00000100:00100000:1.0:1788572501.114546:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616268032 00000100:00100000:1.0:1788572501.114633:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2982 00000100:00100000:1.0:1788572501.114645:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91508:x1875449616268032:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572501.114674:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572501.114751:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91508:x1875449616268032:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 107us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572501.114759:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2982 00000100:00080000:0.0:1788572501.114988:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572501.702996:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572501.920373:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572501.920415:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572501.920504:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616268288 00000100:00100000:2.0:1788572501.920514:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616268288 00000100:00100000:2.0:1788572501.920582:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4779 00000100:00100000:2.0:1788572501.920593:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2386:x1875449616268288:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572501.920671:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2386:x1875449616268288:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 80us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572501.920679:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4779 00000100:00100000:3.0:1788572501.921095:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572501.921123:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572501.921148:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572501.921199:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616268160 00000100:00100000:2.0:1788572501.921204:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616268160 00000100:00100000:2.0:1788572501.921247:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 92 00000100:00100000:2.0:1788572501.921254:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616268160:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572501.921292:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616268160:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572501.921312:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 92 00000100:00100000:0.0:1788572501.932142:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616268544 00000100:00100000:0.0:1788572501.932161:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616268544 00000100:00100000:0.0:1788572501.932293:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616268672 00000100:00100000:0.0:1788572501.932297:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616268672 00000100:00100000:2.0:1788572501.933637:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3841 00000100:00100000:2.0:1788572501.933658:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616268544:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572501.933753:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616268544:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 103us (13337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572501.933761:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3841 00000100:00100000:2.0:1788572501.933914:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3842 00000100:00100000:2.0:1788572501.933921:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616268672:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572501.933953:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616268672:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 32us (12803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572501.933959:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3842 00000100:00100000:0.0:1788572501.937665:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616268416 00000100:00100000:0.0:1788572501.937682:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616268416 00000100:00100000:0.0:1788572501.937747:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4780 00000100:00100000:0.0:1788572501.937775:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616268416:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572501.937888:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616268416:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 114us (16763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572501.937896:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4780 00010000:00010000:0.0:1788572502.725270:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572503.046550:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572503.046574:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639245696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572503.046948:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572503.055629:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639245696 00000100:00100000:1.0:1788572503.055645:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639245696 00000100:00100000:1.0:1788572503.055703:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:1.0:1788572503.055714:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639245696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572503.055756:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572503.055863:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639245696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (8915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572503.055870:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00000100:00100000:2.0:1788572503.063949:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639245696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572503.260834:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572503.264612:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616268800 00000100:00100000:3.0:1788572503.264632:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616268800 00000100:00100000:3.0:1788572503.264730:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4781 00000100:00100000:3.0:1788572503.264744:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616268800:12345-192.168.202.13@tcp:38:lctl.0 00010000:00020000:3.0:1788572503.264767:0:10390:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_race id 701 sleeping 00000100:00080000:1.0:1788572503.266559:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572503.555409:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572503.555436:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639245824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572503.555531:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572503.555721:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639245824 00000100:00100000:3.0:1788572503.555730:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639245824 00000100:00100000:3.0:1788572503.555798:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:3.0:1788572503.555808:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639245824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572503.555846:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:3.0:1788572503.555910:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639245824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572503.555917:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:1.0:1788572503.556050:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639245824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572503.556384:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572503.556397:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639245952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572503.556434:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572503.556705:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639245952 00000100:00100000:1.0:1788572503.556711:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639245952 00000100:00100000:1.0:1788572503.556769:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2983 00000100:00100000:1.0:1788572503.556777:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639245952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572503.556800:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572503.556854:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639245952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572503.556861:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2983 00000100:00100000:2.0:1788572503.556990:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639245952:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788572503.557722:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572503.748598:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572504.067359:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639246208:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.067555:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639246464:0@lo:400:kworker.0 00000100:00100000:3.0:1788572504.067581:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572504.067589:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572504.067653:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639246208 00000100:00100000:1.0:1788572504.067663:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639246208 00000100:00100000:2.0:1788572504.067669:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639246336:0@lo:400:kworker.0 00000100:00100000:1.0:1788572504.067901:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:1.0:1788572504.067914:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639246208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.073150:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639246976:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.073237:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572504.074083:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639247488:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.074124:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572504.074153:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788572504.074160:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639246080:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.074188:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572504.074217:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639246592:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.074266:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572504.074285:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639247104:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.074304:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572504.074319:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639247616:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.074336:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572504.074370:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639246976 00000100:00100000:0.0:1788572504.074378:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639246976 00000100:00100000:0.0:1788572504.074435:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639246592 00000100:00100000:0.0:1788572504.074439:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639246592 00000100:00100000:0.0:1788572504.074454:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639247104 00000100:00100000:0.0:1788572504.074456:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639247104 00000100:00100000:0.0:1788572504.074466:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639247616 00000100:00100000:0.0:1788572504.074468:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639247616 00000100:00100000:0.0:1788572504.074482:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4782 00000100:00100000:0.0:1788572504.074491:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639246976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.074546:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639246976:12345-0@lo:400:kworker.0 Request processed in 56us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572504.074553:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4782 00000100:00100000:0.0:1788572504.074570:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4783 00000100:00100000:0.0:1788572504.074576:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639246592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.074604:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639246592:12345-0@lo:400:kworker.0 Request processed in 29us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572504.074610:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4783 00000100:00100000:0.0:1788572504.074621:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4784 00000100:00100000:0.0:1788572504.074628:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639247104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.074654:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639247104:12345-0@lo:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572504.074659:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4784 00000100:00100000:0.0:1788572504.074669:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4785 00000100:00100000:0.0:1788572504.074674:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639247616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.074699:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639247616:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572504.074704:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4785 00000100:00100000:0.0:1788572504.074721:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639246080 00000100:00100000:0.0:1788572504.074725:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639246080 00000100:00100000:0.0:1788572504.074751:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788572504.074757:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639246080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.074784:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639246080:12345-0@lo:400:kworker.0 Request processed in 27us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572504.074805:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1788572504.075252:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572504.075314:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572504.075347:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639246080:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.075361:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639246592:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.075371:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639247104:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.075380:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639247616:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.075388:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639246976:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.075450:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639246464 00000100:00100000:0.0:1788572504.075455:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639246464 00000100:00100000:0.0:1788572504.075498:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639247488 00000100:00100000:0.0:1788572504.075501:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639247488 00000100:00100000:0.0:1788572504.075525:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:0.0:1788572504.075531:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639246464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.075574:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639246464:12345-0@lo:400:kworker.0 Request processed in 42us (7983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572504.075580:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00100000:0.0:1788572504.075593:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:0.0:1788572504.075599:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639247488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.075625:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639247488:12345-0@lo:400:kworker.0 Request processed in 27us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572504.075630:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00080000:0.0:1788572504.075646:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572504.075649:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572504.075665:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639246464:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.075675:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639247488:0@lo:400:kworker.0 00000100:00100000:3.0:1788572504.079119:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639246720:0@lo:400:kworker.0 00000100:00100000:3.0:1788572504.079203:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572504.079244:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639247232:0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.080927:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639246720 00000100:00100000:0.0:1788572504.080943:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639246720 00000100:00100000:0.0:1788572504.081039:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4786 00000100:00100000:0.0:1788572504.081049:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639246720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.081131:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639246720:12345-0@lo:400:kworker.0 Request processed in 83us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572504.081139:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4786 00000100:00080000:0.0:1788572504.081163:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572504.082392:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572504.082442:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572504.082473:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639247232 00000100:00100000:0.0:1788572504.082482:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639247232 00000100:00100000:0.0:1788572504.082525:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:0.0:1788572504.082533:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639247232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572504.082608:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639246848:0@lo:400:kworker.0 00000100:00100000:2.0:1788572504.082653:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572504.082678:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639246848 00000100:00100000:2.0:1788572504.082682:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639246848 00000100:00100000:2.0:1788572504.082720:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:2.0:1788572504.082726:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639246848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572504.082760:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639246848:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572504.082768:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:0.0:1788572504.082950:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639247232:12345-0@lo:400:kworker.0 Request processed in 416us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572504.082958:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00100000:0.0:1788572504.082983:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639246336 00000100:00100000:0.0:1788572504.082987:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639246336 00000100:00100000:0.0:1788572504.083044:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4787 00000100:00100000:0.0:1788572504.083052:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639246336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572504.083089:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639246336:12345-0@lo:400:kworker.0 Request processed in 38us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572504.083095:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4787 00000100:00080000:0.0:1788572504.083119:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572504.083406:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639246848:0@lo:400:kworker.0 00000100:00100000:2.0:1788572504.083417:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639247360:0@lo:400:kworker.0 00000100:00100000:2.0:1788572504.083445:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572504.083619:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639246336:0@lo:400:kworker.0 00000100:00100000:2.0:1788572504.083658:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639247360 00000100:00100000:2.0:1788572504.083662:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639247360 00000100:00100000:2.0:1788572504.083686:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:2.0:1788572504.083693:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639247360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572504.083733:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639247360:12345-0@lo:400:kworker.0 Request processed in 41us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572504.083739:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00100000:2.0:1788572504.083766:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639247360:0@lo:400:kworker.0 00000100:00100000:3.0:1788572504.086948:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639247232:0@lo:400:kworker.0 00000100:00100000:3.0:1788572504.086994:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639246720:0@lo:400:kworker.0 00000100:00100000:1.0:1788572504.087204:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639246208:12345-0@lo:400:kworker.0 Request processed in 19289us (19620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572504.087215:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000100:00100000:3.0:1788572504.089962:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639246208:0@lo:400:kworker.0 00010000:00010000:0.0:1788572504.771197:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572505.098324:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639247744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572505.098418:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572505.099128:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639247744 00000100:00100000:0.0:1788572505.099140:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639247744 00000100:00100000:0.0:1788572505.099207:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984 00000100:00100000:0.0:1788572505.099228:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639247744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572505.099264:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572505.099336:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639247744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572505.099343:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984 00000100:00100000:1.0:1788572505.099476:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639247744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572505.606509:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572505.606534:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639247872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572505.606611:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572505.607272:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639247872 00000100:00100000:2.0:1788572505.607283:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639247872 00000100:00100000:2.0:1788572505.607347:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985 00000100:00100000:2.0:1788572505.607360:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639247872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572505.607393:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572505.607459:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639247872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572505.607467:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985 00000100:00100000:1.0:1788572505.607568:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639247872:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572505.795295:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572506.115525:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572506.115553:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639248000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572506.115633:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572506.115871:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639248000 00000100:00100000:1.0:1788572506.115881:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639248000 00000100:00100000:1.0:1788572506.115973:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986 00000100:00100000:1.0:1788572506.115998:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639248000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572506.116059:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572506.116114:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639248000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572506.116121:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986 00000100:00080000:2.0:1788572506.116325:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572506.116375:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639248000:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572506.819449:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572507.047249:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572507.047300:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572507.047332:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572507.047369:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572507.047395:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616269056 00000100:00100000:1.0:1788572507.047395:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616269184 00000100:00100000:2.0:1788572507.047399:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616269312 00000100:00100000:0.0:1788572507.047406:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616269056 00000100:00100000:2.0:1788572507.047406:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616269312 00000100:00100000:1.0:1788572507.047407:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616269184 00000100:00100000:3.0:1788572507.047472:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616268928 00000100:00100000:3.0:1788572507.047477:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616268928 00000100:00100000:3.0:1788572507.047536:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 94 00000100:00100000:3.0:1788572507.047547:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616268928:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572507.047624:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616268928:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 79us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572507.047633:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 94 00000100:00100000:2.0:1788572507.047723:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3847 00000100:00100000:2.0:1788572507.047731:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616269312:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572507.047761:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616269312:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 32us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572507.047766:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3847 00000100:00100000:1.0:1788572507.056757:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3848 00000100:00100000:1.0:1788572507.056780:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616269184:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572507.056903:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616269184:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 133us (9570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572507.056922:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3848 00000100:00080000:3.0:1788572507.064857:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572507.064868:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572507.064872:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572507.065131:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4788 00000100:00100000:0.0:1788572507.065149:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616269056:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572507.065267:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616269056:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 124us (17964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572507.065275:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4788 00000001:00100000:0.0:1788572507.142561:0:9546:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00000001:00100000:2.0:1788572507.142928:0:114775:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35eb2d60-2de0-4b00-9815-d5153edd0057 00010000:00010000:2.0:1788572507.844914:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572508.163467:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572508.163492:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639248128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572508.163584:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572508.167618:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639248128 00000100:00100000:2.0:1788572508.167643:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639248128 00000100:00100000:2.0:1788572508.167723:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:2.0:1788572508.167734:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639248128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572508.167774:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572508.167871:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639248128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (4286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572508.167878:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000100:00100000:1.0:1788572508.167998:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639248128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572508.676161:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639248256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572508.676256:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572508.676440:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639248256 00000100:00100000:0.0:1788572508.676450:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639248256 00000100:00100000:0.0:1788572508.676506:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:0.0:1788572508.676527:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639248256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572508.676567:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572508.676631:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639248256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572508.676638:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:3.0:1788572508.676821:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639248256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572508.676957:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639248384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572508.676994:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572508.677093:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639248384 00000100:00100000:1.0:1788572508.677098:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639248384 00000100:00100000:1.0:1788572508.677152:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987 00000100:00100000:1.0:1788572508.677159:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639248384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572508.677181:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00080000:3.0:1788572508.677225:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572508.677231:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639248384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572508.677238:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987 00000100:00100000:2.0:1788572508.677323:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639248384:0@lo:13:osp-pre-0-0.0 00010000:00020000:0.0:1788572508.678654:0:10390:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 awake: rc=0 00010000:02000400:0.0:1788572508.688312:0:10390:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 35eb2d60-2de0-4b00-9815-d5153edd0057 (at 192.168.202.13@tcp) reconnecting 00010000:00080000:0.0:1788572508.703056:0:10390:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t219043334909 exp ffff94e633e09800 cur 4425 last 1788572503 00000004:00100000:0.0:1788572508.703108:0:10390:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.13@tcp supports cksum type f7, return f7 00000100:00080000:0.0:1788572508.703135:0:10390:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1788572508.703156:0:10390:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572508.703259:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616268800:12345-192.168.202.13@tcp:38:lctl.0 Request processed in 5438508us (5442429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572508.703270:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4781 00000100:00100000:1.0:1788572508.763841:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572508.764268:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616269440 00000100:00100000:0.0:1788572508.764279:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616269440 00000100:00100000:0.0:1788572508.764366:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15537 00000100:00100000:0.0:1788572508.764378:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91529:x1875449616269440:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572508.764414:0:6552:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572508.764503:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91529:x1875449616269440:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 127us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572508.764512:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15537 00000100:00080000:3.0:1788572508.764885:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572508.778713:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572508.779572:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616269568 00000100:00100000:0.0:1788572508.779584:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616269568 00000100:00100000:0.0:1788572508.779654:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15538 00000100:00100000:0.0:1788572508.779667:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91529:x1875449616269568:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572508.779706:0:95742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572508.779789:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91529:x1875449616269568:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 124us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572508.779795:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15538 00000100:00100000:2.0:1788572508.790529:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572508.791803:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616269696 00000100:00100000:1.0:1788572508.791819:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616269696 00000100:00100000:1.0:1788572508.791953:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2988 00000100:00100000:1.0:1788572508.791966:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91529:x1875449616269696:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572508.791997:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572508.792116:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91529:x1875449616269696:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 151us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572508.792123:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2988 00000100:00100000:1.0:1788572508.796987:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572508.800511:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616269824 00000100:00100000:2.0:1788572508.800527:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616269824 00000100:00100000:2.0:1788572508.800605:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2989 00000100:00100000:2.0:1788572508.800617:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91529:x1875449616269824:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:2.0:1788572508.800661:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572508.800802:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91529:x1875449616269824:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 186us (3826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572508.800810:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2989 00010000:00010000:2.0:1788572508.873067:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572509.199895:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639248768:0@lo:400:kworker.0 00000100:00100000:3.0:1788572509.199977:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572509.200032:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639249280:0@lo:400:kworker.0 00000100:00100000:3.0:1788572509.200059:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572509.200077:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639249792:0@lo:400:kworker.0 00000100:00100000:3.0:1788572509.200097:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572509.200130:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788572509.200136:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639248896:0@lo:400:kworker.0 00000100:00100000:3.0:1788572509.200157:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572509.200175:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639249408:0@lo:400:kworker.0 00000100:00100000:3.0:1788572509.200195:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572509.200222:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639249920:0@lo:400:kworker.0 00000100:00100000:3.0:1788572509.200242:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572509.200279:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639249280 00000100:00100000:3.0:1788572509.200286:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639249280 00000100:00100000:2.0:1788572509.200411:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639248640:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.200443:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572509.200481:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639249152:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.200500:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572509.200513:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639249664:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.200531:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572509.200548:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788572509.200553:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639248512:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.200576:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572509.200592:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639249024:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.200612:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572509.200628:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639249536:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.200646:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572509.200658:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639250048:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.200673:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572509.200698:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639249792 00000100:00100000:2.0:1788572509.200702:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639249792 00000100:00100000:2.0:1788572509.200741:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639248896 00000100:00100000:2.0:1788572509.200743:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639248896 00000100:00100000:2.0:1788572509.200767:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639249920 00000100:00100000:2.0:1788572509.200770:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639249920 00000100:00100000:2.0:1788572509.200788:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:2.0:1788572509.200796:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639249792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.200845:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639249792:12345-0@lo:400:kworker.0 Request processed in 49us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572509.200852:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:2.0:1788572509.200873:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:2.0:1788572509.200879:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639248896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.200904:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639248896:12345-0@lo:400:kworker.0 Request processed in 26us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572509.200910:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00100000:2.0:1788572509.200924:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:2.0:1788572509.200930:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639249920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.200954:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639249920:12345-0@lo:400:kworker.0 Request processed in 25us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572509.200960:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:2.0:1788572509.200978:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639248640 00000100:00100000:2.0:1788572509.200982:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639248640 00000100:00100000:2.0:1788572509.201001:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639249664 00000100:00100000:2.0:1788572509.201020:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639249664 00000100:00100000:2.0:1788572509.201038:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:2.0:1788572509.201044:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639248640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201077:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639248640:12345-0@lo:400:kworker.0 Request processed in 33us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572509.201083:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00000100:00100000:2.0:1788572509.201094:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:2.0:1788572509.201100:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639249664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201123:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639249664:12345-0@lo:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572509.201127:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00000100:00100000:2.0:1788572509.201145:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639248768 00000100:00100000:2.0:1788572509.201148:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639248768 00000100:00100000:2.0:1788572509.201163:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639249408 00000100:00100000:2.0:1788572509.201165:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639249408 00000100:00100000:2.0:1788572509.201174:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639249152 00000100:00100000:2.0:1788572509.201176:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639249152 00000100:00100000:2.0:1788572509.201185:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639249024 00000100:00100000:2.0:1788572509.201186:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639249024 00000100:00100000:2.0:1788572509.201194:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639249536 00000100:00100000:2.0:1788572509.201197:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639249536 00000100:00100000:2.0:1788572509.201222:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639250048 00000100:00100000:2.0:1788572509.201224:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639250048 00000100:00100000:2.0:1788572509.201237:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4789 00000100:00100000:2.0:1788572509.201242:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639248768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201268:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639248768:12345-0@lo:400:kworker.0 Request processed in 27us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572509.201273:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4789 00000100:00100000:2.0:1788572509.201283:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4790 00000100:00100000:2.0:1788572509.201288:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639249408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201321:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639249408:12345-0@lo:400:kworker.0 Request processed in 34us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572509.201326:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4790 00000100:00100000:2.0:1788572509.201336:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4791 00000100:00100000:2.0:1788572509.201341:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639249152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201359:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639249152:12345-0@lo:400:kworker.0 Request processed in 19us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572509.201364:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4791 00000100:00100000:2.0:1788572509.201372:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4792 00000100:00100000:2.0:1788572509.201377:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639249024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201395:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d4b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639249024:12345-0@lo:400:kworker.0 Request processed in 19us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572509.201400:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4792 00000100:00100000:2.0:1788572509.201411:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4793 00000100:00100000:2.0:1788572509.201416:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639249536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201438:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639249536:12345-0@lo:400:kworker.0 Request processed in 23us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572509.201443:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4793 00000100:00100000:2.0:1788572509.201453:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4794 00000100:00100000:2.0:1788572509.201457:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639250048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201477:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639250048:12345-0@lo:400:kworker.0 Request processed in 20us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572509.201481:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4794 00000100:00080000:2.0:1788572509.201503:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572509.201507:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572509.201509:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572509.201511:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572509.201543:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639248896:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201552:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639249408:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201560:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639249920:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201569:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639248768:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201577:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639249792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201620:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639249024:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201629:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639249536:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201637:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639250048:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201645:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639248640:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201652:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639249152:0@lo:400:kworker.0 00000100:00100000:2.0:1788572509.201661:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639249664:0@lo:400:kworker.0 00000100:00100000:0.0:1788572509.202031:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639248512 00000100:00100000:0.0:1788572509.202037:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639248512 00000100:00100000:0.0:1788572509.202071:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788572509.202078:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63acf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639248512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572509.202128:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63acf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639248512:12345-0@lo:400:kworker.0 Request processed in 50us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572509.202133:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788572509.202179:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639248512:0@lo:400:kworker.0 00000100:00100000:3.0:1788572509.205371:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:3.0:1788572509.205388:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639249280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572509.205565:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639249280:12345-0@lo:400:kworker.0 Request processed in 180us (5503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572509.205574:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:2.0:1788572509.206462:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639249280:0@lo:400:kworker.0 00000100:00080000:0.0:1788572509.208086:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572509.897558:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572510.211288:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788572510.211310:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639250176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572510.211385:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572510.211571:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639250176 00000100:00100000:0.0:1788572510.211580:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639250176 00000100:00100000:0.0:1788572510.211628:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990 00000100:00100000:0.0:1788572510.211637:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639250176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572510.211668:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572510.211715:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639250176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572510.211721:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990 00000100:00100000:0.0:1788572510.211767:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639250176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572510.725693:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572510.725717:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fc3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639250304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572510.725793:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572510.727331:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639250304 00000100:00100000:2.0:1788572510.727347:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639250304 00000100:00100000:2.0:1788572510.727457:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991 00000100:00100000:2.0:1788572510.727467:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639250304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572510.727503:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572510.727569:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639250304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572510.727577:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991 00000100:00100000:3.0:1788572510.728852:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fc3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639250304:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572510.915357:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572511.252973:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639250432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572511.253074:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572511.253340:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639250432 00000100:00100000:0.0:1788572511.253349:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639250432 00000100:00100000:0.0:1788572511.253417:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992 00000100:00100000:0.0:1788572511.253427:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639250432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572511.253449:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572511.253500:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639250432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572511.253506:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992 00000100:00100000:0.0:1788572511.253567:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639250432:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788572511.256391:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572511.426082:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572511.427427:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616269952 00000100:00100000:3.0:1788572511.427454:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616269952 00000100:00100000:3.0:1788572511.427557:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4795 00000100:00100000:3.0:1788572511.427570:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616269952:12345-192.168.202.13@tcp:38:lctl.0 00010000:00020000:3.0:1788572511.427580:0:9276:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_race id 701 sleeping 00000100:00080000:0.0:1788572511.427628:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572511.939339:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572512.165779:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572512.165851:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572512.165884:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572512.165925:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572512.166045:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616270336 00000100:00100000:0.0:1788572512.166056:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616270336 00000100:00100000:0.0:1788572512.166111:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616270464 00000100:00100000:0.0:1788572512.166114:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616270464 00000100:00100000:0.0:1788572512.166143:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3853 00000100:00100000:0.0:1788572512.166153:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616270336:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572512.166242:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616270336:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 90us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572512.166250:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3853 00000100:00100000:0.0:1788572512.166266:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3854 00000100:00100000:0.0:1788572512.166272:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616270464:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572512.166296:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616270464:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572512.166302:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3854 00000100:00100000:3.0:1788572512.166625:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616270080 00000100:00100000:3.0:1788572512.166630:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616270080 00000100:00100000:3.0:1788572512.166673:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 96 00000100:00100000:3.0:1788572512.166680:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616270080:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572512.166716:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616270080:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 37us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572512.166723:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 96 00000100:00080000:1.0:1788572512.166919:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572512.166924:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572512.167225:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616270208 00000100:00100000:2.0:1788572512.167231:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616270208 00000100:00100000:2.0:1788572512.167280:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4796 00000100:00100000:2.0:1788572512.167288:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616270208:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572512.167347:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616270208:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 59us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572512.167354:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4796 00000100:00080000:1.0:1788572512.167617:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788572512.966361:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572513.193789:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572513.199541:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572513.199608:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572513.199663:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572513.201287:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616270976 00000100:00100000:0.0:1788572513.201307:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616270976 00000100:00100000:0.0:1788572513.201424:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616270848 00000100:00100000:0.0:1788572513.201573:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616270848 00000100:00100000:0.0:1788572513.201616:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3855 00000100:00100000:0.0:1788572513.201629:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616270976:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572513.201751:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616270976:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 124us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572513.201759:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3855 00000100:00100000:0.0:1788572513.201779:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3856 00000100:00100000:0.0:1788572513.201785:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616270848:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572513.201997:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616270848:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 211us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572513.202052:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3856 00000100:00100000:3.0:1788572513.202297:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616270592 00000100:00100000:3.0:1788572513.202305:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616270592 00000100:00100000:3.0:1788572513.202357:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 97 00000100:00100000:3.0:1788572513.202365:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616270592:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572513.202408:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616270592:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 44us (2799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572513.202415:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 97 00000100:00100000:2.0:1788572513.208843:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616270720 00000100:00100000:2.0:1788572513.208869:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616270720 00000100:00100000:2.0:1788572513.208961:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4797 00000100:00100000:2.0:1788572513.208975:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616270720:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572513.209137:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616270720:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 164us (15363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572513.209146:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4797 00000100:00100000:0.0:1788572513.284749:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639250560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572513.285132:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572513.285348:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639250560 00000100:00100000:2.0:1788572513.285361:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639250560 00000100:00100000:2.0:1788572513.285568:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:2.0:1788572513.285584:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639250560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572513.285637:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572513.285711:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639250560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572513.285718:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000100:00100000:1.0:1788572513.285934:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639250560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572513.795840:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639250688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572513.795951:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572513.798681:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639250688 00000100:00100000:2.0:1788572513.798718:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639250688 00000100:00100000:2.0:1788572513.798803:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:2.0:1788572513.798815:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639250688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572513.798877:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572513.798996:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639250688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 182us (3045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572513.799028:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00100000:2.0:1788572513.799683:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639250816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572513.808775:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639250688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572513.816147:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572513.816607:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639250816 00000100:00100000:1.0:1788572513.816622:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639250816 00000100:00100000:1.0:1788572513.816851:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993 00000100:00100000:1.0:1788572513.816865:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639250816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572513.816914:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572513.816989:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639250816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572513.816998:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993 00000100:00100000:1.0:1788572513.817593:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639250816:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788572513.821280:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572513.988924:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572514.313581:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639250944:0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.313694:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572514.313768:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639251456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.313810:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572514.313838:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639251968:0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.313863:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572514.313897:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788572514.313903:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639251328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.313931:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572514.313950:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639251840:0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.313973:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572514.314055:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639251456 00000100:00100000:0.0:1788572514.314065:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639251456 00000100:00100000:0.0:1788572514.314295:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639251968 00000100:00100000:0.0:1788572514.314300:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639251968 00000100:00100000:0.0:1788572514.314323:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639251840 00000100:00100000:0.0:1788572514.314326:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639251840 00000100:00100000:0.0:1788572514.314348:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4798 00000100:00100000:0.0:1788572514.314359:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639251456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572514.315376:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639251328 00000100:00100000:1.0:1788572514.315389:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639251328 00000100:00100000:1.0:1788572514.315554:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:1.0:1788572514.315566:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639251328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572514.315646:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639251328:12345-0@lo:400:kworker.0 Request processed in 84us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572514.315653:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:3.0:1788572514.315993:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639250944 00000100:00100000:3.0:1788572514.316000:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639250944 00000100:00100000:3.0:1788572514.316061:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788572514.316263:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4799 00000100:00100000:2.0:1788572514.316275:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639251968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572514.316330:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639251968:12345-0@lo:400:kworker.0 Request processed in 57us (2466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572514.316337:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4799 00000100:00100000:2.0:1788572514.316359:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4800 00000100:00100000:2.0:1788572514.316369:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639251840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572514.316404:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639251840:12345-0@lo:400:kworker.0 Request processed in 37us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572514.316411:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4800 00000100:00100000:0.0:1788572514.316532:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639251456:12345-0@lo:400:kworker.0 Request processed in 70us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572514.316543:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4798 00000100:00080000:0.0:1788572514.316580:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572514.316587:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572514.316591:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572514.316617:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639252480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.316670:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572514.316953:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639250944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.317044:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639251328:0@lo:400:kworker.0 00000100:00100000:1.0:1788572514.317121:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639252352:0@lo:400:kworker.0 00000100:00100000:2.0:1788572514.317370:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639251072:0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.318894:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639250944:12345-0@lo:400:kworker.0 Request processed in 2816us (5191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572514.318912:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788572514.319049:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639251200:0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.319540:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572514.319587:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639251712:0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.319624:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572514.319646:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639252224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.319674:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572514.319743:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639252480 00000100:00100000:3.0:1788572514.319755:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639252480 00000100:00100000:3.0:1788572514.319819:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639251200 00000100:00100000:3.0:1788572514.319823:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639251200 00000100:00100000:3.0:1788572514.319858:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4801 00000100:00100000:3.0:1788572514.319869:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639252480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.319943:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639252480:12345-0@lo:400:kworker.0 Request processed in 75us (3272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572514.319950:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4801 00000100:00100000:3.0:1788572514.319969:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4802 00000100:00100000:3.0:1788572514.319977:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639251200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.320036:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639251200:12345-0@lo:400:kworker.0 Request processed in 59us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572514.320044:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4802 00000100:00100000:3.0:1788572514.320524:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639251200:0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.320598:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639251712 00000100:00100000:3.0:1788572514.320603:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639251712 00000100:00100000:3.0:1788572514.320661:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639252224 00000100:00100000:3.0:1788572514.320664:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639252224 00000100:00100000:3.0:1788572514.320685:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1788572514.320691:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639251712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.320748:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639251712:12345-0@lo:400:kworker.0 Request processed in 57us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572514.320755:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1788572514.320770:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:3.0:1788572514.320777:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639252224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.320819:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639252224:12345-0@lo:400:kworker.0 Request processed in 43us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572514.320826:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00080000:3.0:1788572514.320907:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572514.320934:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639251712:0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.320949:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639252224:0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.321570:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639251840:0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.321591:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639250944:0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.321609:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639251456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.321626:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639251968:0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.321666:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639252480:0@lo:400:kworker.0 00000100:00100000:1.0:1788572514.322137:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572514.322303:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639252352 00000100:00100000:0.0:1788572514.322310:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639252352 00000100:00100000:0.0:1788572514.322380:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:0.0:1788572514.322389:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639252352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.322472:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639252352:12345-0@lo:400:kworker.0 Request processed in 84us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572514.322480:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:1.0:1788572514.323913:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639252352:0@lo:400:kworker.0 00000100:00080000:3.0:1788572514.325523:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572514.325994:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572514.326147:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639251584:0@lo:400:kworker.0 00000100:00100000:2.0:1788572514.326216:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572514.326252:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639252096:0@lo:400:kworker.0 00000100:00100000:2.0:1788572514.326275:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572514.326341:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639251584 00000100:00100000:0.0:1788572514.326353:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639251584 00000100:00080000:1.0:1788572514.326623:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572514.327489:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4803 00000100:00100000:0.0:1788572514.327514:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639251584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572514.327616:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639251584:12345-0@lo:400:kworker.0 Request processed in 114us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572514.327624:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4803 00000100:00100000:2.0:1788572514.328404:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639251584:0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.328561:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639251072 00000100:00100000:3.0:1788572514.328571:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639251072 00000100:00100000:3.0:1788572514.328625:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639252096 00000100:00100000:3.0:1788572514.328628:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639252096 00000100:00100000:3.0:1788572514.328724:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:3.0:1788572514.328734:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639251072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.328825:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639251072:12345-0@lo:400:kworker.0 Request processed in 92us (2836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572514.330287:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00100000:3.0:1788572514.330342:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:3.0:1788572514.330366:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639252096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572514.330496:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639252096:12345-0@lo:400:kworker.0 Request processed in 144us (4219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572514.330504:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00000100:00100000:2.0:1788572514.331621:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639251072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572514.331641:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639252096:0@lo:400:kworker.0 00010000:00010000:1.0:1788572515.012972:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572515.331823:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639252608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572515.332236:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572515.338983:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639252608 00000100:00100000:0.0:1788572515.339031:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639252608 00000100:00100000:0.0:1788572515.339136:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2994 00000100:00100000:0.0:1788572515.339148:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639252608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572515.339209:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572515.339613:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639252608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 466us (7377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572515.339623:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2994 00000100:00100000:2.0:1788572515.341479:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639252608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572515.845631:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572515.845668:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63767e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639252736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572515.845779:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572515.845879:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639252736 00000100:00100000:1.0:1788572515.845891:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639252736 00000100:00100000:1.0:1788572515.845965:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995 00000100:00100000:1.0:1788572515.845976:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639252736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572515.846046:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572515.846111:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639252736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572515.846118:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995 00000100:00100000:0.0:1788572515.846536:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63767e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639252736:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572516.037282:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572516.356030:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572516.356068:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639252864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572516.356184:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572516.356366:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639252864 00000100:00100000:1.0:1788572516.356376:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639252864 00000100:00100000:1.0:1788572516.356462:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996 00000100:00100000:1.0:1788572516.356475:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639252864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572516.356520:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572516.356581:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639252864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572516.356588:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996 00000100:00080000:3.0:1788572516.356863:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572516.357088:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639252864:0@lo:13:osp-pre-1-1.0 00010000:00020000:2.0:1788572516.868417:0:9276:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 awake: rc=0 00010000:02000400:2.0:1788572516.878222:0:9276:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 35eb2d60-2de0-4b00-9815-d5153edd0057 (at 192.168.202.13@tcp) reconnecting 00010000:00080000:2.0:1788572516.889635:0:9276:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t219043334909 exp ffff94e633e09800 cur 4433 last 1788572511 00000004:00100000:2.0:1788572516.890615:0:9276:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.13@tcp supports cksum type f7, return f7 00000100:00080000:2.0:1788572516.890646:0:9276:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1788572516.890657:0:9276:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572516.893363:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616269952:12345-192.168.202.13@tcp:38:lctl.0 Request processed in 5465784us (5467279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572516.893379:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4795 00000100:00100000:1.0:1788572516.951437:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572516.951543:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616271104 00000100:00100000:3.0:1788572516.951552:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616271104 00000100:00100000:3.0:1788572516.951637:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15539 00000100:00100000:3.0:1788572516.951649:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91550:x1875449616271104:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:3.0:1788572516.951691:0:10390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:3.0:1788572516.951779:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91550:x1875449616271104:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 132us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572516.951787:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15539 00000100:00080000:1.0:1788572516.951970:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572516.961344:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572516.961718:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616271232 00000100:00100000:0.0:1788572516.961737:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616271232 00000100:00100000:0.0:1788572516.961991:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15540 00000100:00100000:0.0:1788572516.962044:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91550:x1875449616271232:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572516.962104:0:6551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572516.962225:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91550:x1875449616271232:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 222us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572516.962233:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15540 00000100:00080000:1.0:1788572516.965257:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572516.973151:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572516.973282:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616271360 00000100:00100000:1.0:1788572516.973297:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616271360 00000100:00100000:1.0:1788572516.973394:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2997 00000100:00100000:1.0:1788572516.973406:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91550:x1875449616271360:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572516.973445:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572516.973672:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91550:x1875449616271360:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 266us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572516.973680:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2997 00000100:00080000:3.0:1788572516.974166:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572516.977363:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572516.979599:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616271488 00000100:00100000:1.0:1788572516.979620:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616271488 00000100:00100000:1.0:1788572516.979730:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 2998 00000100:00100000:1.0:1788572516.979742:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91550:x1875449616271488:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572516.979782:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788572516.980222:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572516.990766:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91550:x1875449616271488:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 11007us (13398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572516.990906:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 2998 00010000:00010000:1.0:1788572517.059515:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572518.087753:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572518.326625:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572518.326688:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572518.326724:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572518.326749:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572518.326805:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572518.326850:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616271744 00000100:00100000:2.0:1788572518.326864:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616271744 00000100:00100000:2.0:1788572518.326946:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616271872 00000100:00100000:2.0:1788572518.326949:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616271872 00000100:00100000:2.0:1788572518.326979:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4804 00000100:00100000:2.0:1788572518.326992:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63767e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2385:x1875449616271744:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572518.327118:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63767e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2385:x1875449616271744:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 129us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572518.327126:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4804 00000100:00100000:2.0:1788572518.327154:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4805 00000100:00100000:2.0:1788572518.327160:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616271872:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572518.327198:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616271872:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 38us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572518.327205:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4805 00000100:00100000:2.0:1788572518.327233:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616272000 00000100:00100000:2.0:1788572518.327237:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616272000 00000100:00100000:2.0:1788572518.327271:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616272128 00000100:00100000:2.0:1788572518.327274:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616272128 00000100:00100000:2.0:1788572518.327296:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3861 00000100:00100000:2.0:1788572518.327302:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616272000:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572518.327331:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616272000:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 30us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572518.327338:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3861 00000100:00100000:2.0:1788572518.327350:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3862 00000100:00100000:2.0:1788572518.327356:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616272128:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572518.327382:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616272128:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572518.327400:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3862 00000100:00080000:2.0:1788572518.327423:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572518.327427:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572518.327430:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572518.327432:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572518.327556:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616271616 00000100:00100000:1.0:1788572518.327562:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616271616 00000100:00100000:1.0:1788572518.327613:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 99 00000100:00100000:1.0:1788572518.327621:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616271616:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572518.327664:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616271616:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 45us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572518.327671:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 99 00000100:00100000:3.0:1788572518.406040:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639252992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572518.406147:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572518.406305:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639252992 00000100:00100000:2.0:1788572518.406318:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639252992 00000100:00100000:2.0:1788572518.406386:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:2.0:1788572518.406398:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639252992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572518.406445:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572518.406509:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639252992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572518.406517:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00000100:00100000:2.0:1788572518.406579:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639252992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572518.916295:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572518.916326:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639253120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572518.916475:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572518.916564:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639253120 00000100:00100000:0.0:1788572518.916575:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639253120 00000100:00100000:0.0:1788572518.916639:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:0.0:1788572518.916649:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639253120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572518.916694:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572518.916747:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639253120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572518.916755:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:0.0:1788572518.916817:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639253120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572518.917661:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572518.917677:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639253248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572518.917733:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572518.917774:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639253248 00000100:00100000:3.0:1788572518.917780:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639253248 00000100:00100000:3.0:1788572518.917839:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:3.0:1788572518.917848:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639253248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572518.917879:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572518.917923:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639253248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572518.917931:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00080000:3.0:1788572518.917968:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572518.918023:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639253248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572519.111600:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572519.277429:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572519.277511:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616272256 00000100:00100000:0.0:1788572519.277527:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616272256 00000100:00100000:0.0:1788572519.277621:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4806 00000100:00100000:0.0:1788572519.277634:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616272256:12345-192.168.202.13@tcp:38:lctl.0 00010000:00020000:0.0:1788572519.277648:0:6551:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_race id 701 sleeping 00000100:00100000:1.0:1788572519.431429:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639253504:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.431531:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.431591:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639254016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.431622:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.431643:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639254528:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.431665:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.431696:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788572519.431703:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639253376:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.431739:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.431763:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639253888:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.431786:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.431805:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639254400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.431826:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.431844:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639254912:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.431865:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.431897:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639253632:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.431922:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.431942:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639254144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.431967:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.431996:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639254656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432039:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.432060:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572519.432066:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639253760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432103:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.432124:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639254272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432145:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.432155:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639254784:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432186:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572519.432226:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639253504 00000100:00100000:1.0:1788572519.432236:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639253504 00000100:00100000:1.0:1788572519.432291:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639254528 00000100:00100000:1.0:1788572519.432295:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639254528 00000100:00100000:1.0:1788572519.432318:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1788572519.432327:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639253504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432393:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639253504:12345-0@lo:400:kworker.0 Request processed in 66us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.432402:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1788572519.432426:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1788572519.432432:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639254528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432462:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639254528:12345-0@lo:400:kworker.0 Request processed in 30us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.432473:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1788572519.432494:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639254016 00000100:00100000:1.0:1788572519.432497:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639254016 00000100:00100000:1.0:1788572519.432532:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639253888 00000100:00100000:1.0:1788572519.432535:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639253888 00000100:00100000:1.0:1788572519.432546:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639254400 00000100:00100000:1.0:1788572519.432549:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639254400 00000100:00100000:1.0:1788572519.432563:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639254912 00000100:00100000:1.0:1788572519.432565:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639254912 00000100:00100000:1.0:1788572519.432576:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639253632 00000100:00100000:1.0:1788572519.432578:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639253632 00000100:00100000:1.0:1788572519.432589:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639254272 00000100:00100000:1.0:1788572519.432592:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639254272 00000100:00100000:1.0:1788572519.432607:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4807 00000100:00100000:1.0:1788572519.432613:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639254016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432645:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639254016:12345-0@lo:400:kworker.0 Request processed in 31us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.432651:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4807 00000100:00100000:1.0:1788572519.432664:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4808 00000100:00100000:1.0:1788572519.432670:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639253888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432697:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639253888:12345-0@lo:400:kworker.0 Request processed in 28us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.432703:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4808 00000100:00100000:1.0:1788572519.432714:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4809 00000100:00100000:1.0:1788572519.432720:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639254400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432746:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639254400:12345-0@lo:400:kworker.0 Request processed in 27us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.432752:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4809 00000100:00100000:1.0:1788572519.432766:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4810 00000100:00100000:1.0:1788572519.432772:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639254912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432799:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639254912:12345-0@lo:400:kworker.0 Request processed in 28us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.432805:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4810 00000100:00100000:1.0:1788572519.432816:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4811 00000100:00100000:1.0:1788572519.432822:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639253632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432853:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639253632:12345-0@lo:400:kworker.0 Request processed in 31us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.432860:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4811 00000100:00100000:1.0:1788572519.432871:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4812 00000100:00100000:1.0:1788572519.432878:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639254272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432902:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639254272:12345-0@lo:400:kworker.0 Request processed in 25us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.432907:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4812 00000100:00100000:1.0:1788572519.432932:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639253376 00000100:00100000:1.0:1788572519.432935:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639253376 00000100:00100000:1.0:1788572519.432961:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788572519.432968:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639253376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.432997:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639253376:12345-0@lo:400:kworker.0 Request processed in 29us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.433027:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788572519.433078:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639254144 00000100:00100000:1.0:1788572519.433082:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639254144 00000100:00100000:1.0:1788572519.433113:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639254656 00000100:00100000:1.0:1788572519.433116:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639254656 00000100:00100000:1.0:1788572519.433133:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639253760 00000100:00100000:1.0:1788572519.433136:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639253760 00000100:00100000:1.0:1788572519.433153:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639254784 00000100:00100000:1.0:1788572519.433156:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639254784 00000100:00100000:1.0:1788572519.433191:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:1.0:1788572519.433198:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639254144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433231:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639254144:12345-0@lo:400:kworker.0 Request processed in 34us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.433238:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00100000:1.0:1788572519.433249:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:1.0:1788572519.433255:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639254656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433281:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639254656:12345-0@lo:400:kworker.0 Request processed in 26us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.433287:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00100000:1.0:1788572519.433297:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:1.0:1788572519.433303:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639253760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433328:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639253760:12345-0@lo:400:kworker.0 Request processed in 25us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.433334:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:1.0:1788572519.433344:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:1.0:1788572519.433349:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639254784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433374:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639254784:12345-0@lo:400:kworker.0 Request processed in 25us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572519.433380:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00080000:1.0:1788572519.433415:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572519.433421:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572519.433424:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572519.433427:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572519.433478:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639253760:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433492:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639254272:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433502:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639254784:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433512:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639253632:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433522:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639254144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433532:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639254656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433600:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639253376:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433616:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639253888:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433628:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639254400:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433639:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639254912:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433650:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639253504:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433662:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639254016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572519.433674:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639254528:0@lo:400:kworker.0 00010000:00010000:1.0:1788572520.135323:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572520.453743:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639255040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572520.453841:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572520.453962:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639255040 00000100:00100000:0.0:1788572520.453974:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639255040 00000100:00100000:0.0:1788572520.454063:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000 00000100:00100000:0.0:1788572520.454074:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639255040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572520.454118:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572520.454211:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639255040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572520.454219:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000 00000100:00100000:1.0:1788572520.454316:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639255040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572520.964491:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572520.964530:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639255168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572520.964642:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572520.965271:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639255168 00000100:00100000:2.0:1788572520.965284:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639255168 00000100:00100000:2.0:1788572520.965423:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001 00000100:00100000:2.0:1788572520.965436:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639255168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572520.965481:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572520.965568:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639255168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572520.965577:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001 00000100:00100000:1.0:1788572520.965679:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639255168:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572521.156031:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572521.482563:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639255296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572521.482741:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572521.482889:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639255296 00000100:00100000:0.0:1788572521.482901:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639255296 00000100:00100000:0.0:1788572521.483030:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002 00000100:00100000:0.0:1788572521.483049:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639255296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572521.483204:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788572521.483288:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572521.488048:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639255296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4989us (5290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572521.488069:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002 00000100:00100000:3.0:1788572521.490685:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639255296:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572522.179609:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572523.203650:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572523.425614:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572523.425670:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572523.425713:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572523.425743:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616272768 00000100:00100000:3.0:1788572523.425760:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616272768 00000100:00100000:2.0:1788572523.425761:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572523.425864:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616272384 00000100:00100000:0.0:1788572523.425870:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616272384 00000100:00100000:0.0:1788572523.425934:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00100000:0.0:1788572523.425947:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616272384:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572523.426084:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616272384:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 137us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572523.426092:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 101 00000100:00100000:3.0:1788572523.426240:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616272640 00000100:00100000:3.0:1788572523.426245:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616272640 00000100:00100000:3.0:1788572523.426277:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3867 00000100:00100000:3.0:1788572523.426296:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616272768:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572523.426297:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3868 00000100:00100000:0.0:1788572523.426312:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616272640:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572523.426348:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616272768:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 62us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572523.426355:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3867 00000100:00100000:1.0:1788572523.427357:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616272512 00000100:00100000:1.0:1788572523.427373:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616272512 00000100:00100000:1.0:1788572523.427468:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4813 00000100:00100000:1.0:1788572523.427480:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616272512:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572523.427645:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616272640:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 1333us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572523.427655:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3868 00000100:00080000:0.0:1788572523.427686:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572523.427693:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572523.427697:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572523.438226:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616272512:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 10728us (12612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572523.438248:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4813 00000100:00100000:1.0:1788572523.523336:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572523.523372:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639255424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572523.523476:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572523.523825:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639255424 00000100:00100000:2.0:1788572523.523837:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639255424 00000100:00100000:2.0:1788572523.523905:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:2.0:1788572523.523918:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639255424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572523.523966:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572523.524064:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639255424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572523.524073:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:0.0:1788572523.524194:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639255424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572524.035598:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6349f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639255552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572524.035700:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572524.036085:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639255680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572524.036128:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572524.036348:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639255680 00000100:00100000:1.0:1788572524.036361:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639255680 00000100:00100000:1.0:1788572524.036454:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3003 00000100:00100000:1.0:1788572524.036466:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639255680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572524.036512:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572524.036569:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639255680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572524.036576:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3003 00000100:00080000:2.0:1788572524.036645:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572524.036692:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639255680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572524.036827:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639255552 00000100:00100000:0.0:1788572524.036834:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639255552 00000100:00100000:0.0:1788572524.036880:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873 00000100:00100000:0.0:1788572524.036887:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639255552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572524.036917:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572524.036972:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639255552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572524.036983:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873 00000100:00100000:2.0:1788572524.037086:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6349f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639255552:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788572524.227470:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572524.547526:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639255808:0@lo:400:kworker.0 00000100:00100000:0.0:1788572524.547669:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572524.547738:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639256320:0@lo:400:kworker.0 00000100:00100000:0.0:1788572524.547772:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572524.547793:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639256832:0@lo:400:kworker.0 00000100:00100000:0.0:1788572524.547821:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572524.547850:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788572524.547856:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639256192:0@lo:400:kworker.0 00000100:00100000:0.0:1788572524.547880:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572524.547896:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639256704:0@lo:400:kworker.0 00000100:00100000:0.0:1788572524.547918:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572524.548088:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639256064:0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.548129:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572524.548169:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639256576:0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.548194:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572524.548215:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639257088:0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.548237:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572524.548256:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788572524.548263:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639255936:0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.548286:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572524.548299:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639256448:0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.548321:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572524.548341:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639256960:0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.548367:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572524.548403:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639256832 00000100:00100000:2.0:1788572524.548413:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639256832 00000100:00100000:2.0:1788572524.548478:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:2.0:1788572524.548489:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639256832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.548558:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639256832:12345-0@lo:400:kworker.0 Request processed in 70us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.548566:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00000100:00100000:2.0:1788572524.548600:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639256320 00000100:00100000:2.0:1788572524.548605:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639256320 00000100:00100000:2.0:1788572524.548641:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639256192 00000100:00100000:2.0:1788572524.548644:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639256192 00000100:00100000:2.0:1788572524.548660:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639256704 00000100:00100000:2.0:1788572524.548663:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639256704 00000100:00100000:2.0:1788572524.548679:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639256576 00000100:00100000:2.0:1788572524.548682:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639256576 00000100:00100000:2.0:1788572524.548696:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639257088 00000100:00100000:2.0:1788572524.548713:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639257088 00000100:00100000:2.0:1788572524.548727:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639255936 00000100:00100000:2.0:1788572524.548730:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639255936 00000100:00100000:2.0:1788572524.548744:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4814 00000100:00100000:2.0:1788572524.548751:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639256320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.548785:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639256320:12345-0@lo:400:kworker.0 Request processed in 34us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.548792:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4814 00000100:00100000:2.0:1788572524.548806:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4815 00000100:00100000:2.0:1788572524.548812:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639256192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.548841:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639256192:12345-0@lo:400:kworker.0 Request processed in 29us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.548847:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4815 00000100:00100000:2.0:1788572524.548864:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4816 00000100:00100000:2.0:1788572524.548871:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639256704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.548899:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639256704:12345-0@lo:400:kworker.0 Request processed in 29us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.548904:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4816 00000100:00100000:2.0:1788572524.548917:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4817 00000100:00100000:2.0:1788572524.548922:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639256576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.548955:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639256576:12345-0@lo:400:kworker.0 Request processed in 33us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.548961:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4817 00000100:00100000:2.0:1788572524.548974:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4818 00000100:00100000:2.0:1788572524.548981:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639257088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.549053:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639257088:12345-0@lo:400:kworker.0 Request processed in 73us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.549061:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4818 00000100:00100000:2.0:1788572524.549074:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4819 00000100:00100000:2.0:1788572524.549080:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639255936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.549108:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639255936:12345-0@lo:400:kworker.0 Request processed in 29us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.549114:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4819 00000100:00100000:2.0:1788572524.549137:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639256064 00000100:00100000:2.0:1788572524.549153:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639256064 00000100:00100000:2.0:1788572524.549188:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639256448 00000100:00100000:2.0:1788572524.549192:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639256448 00000100:00100000:2.0:1788572524.549212:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639256960 00000100:00100000:2.0:1788572524.549215:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639256960 00000100:00100000:2.0:1788572524.549233:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:2.0:1788572524.549240:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639256064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.549278:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639256064:12345-0@lo:400:kworker.0 Request processed in 40us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.549284:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00100000:2.0:1788572524.549295:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1788572524.549300:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639256448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.549326:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639256448:12345-0@lo:400:kworker.0 Request processed in 26us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.549331:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1788572524.549342:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:2.0:1788572524.549348:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639256960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.549380:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639256960:12345-0@lo:400:kworker.0 Request processed in 32us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.549386:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00080000:2.0:1788572524.549414:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572524.549419:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572524.549422:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572524.549424:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572524.549481:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639255936:0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.549495:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639256448:0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.549506:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639256960:0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.549517:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639256064:0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.549527:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639256576:0@lo:400:kworker.0 00000100:00100000:2.0:1788572524.549537:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639257088:0@lo:400:kworker.0 00010000:00020000:3.0:1788572524.549888:0:6551:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 awake: rc=0 00000100:00100000:0.0:1788572524.550887:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639256192:0@lo:400:kworker.0 00000100:00100000:0.0:1788572524.550904:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639256704:0@lo:400:kworker.0 00000100:00100000:0.0:1788572524.550919:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639256320:0@lo:400:kworker.0 00000100:00100000:0.0:1788572524.550933:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639256832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572524.551752:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639255808 00000100:00100000:1.0:1788572524.551765:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639255808 00000100:00100000:1.0:1788572524.551853:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788572524.551865:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639255808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572524.551977:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639255808:12345-0@lo:400:kworker.0 Request processed in 114us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572524.551986:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788572524.552095:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639255808:0@lo:400:kworker.0 00010000:02000400:3.0:1788572524.565964:0:6551:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 35eb2d60-2de0-4b00-9815-d5153edd0057 (at 192.168.202.13@tcp) reconnecting 00010000:00080000:3.0:1788572524.565975:0:6551:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t219043334909 exp ffff94e633e09800 cur 4441 last 1788572519 00000004:00100000:3.0:1788572524.566059:0:6551:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.13@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1788572524.566101:0:6551:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1788572524.566114:0:6551:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572524.566233:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616272256:12345-192.168.202.13@tcp:38:lctl.0 Request processed in 5288599us (5288819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572524.566249:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4806 00000100:00100000:3.0:1788572524.632170:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572524.632319:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616272896 00000100:00100000:2.0:1788572524.632333:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616272896 00000100:00100000:2.0:1788572524.632455:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15541 00000100:00100000:2.0:1788572524.632469:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91571:x1875449616272896:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:2.0:1788572524.632518:0:9276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572524.632627:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91571:x1875449616272896:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 159us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572524.632637:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15541 00000100:00080000:0.0:1788572524.632801:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572524.635399:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572524.635568:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616273024 00000100:00100000:1.0:1788572524.635582:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616273024 00000100:00100000:1.0:1788572524.635665:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15542 00000100:00100000:1.0:1788572524.635678:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91571:x1875449616273024:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:1.0:1788572524.635731:0:6550:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572524.635835:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91571:x1875449616273024:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 158us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572524.635843:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15542 00000100:00100000:3.0:1788572524.638427:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572524.638588:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616273152 00000100:00100000:1.0:1788572524.638601:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616273152 00000100:00100000:1.0:1788572524.638671:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3004 00000100:00100000:1.0:1788572524.638683:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91571:x1875449616273152:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572524.638719:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572524.638827:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91571:x1875449616273152:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 145us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572524.638836:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3004 00000100:00100000:3.0:1788572524.642513:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572524.642855:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616273280 00000100:00100000:1.0:1788572524.642868:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616273280 00000100:00100000:1.0:1788572524.642941:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3005 00000100:00100000:1.0:1788572524.642952:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91571:x1875449616273280:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572524.642999:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572524.643153:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91571:x1875449616273280:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 202us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572524.643162:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3005 00010000:00010000:3.0:1788572525.252896:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572525.573919:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639257216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572525.574103:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572525.574318:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639257216 00000100:00100000:2.0:1788572525.574329:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639257216 00000100:00100000:2.0:1788572525.574404:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006 00000100:00100000:2.0:1788572525.574417:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639257216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572525.574449:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572525.574514:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639257216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572525.574523:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006 00000100:00100000:0.0:1788572525.575588:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639257216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572526.085914:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572526.086559:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639257344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572526.086647:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572526.086715:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639257344 00000100:00100000:0.0:1788572526.086731:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639257344 00000100:00080000:2.0:1788572526.086783:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572526.086887:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007 00000100:00100000:0.0:1788572526.086903:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639257344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572526.086944:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572526.087056:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639257344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572526.087064:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007 00000100:00100000:2.0:1788572526.087538:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639257344:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572526.292420:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572526.598998:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639257472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572526.599089:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572526.600090:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639257472 00000100:00100000:1.0:1788572526.600104:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639257472 00000100:00100000:1.0:1788572526.600187:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:1.0:1788572526.600199:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6349fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639257472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572526.600237:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572526.600312:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6349fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639257472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572526.600319:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000100:00080000:1.0:1788572526.600346:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572526.600397:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639257472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572526.696153:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572526.698537:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616273408 00000100:00100000:0.0:1788572526.698551:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616273408 00000100:00100000:0.0:1788572526.698628:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4820 00000100:00100000:0.0:1788572526.698640:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616273408:12345-192.168.202.13@tcp:38:lctl.0 00010000:00020000:0.0:1788572526.698651:0:6552:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_race id 701 sleeping 00000100:00080000:1.0:1788572526.706510:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572527.299363:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572528.323296:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572528.551121:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572528.551180:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572528.551215:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616273536 00000100:00100000:0.0:1788572528.551227:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616273536 00000100:00100000:0.0:1788572528.551299:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 103 00000100:00100000:0.0:1788572528.551311:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616273536:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572528.551396:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616273536:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 87us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.551404:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 103 00000100:00100000:1.0:1788572528.551707:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616273792 00000100:00100000:1.0:1788572528.551713:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616273792 00000100:00100000:1.0:1788572528.551776:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3872 00000100:00100000:1.0:1788572528.551784:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616273792:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572528.551822:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616273792:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 40us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572528.551828:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3872 00000100:00080000:0.0:1788572528.551901:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572528.551901:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572528.552720:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616273664 00000100:00100000:1.0:1788572528.552730:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616273664 00000100:00100000:2.0:1788572528.552776:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00080000:2.0:1788572528.552827:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572528.552851:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4821 00000100:00100000:1.0:1788572528.552862:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616273664:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572528.552898:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616273920 00000100:00100000:0.0:1788572528.552904:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616273920 00000100:00100000:0.0:1788572528.552950:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3873 00000100:00100000:0.0:1788572528.552958:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616273920:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572528.552968:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616273664:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 106us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.553027:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616273920:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 45us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572528.553035:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3873 00000100:00080000:3.0:1788572528.553109:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572528.559722:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4821 00000100:00100000:0.0:1788572528.643345:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639257600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572528.644022:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572528.644454:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639257600 00000100:00100000:1.0:1788572528.644464:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639257600 00000100:00100000:1.0:1788572528.644526:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875 00000100:00100000:1.0:1788572528.644537:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639257600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572528.644576:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572528.644641:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639257600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572528.644648:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875 00000100:00100000:2.0:1788572528.646573:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639257600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572529.155781:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e502d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639257728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572529.155856:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572529.155929:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572529.155937:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639257856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572529.156120:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639257728 00000100:00100000:0.0:1788572529.156143:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639257728 00000100:00100000:0.0:1788572529.156213:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:0.0:1788572529.156224:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639257728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572529.156259:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572529.156319:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639257728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.156327:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:2.0:1788572529.156645:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572529.156700:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e502d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639257728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572529.156879:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639257856 00000100:00100000:0.0:1788572529.156884:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639257856 00000100:00080000:3.0:1788572529.156989:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572529.157902:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009 00000100:00100000:0.0:1788572529.157918:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639257856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572529.157959:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572529.158048:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639257856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.158054:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009 00000100:00100000:2.0:1788572529.158147:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639257856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788572529.350538:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572529.569761:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572529.569807:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572529.569858:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572529.569877:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616274176 00000100:00100000:1.0:1788572529.569889:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616274176 00000100:00100000:3.0:1788572529.569889:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572529.569915:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616274048 00000100:00100000:3.0:1788572529.569918:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616274048 00000100:00100000:1.0:1788572529.569952:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4822 00000100:00100000:3.0:1788572529.569952:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 104 00000100:00100000:1.0:1788572529.569962:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616274176:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572529.569962:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e604f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616274048:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572529.570084:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616274176:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 123us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572529.570092:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4822 00000100:00100000:2.0:1788572529.570149:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616274432 00000100:00100000:2.0:1788572529.570153:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616274432 00000100:00100000:2.0:1788572529.570192:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616274304 00000100:00100000:2.0:1788572529.570196:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616274304 00000100:00100000:2.0:1788572529.570217:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3874 00000100:00100000:2.0:1788572529.570225:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616274432:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572529.570306:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3875 00000100:00100000:0.0:1788572529.570316:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616274304:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572529.571629:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e604f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616274048:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 1639us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572529.571650:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 104 00000100:00100000:2.0:1788572529.580495:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616274432:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 10257us (10673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.580514:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3874 00000100:00100000:0.0:1788572529.584272:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616274304:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 13938us (14361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.584391:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3875 00000100:00100000:3.0:1788572529.674683:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639258368:0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.674747:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639258112:0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.674764:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572529.674791:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572529.674810:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639258624:0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.674810:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639258880:0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.674831:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572529.674832:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572529.674856:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788572529.674861:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639259136:0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.674861:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639258240:0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.674880:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572529.674891:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639258368 00000100:00100000:3.0:1788572529.674898:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639258368 00000100:00100000:2.0:1788572529.674900:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788572529.674904:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639257984:0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.674949:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572529.674950:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639258112 00000100:00100000:3.0:1788572529.674953:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639258112 00000100:00100000:3.0:1788572529.674968:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639258880 00000100:00100000:3.0:1788572529.674970:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639258880 00000100:00100000:2.0:1788572529.674975:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639258496:0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.674987:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4823 00000100:00100000:2.0:1788572529.674994:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572529.674995:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639258368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.675022:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639259008:0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.675045:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572529.675062:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639258368:12345-0@lo:400:kworker.0 Request processed in 67us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572529.675070:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4823 00000100:00100000:2.0:1788572529.675073:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639258496 00000100:00100000:2.0:1788572529.675075:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639258496 00000100:00100000:3.0:1788572529.675086:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4824 00000100:00100000:3.0:1788572529.675092:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639258112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.675096:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4825 00000100:00100000:2.0:1788572529.675101:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639258880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.675137:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639258880:12345-0@lo:400:kworker.0 Request processed in 37us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572529.675137:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639258112:12345-0@lo:400:kworker.0 Request processed in 45us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572529.675144:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4824 00000100:00100000:0.0:1788572529.675207:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639257984 00000100:00100000:0.0:1788572529.675212:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639257984 00000100:00100000:0.0:1788572529.675245:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788572529.675258:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639257984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572529.675292:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639257984:12345-0@lo:400:kworker.0 Request processed in 35us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572529.675298:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788572529.683094:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4825 00000100:00100000:2.0:1788572529.683162:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4826 00000100:00100000:2.0:1788572529.683660:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639258496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.683933:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639258496:12345-0@lo:400:kworker.0 Request processed in 761us (8936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.683943:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4826 00000100:00100000:2.0:1788572529.683991:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639258624 00000100:00100000:2.0:1788572529.683998:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639258624 00000100:00100000:2.0:1788572529.684065:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639259136 00000100:00100000:2.0:1788572529.684068:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639259136 00000100:00100000:2.0:1788572529.684093:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:2.0:1788572529.684099:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639258624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.684146:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639258624:12345-0@lo:400:kworker.0 Request processed in 46us (9312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.684152:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:2.0:1788572529.684164:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1788572529.684170:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639259136:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788572529.684664:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572529.684670:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572529.684672:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572529.684795:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572529.684839:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639258752:0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.684877:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572529.684896:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639259264:0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.684917:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572529.684963:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639258368:0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.684977:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639258880:0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.684980:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639259136:12345-0@lo:400:kworker.0 Request processed in 811us (10098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.684987:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1788572529.685017:0:17011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639258240 00000100:00100000:2.0:1788572529.685021:0:17011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639258240 00000100:00100000:3.0:1788572529.685025:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639258752 00000100:00100000:3.0:1788572529.685027:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639258752 00000100:00100000:3.0:1788572529.685049:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639259264 00000100:00100000:3.0:1788572529.685051:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639259264 00000100:00100000:2.0:1788572529.685053:0:17011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:2.0:1788572529.685058:0:17011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639258240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.685063:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4827 00000100:00100000:3.0:1788572529.685068:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639258752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.685094:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639258752:12345-0@lo:400:kworker.0 Request processed in 26us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.685095:0:17011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639258240:12345-0@lo:400:kworker.0 Request processed in 36us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.685101:0:17011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:3.0:1788572529.685101:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4827 00000100:00100000:3.0:1788572529.685113:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4828 00000100:00100000:3.0:1788572529.685130:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639259264:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788572529.685136:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572529.685139:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572529.685159:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639257984:0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.685159:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639259264:12345-0@lo:400:kworker.0 Request processed in 41us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.685172:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639258496:0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.685194:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639258112:0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.685205:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639258624:0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.685216:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639259136:0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.685260:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639258240:0@lo:400:kworker.0 00000100:00100000:3.0:1788572529.685269:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4828 00000100:00100000:2.0:1788572529.685270:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639258752:0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.685278:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639259264:0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.685327:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639259008 00000100:00100000:2.0:1788572529.685331:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639259008 00000100:00100000:2.0:1788572529.685359:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:2.0:1788572529.685365:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639259008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572529.685413:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639259008:12345-0@lo:400:kworker.0 Request processed in 48us (10366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572529.685420:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:1.0:1788572529.685544:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639259008:0@lo:400:kworker.0 00010000:00010000:3.0:1788572530.373040:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572530.691420:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572530.691448:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639259392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572530.691522:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572530.691834:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639259392 00000100:00100000:1.0:1788572530.691843:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639259392 00000100:00100000:1.0:1788572530.691898:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010 00000100:00100000:1.0:1788572530.691909:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e502d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639259392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572530.691939:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572530.691992:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e502d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639259392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572530.692000:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010 00000100:00100000:2.0:1788572530.692380:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639259392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572531.207096:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e502d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639259520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572531.207207:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572531.207306:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639259520 00000100:00100000:0.0:1788572531.207314:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639259520 00000100:00100000:0.0:1788572531.207383:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3011 00000100:00100000:0.0:1788572531.207394:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639259520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572531.207425:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572531.207475:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639259520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572531.207483:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3011 00000100:00100000:0.0:1788572531.207530:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e502d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639259520:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788572531.207637:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572531.395318:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572531.715311:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639259648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572531.715393:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572531.715501:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639259648 00000100:00100000:1.0:1788572531.715513:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639259648 00000100:00100000:1.0:1788572531.715592:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012 00000100:00100000:1.0:1788572531.715603:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639259648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572531.715634:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572531.715686:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639259648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572531.715693:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012 00000100:00100000:1.0:1788572531.715746:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639259648:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788572531.715994:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00020000:1.0:1788572531.716236:0:6552:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 awake: rc=0 00010000:02000400:1.0:1788572531.725244:0:6552:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 35eb2d60-2de0-4b00-9815-d5153edd0057 (at 192.168.202.13@tcp) reconnecting 00010000:00080000:1.0:1788572531.748140:0:6552:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t219043334909 exp ffff94e633e09800 cur 4448 last 1788572526 00000004:00100000:0.0:1788572531.752226:0:6552:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.13@tcp supports cksum type f7, return f7 00000100:00080000:0.0:1788572531.752261:0:6552:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1788572531.752273:0:6552:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572531.752372:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616273408:12345-192.168.202.13@tcp:38:lctl.0 Request processed in 5053733us (5056236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572531.752387:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4820 00000100:00100000:3.0:1788572531.806058:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572531.806457:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616274560 00000100:00100000:2.0:1788572531.806469:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616274560 00000100:00100000:2.0:1788572531.806557:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15543 00000100:00100000:2.0:1788572531.806569:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91592:x1875449616274560:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:2.0:1788572531.806611:0:9276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572531.806706:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91592:x1875449616274560:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 139us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572531.806713:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15543 00000100:00080000:3.0:1788572531.807240:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572531.811575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572531.811706:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616274688 00000100:00100000:1.0:1788572531.811718:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616274688 00000100:00100000:1.0:1788572531.811803:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15544 00000100:00100000:1.0:1788572531.811815:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91592:x1875449616274688:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:1.0:1788572531.811864:0:10390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00080000:3.0:1788572531.812148:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572531.812803:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91592:x1875449616274688:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 986us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572531.812813:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15544 00000100:00100000:1.0:1788572531.826587:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572531.827403:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616274816 00000100:00100000:0.0:1788572531.827416:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616274816 00000100:00100000:0.0:1788572531.827505:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3013 00000100:00100000:0.0:1788572531.827518:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91592:x1875449616274816:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:0.0:1788572531.827551:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572531.827628:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91592:x1875449616274816:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 113us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572531.827636:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3013 00000100:00080000:3.0:1788572531.828132:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572531.835059:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572531.835197:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616274944 00000100:00100000:1.0:1788572531.835208:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616274944 00000100:00100000:1.0:1788572531.835289:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3014 00000100:00100000:1.0:1788572531.835299:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e502d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91592:x1875449616274944:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572531.835327:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572531.835412:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e502d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91592:x1875449616274944:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 113us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572531.835420:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3014 00000100:00080000:3.0:1788572531.835493:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572532.421940:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572533.447165:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572533.774333:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639259776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572533.774430:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572533.777075:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639259776 00000100:00100000:0.0:1788572533.777092:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639259776 00000100:00100000:0.0:1788572533.777189:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:0.0:1788572533.777201:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d80e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639259776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572533.777244:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572533.777326:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d80e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639259776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (2896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572533.777332:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000100:00100000:3.0:1788572533.777952:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639259776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572534.261931:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572534.264971:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616275072 00000100:00100000:1.0:1788572534.264989:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616275072 00000100:00100000:1.0:1788572534.265097:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4829 00000100:00100000:1.0:1788572534.265118:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616275072:12345-192.168.202.13@tcp:38:lctl.0 00010000:00020000:1.0:1788572534.265130:0:6550:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_race id 701 sleeping 00000100:00080000:0.0:1788572534.265429:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572534.275976:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fe47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639259904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572534.276058:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572534.276141:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639259904 00000100:00100000:2.0:1788572534.276149:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639259904 00000100:00100000:2.0:1788572534.276193:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879 00000100:00100000:2.0:1788572534.276203:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639259904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572534.276239:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572534.276288:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639259904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572534.276295:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000100:00100000:2.0:1788572534.276344:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fe47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639259904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572534.276558:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572534.276569:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639260032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572534.276602:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572534.279956:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639260032 00000100:00100000:0.0:1788572534.279970:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639260032 00000100:00100000:0.0:1788572534.280061:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015 00000100:00100000:0.0:1788572534.280071:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639260032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572534.280116:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572534.280178:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639260032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (3575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572534.280188:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015 00000100:00100000:0.0:1788572534.280242:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639260032:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788572534.280308:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572534.467229:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572534.691337:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572534.691382:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572534.691414:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572534.691457:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572534.691567:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616275456 00000100:00100000:2.0:1788572534.691579:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616275456 00000100:00100000:2.0:1788572534.691652:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616275584 00000100:00100000:2.0:1788572534.691656:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616275584 00000100:00100000:2.0:1788572534.691681:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3879 00000100:00100000:2.0:1788572534.691691:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616275456:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572534.691741:0:116815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616275200 00000100:00100000:3.0:1788572534.691747:0:116815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616275200 00000100:00100000:2.0:1788572534.691769:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616275456:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 77us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572534.691778:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3879 00000100:00100000:3.0:1788572534.691787:0:116815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 106 00000100:00100000:2.0:1788572534.691799:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3880 00000100:00100000:3.0:1788572534.691811:0:116815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616275200:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572534.691812:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616275584:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572534.691853:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616275584:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 46us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572534.691859:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3880 00000100:00080000:0.0:1788572534.692048:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572534.692053:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572534.692129:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616275328 00000100:00100000:1.0:1788572534.692135:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616275328 00000100:00100000:3.0:1788572534.692167:0:116815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616275200:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 358us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572534.692177:0:116815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 106 00000100:00100000:1.0:1788572534.692191:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4830 00000100:00100000:1.0:1788572534.692201:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616275328:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572534.692238:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616275328:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 38us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572534.692254:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4830 00000100:00080000:0.0:1788572534.692324:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572534.787268:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639260160:0@lo:400:kworker.0 00000100:00100000:0.0:1788572534.787371:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572534.787484:0:116821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639260160 00000100:00100000:1.0:1788572534.787494:0:116821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639260160 00000100:00100000:1.0:1788572534.787549:0:116821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788572534.787558:0:116821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639260160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.789751:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639260544:0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.789830:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572534.789909:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639260544 00000100:00100000:2.0:1788572534.789917:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639260544 00000100:00100000:2.0:1788572534.789980:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4831 00000100:00100000:2.0:1788572534.789988:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639260544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.790067:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639260544:12345-0@lo:400:kworker.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572534.790075:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4831 00000100:00100000:2.0:1788572534.790140:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639260544:0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.790180:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639260288:0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.790205:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572534.790225:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572534.790232:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639260416:0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.790258:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572534.790285:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639260288 00000100:00100000:2.0:1788572534.790288:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639260288 00000100:00100000:2.0:1788572534.790313:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4832 00000100:00100000:2.0:1788572534.790332:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639260288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.790439:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639260288:12345-0@lo:400:kworker.0 Request processed in 120us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572534.790446:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4832 00000100:00100000:2.0:1788572534.790473:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639260288:0@lo:400:kworker.0 00000100:00080000:2.0:1788572534.790507:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572534.790525:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639260416 00000100:00100000:2.0:1788572534.790529:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639260416 00000100:00100000:2.0:1788572534.790569:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:2.0:1788572534.790576:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639260416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.790611:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639260416:12345-0@lo:400:kworker.0 Request processed in 36us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572534.790617:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00080000:2.0:1788572534.790629:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572534.790646:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639260416:0@lo:400:kworker.0 00000100:00100000:1.0:1788572534.804996:0:116821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505643450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639260160:12345-0@lo:400:kworker.0 Request processed in 17426us (17612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572534.805027:0:116821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788572534.806388:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639260800:0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.806388:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639260928:0@lo:400:kworker.0 00000100:00100000:1.0:1788572534.806464:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572534.806465:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572534.806503:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639261312:0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.806510:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639261440:0@lo:400:kworker.0 00000100:00100000:1.0:1788572534.806533:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572534.806546:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572534.806592:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639260928 00000100:00100000:1.0:1788572534.806597:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639260800 00000100:00100000:2.0:1788572534.806600:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639260928 00000100:00100000:1.0:1788572534.806602:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639260800 00000100:00100000:3.0:1788572534.806657:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639261312 00000100:00100000:3.0:1788572534.806662:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639261312 00000100:00100000:1.0:1788572534.806678:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:1.0:1788572534.806688:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639260800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572534.806740:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639260800:12345-0@lo:400:kworker.0 Request processed in 53us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572534.806747:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:1.0:1788572534.806792:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639260800:0@lo:400:kworker.0 00000100:00100000:0.0:1788572534.809262:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639260160:0@lo:400:kworker.0 00000100:00100000:0.0:1788572534.809311:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639260672:0@lo:400:kworker.0 00000100:00100000:0.0:1788572534.809394:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572534.809438:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639261184:0@lo:400:kworker.0 00000100:00100000:0.0:1788572534.809465:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572534.809497:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639261184 00000100:00100000:0.0:1788572534.809503:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639261184 00000100:00100000:0.0:1788572534.809554:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880 00000100:00100000:0.0:1788572534.809562:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639261184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572534.809615:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639261184:12345-0@lo:400:kworker.0 Request processed in 53us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572534.809622:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880 00000100:00100000:0.0:1788572534.809657:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639261184:0@lo:400:kworker.0 00000100:00100000:0.0:1788572534.809672:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572534.809678:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639261056:0@lo:400:kworker.0 00000100:00100000:0.0:1788572534.809702:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572534.809767:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639261440 00000100:00100000:0.0:1788572534.809771:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639261440 00000100:00100000:0.0:1788572534.809796:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639260672 00000100:00100000:0.0:1788572534.809799:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639260672 00000100:00100000:2.0:1788572534.810988:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639261056 00000100:00100000:2.0:1788572534.810999:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639261056 00000100:00100000:2.0:1788572534.811049:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4833 00000100:00100000:2.0:1788572534.811057:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639261440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.811149:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639261440:12345-0@lo:400:kworker.0 Request processed in 92us (4602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572534.811155:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4833 00000100:00100000:2.0:1788572534.811171:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4834 00000100:00100000:2.0:1788572534.811177:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639261056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.811215:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639261056:12345-0@lo:400:kworker.0 Request processed in 38us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572534.811221:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4834 00000100:00100000:2.0:1788572534.811263:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639261440:0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.811303:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4835 00000100:00100000:2.0:1788572534.811309:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639260928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572534.811342:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639260928:12345-0@lo:400:kworker.0 Request processed in 33us (4882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572534.811361:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4835 00000100:00100000:2.0:1788572534.811386:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639260928:0@lo:400:kworker.0 00000100:00100000:3.0:1788572534.816576:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:3.0:1788572534.816593:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639261312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572534.816733:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639261312:12345-0@lo:400:kworker.0 Request processed in 145us (10200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572534.816741:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00080000:1.0:1788572534.818474:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572534.818541:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639261312:0@lo:400:kworker.0 00000100:00080000:1.0:1788572534.818583:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572534.818588:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572534.818633:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4836 00000100:00100000:0.0:1788572534.818645:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639260672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572534.818721:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639260672:12345-0@lo:400:kworker.0 Request processed in 79us (9327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572534.818727:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4836 00000100:00100000:1.0:1788572534.818749:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639261056:0@lo:400:kworker.0 00000100:00100000:1.0:1788572534.818766:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639260672:0@lo:400:kworker.0 00010000:00010000:3.0:1788572535.491253:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572535.811391:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639261568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572535.811468:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572535.811643:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639261568 00000100:00100000:2.0:1788572535.811652:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639261568 00000100:00100000:2.0:1788572535.811719:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016 00000100:00100000:2.0:1788572535.811740:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639261568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572535.811772:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572535.811831:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639261568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572535.811842:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016 00000100:00100000:1.0:1788572535.811944:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639261568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572536.323415:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639261696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572536.323509:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572536.323670:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639261696 00000100:00100000:0.0:1788572536.323679:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639261696 00000100:00100000:0.0:1788572536.323754:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:0.0:1788572536.323764:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639261696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572536.323794:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572536.323843:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639261696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572536.323850:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000100:00080000:1.0:1788572536.323911:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572536.323949:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639261696:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572536.515258:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572536.735965:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572536.736056:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572536.736107:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572536.736143:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572536.736174:0:43972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616276096 00000100:00100000:0.0:1788572536.736185:0:43972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616276096 00000100:00100000:1.0:1788572536.736235:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616275968 00000100:00100000:1.0:1788572536.736239:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616275968 00000100:00100000:0.0:1788572536.736256:0:43972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3884 00000100:00100000:0.0:1788572536.736271:0:43972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616276096:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572536.736302:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616275840 00000100:00100000:2.0:1788572536.736305:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616275840 00000100:00100000:0.0:1788572536.736347:0:43972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616276096:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572536.736356:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4837 00000100:00100000:2.0:1788572536.736364:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616275840:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572536.736396:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616275840:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 33us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572536.736402:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4837 00000100:00100000:3.0:1788572536.736407:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616275712 00000100:00100000:3.0:1788572536.736412:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616275712 00000100:00100000:3.0:1788572536.736440:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 108 00000100:00100000:3.0:1788572536.736446:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616275712:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572536.736472:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616275712:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572536.736479:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 108 00000100:00100000:1.0:1788572536.741199:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3885 00000100:00100000:1.0:1788572536.741225:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616275968:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572536.742001:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616275968:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 785us (5852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572536.742038:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3885 00000100:00080000:1.0:1788572536.742074:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572536.742081:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572536.742575:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572536.742711:0:43972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3884 00000100:00100000:3.0:1788572536.838492:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572536.838518:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639261824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572536.838602:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572536.838736:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639261824 00000100:00100000:1.0:1788572536.838745:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639261824 00000100:00080000:2.0:1788572536.838796:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572536.838827:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018 00000100:00100000:1.0:1788572536.838990:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639261824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572536.839033:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572536.839102:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639261824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572536.839109:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018 00000100:00100000:3.0:1788572536.839241:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639261824:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572537.539360:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572538.565728:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572538.883369:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639261952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572538.883446:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572538.884362:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639261952 00000100:00100000:1.0:1788572538.884373:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639261952 00000100:00100000:1.0:1788572538.884428:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:1.0:1788572538.884437:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639261952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572538.884472:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572538.884534:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639261952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572538.884541:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00000100:00100000:3.0:1788572538.884688:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639261952:0@lo:41:osp-pre-1-0.0 00010000:00020000:1.0:1788572539.395193:0:6550:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 awake: rc=0 00010000:02000400:1.0:1788572539.395245:0:6550:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 35eb2d60-2de0-4b00-9815-d5153edd0057 (at 192.168.202.13@tcp) reconnecting 00010000:00080000:1.0:1788572539.395250:0:6550:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t219043334909 exp ffff94e633e09800 cur 4456 last 1788572534 00000004:00100000:1.0:1788572539.395284:0:6550:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.13@tcp supports cksum type f7, return f7 00000100:00080000:1.0:1788572539.395309:0:6550:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to RECOVER 00000100:00080000:1.0:1788572539.395318:0:6550:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788572539.395403:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fe47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616275072:12345-192.168.202.13@tcp:38:lctl.0 Request processed in 5130286us (5133481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572539.395414:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4829 00000100:00100000:3.0:1788572539.395646:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572539.396632:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639262208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572539.396700:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572539.396763:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639262080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572539.396791:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572539.396920:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639262208 00000100:00100000:2.0:1788572539.396929:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639262208 00000100:00100000:2.0:1788572539.396992:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019 00000100:00100000:2.0:1788572539.397002:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639262208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572539.397054:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572539.397111:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639262208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572539.397118:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019 00000100:00080000:3.0:1788572539.397347:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572539.397387:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639262208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572539.399353:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639262080 00000100:00100000:0.0:1788572539.399436:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639262080 00000100:00100000:0.0:1788572539.399509:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:0.0:1788572539.399519:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639262080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572539.399556:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572539.399649:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639262080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572539.399712:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:1.0:1788572539.399822:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639262080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572539.430154:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572539.430473:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616276224 00000100:00100000:2.0:1788572539.430484:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616276224 00000100:00100000:2.0:1788572539.431357:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15545 00000100:00100000:2.0:1788572539.431371:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91613:x1875449616276224:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:2.0:1788572539.431406:0:6552:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572539.431501:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91613:x1875449616276224:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 134us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572539.431510:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15545 00000100:00080000:3.0:1788572539.433308:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572539.436294:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572539.436411:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616276352 00000100:00100000:2.0:1788572539.436423:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616276352 00000100:00100000:2.0:1788572539.436577:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15546 00000100:00100000:2.0:1788572539.436588:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91613:x1875449616276352:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:2.0:1788572539.436633:0:10390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572539.436723:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91613:x1875449616276352:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 135us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572539.436729:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15546 00000100:00080000:3.0:1788572539.437380:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572539.442277:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572539.443211:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616276480 00000100:00100000:0.0:1788572539.443222:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616276480 00000100:00100000:0.0:1788572539.443300:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3020 00000100:00100000:0.0:1788572539.443311:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91613:x1875449616276480:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:0.0:1788572539.443405:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572539.443490:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91613:x1875449616276480:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 181us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572539.443498:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3020 00000100:00080000:3.0:1788572539.443554:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572539.446866:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572539.448068:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616276608 00000100:00100000:2.0:1788572539.448091:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616276608 00000100:00100000:2.0:1788572539.448220:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3021 00000100:00100000:2.0:1788572539.448233:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91613:x1875449616276608:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:2.0:1788572539.448269:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572539.448355:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91613:x1875449616276608:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 125us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572539.448362:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3021 00000100:00080000:3.0:1788572539.449552:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572539.588506:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572539.907471:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639262592:0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.907546:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572539.907585:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639263104:0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.907613:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572539.907630:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639263616:0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.907649:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572539.907674:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788572539.907681:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639262720:0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.907703:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572539.907723:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639263232:0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.907744:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572539.907784:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639262592 00000100:00100000:3.0:1788572539.907796:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639262592 00000100:00100000:3.0:1788572539.907873:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1788572539.907884:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639262592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.907941:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639262592:12345-0@lo:400:kworker.0 Request processed in 58us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572539.907949:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1788572539.907972:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639263104 00000100:00100000:3.0:1788572539.907975:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639263104 00000100:00100000:3.0:1788572539.908022:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639263616 00000100:00100000:3.0:1788572539.908025:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639263616 00000100:00100000:3.0:1788572539.908044:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639262720 00000100:00100000:3.0:1788572539.908047:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639262720 00000100:00100000:3.0:1788572539.908059:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639263232 00000100:00100000:3.0:1788572539.908061:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639263232 00000100:00100000:3.0:1788572539.908077:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4838 00000100:00100000:3.0:1788572539.908095:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639263104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.908127:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639263104:12345-0@lo:400:kworker.0 Request processed in 34us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572539.908137:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4838 00000100:00100000:3.0:1788572539.908150:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4839 00000100:00100000:3.0:1788572539.908156:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639263616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.908182:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639263616:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572539.908188:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4839 00000100:00100000:3.0:1788572539.908199:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4840 00000100:00100000:3.0:1788572539.908205:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639262720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.908232:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639262720:12345-0@lo:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572539.908237:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4840 00000100:00100000:3.0:1788572539.908247:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4841 00000100:00100000:3.0:1788572539.908253:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639263232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.908281:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639263232:12345-0@lo:400:kworker.0 Request processed in 28us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572539.908287:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4841 00000100:00080000:3.0:1788572539.908311:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572539.908315:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572539.908317:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572539.908351:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639262720:0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.908363:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639263232:0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.908373:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639262592:0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.908381:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639263104:0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.908391:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639263616:0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.908503:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639262464:0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.908542:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572539.908572:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639262976:0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.908596:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572539.908617:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639263488:0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.908638:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572539.908657:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788572539.908663:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639262336:0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.908689:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572539.908716:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639262848:0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.908737:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572539.908751:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639263360:0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.908774:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572539.908804:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639262976 00000100:00100000:0.0:1788572539.908808:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639262976 00000100:00100000:0.0:1788572539.908842:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639263488 00000100:00100000:0.0:1788572539.908845:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639263488 00000100:00100000:0.0:1788572539.908864:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:0.0:1788572539.908870:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639262976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.908908:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639262976:12345-0@lo:400:kworker.0 Request processed in 39us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572539.908915:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00100000:0.0:1788572539.908928:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:0.0:1788572539.908934:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639263488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.908961:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639263488:12345-0@lo:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572539.908967:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:0.0:1788572539.908984:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639262336 00000100:00100000:0.0:1788572539.908988:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639262336 00000100:00100000:0.0:1788572539.909054:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788572539.909061:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639262336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.909102:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639262336:12345-0@lo:400:kworker.0 Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572539.909108:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788572539.909140:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639263360 00000100:00100000:0.0:1788572539.909144:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639263360 00000100:00100000:0.0:1788572539.909170:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:0.0:1788572539.909175:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639263360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.909206:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639263360:12345-0@lo:400:kworker.0 Request processed in 31us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572539.909213:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00100000:0.0:1788572539.909269:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639262336:0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.909281:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639263360:0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.909292:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639262976:0@lo:400:kworker.0 00000100:00100000:0.0:1788572539.909301:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639263488:0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.912431:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639262464 00000100:00100000:3.0:1788572539.912447:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639262464 00000100:00100000:3.0:1788572539.912507:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639262848 00000100:00100000:3.0:1788572539.912511:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639262848 00000100:00100000:3.0:1788572539.912548:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4842 00000100:00100000:3.0:1788572539.912558:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639262464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.912665:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639262464:12345-0@lo:400:kworker.0 Request processed in 108us (4121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572539.912673:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4842 00000100:00100000:3.0:1788572539.912691:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4843 00000100:00100000:3.0:1788572539.912698:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639262848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.912729:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639262848:12345-0@lo:400:kworker.0 Request processed in 33us (3991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572539.912735:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4843 00000100:00080000:3.0:1788572539.912754:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572539.912759:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572539.912794:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639262848:0@lo:400:kworker.0 00000100:00100000:3.0:1788572539.912809:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639262464:0@lo:400:kworker.0 00010000:00010000:2.0:1788572540.612416:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572540.931376:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639263744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572540.931461:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572540.931544:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639263744 00000100:00100000:1.0:1788572540.931555:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639263744 00000100:00100000:1.0:1788572540.931634:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3022 00000100:00100000:1.0:1788572540.931646:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639263744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572540.931682:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572540.932577:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639263744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 919us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572540.932588:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3022 00000100:00100000:2.0:1788572540.932805:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e618491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639263744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572541.443242:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572541.443266:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639263872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572541.443352:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572541.443403:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639263872 00000100:00100000:1.0:1788572541.443410:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639263872 00000100:00100000:1.0:1788572541.443467:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3023 00000100:00100000:1.0:1788572541.443477:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639263872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572541.443508:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572541.443556:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639263872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572541.443563:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3023 00000100:00080000:1.0:1788572541.444065:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572541.444117:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639263872:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788572541.639308:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572541.645148:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572541.645830:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616276736 00000100:00100000:1.0:1788572541.645843:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616276736 00000100:00080000:0.0:1788572541.645998:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572541.646001:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4844 00000100:00100000:1.0:1788572541.649154:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616276736:12345-192.168.202.13@tcp:38:lctl.0 00010000:00020000:1.0:1788572541.649170:0:9276:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_race id 701 sleeping 00000100:00100000:1.0:1788572541.855863:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572541.855906:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572541.855945:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572541.855985:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572541.856085:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616277248 00000100:00100000:1.0:1788572541.856101:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616277248 00000100:00100000:2.0:1788572541.856137:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616277120 00000100:00100000:2.0:1788572541.856157:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616277120 00000100:00100000:1.0:1788572541.856206:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3889 00000100:00100000:1.0:1788572541.856222:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616277248:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572541.856255:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3890 00000100:00100000:2.0:1788572541.856271:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616277120:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572541.856348:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616277248:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 128us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572541.856364:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3889 00000100:00100000:2.0:1788572541.856375:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616277120:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 97us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572541.856388:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3890 00000100:00080000:1.0:1788572541.856412:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572541.856419:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572541.857125:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616276992 00000100:00100000:3.0:1788572541.857138:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616276992 00000100:00100000:3.0:1788572541.857216:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4845 00000100:00100000:3.0:1788572541.857228:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616276992:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572541.857293:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616276992:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 69us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572541.857301:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4845 00000100:00080000:1.0:1788572541.857827:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572541.857994:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616276864 00000100:00100000:0.0:1788572541.858059:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616276864 00000100:00100000:0.0:1788572541.858137:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 110 00000100:00100000:0.0:1788572541.858146:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616276864:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572541.858207:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616276864:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 63us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572541.858214:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 110 00000100:00100000:2.0:1788572541.959256:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639264000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572541.959336:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572541.959428:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639264000 00000100:00100000:0.0:1788572541.959436:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639264000 00000100:00100000:0.0:1788572541.959519:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3024 00000100:00100000:0.0:1788572541.959528:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639264000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572541.959557:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788572541.959640:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572541.963228:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639264000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3621us (3813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572541.963246:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3024 00000100:00100000:2.0:1788572541.963404:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639264000:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572542.659291:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788572543.688611:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572544.003425:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639264128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572544.003510:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572544.003842:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639264128 00000100:00100000:0.0:1788572544.003851:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639264128 00000100:00100000:0.0:1788572544.003907:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884 00000100:00100000:0.0:1788572544.003917:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639264128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572544.003968:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572544.004056:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639264128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572544.004074:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884 00000100:00100000:2.0:1788572544.004289:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639264128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572544.517084:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572544.517109:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639264256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572544.517173:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572544.517274:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639264256 00000100:00100000:0.0:1788572544.517282:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639264256 00000100:00100000:0.0:1788572544.517407:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:0.0:1788572544.517418:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639264256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572544.517455:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572544.517508:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639264256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572544.517513:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00000100:00100000:2.0:1788572544.517658:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639264384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572544.517686:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572544.517775:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639264256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572544.517865:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639264384 00000100:00100000:0.0:1788572544.517869:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639264384 00000100:00100000:0.0:1788572544.517909:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3025 00000100:00100000:0.0:1788572544.517916:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639264384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572544.517935:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572544.517970:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639264384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572544.517976:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3025 00000100:00100000:2.0:1788572544.518057:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62dac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639264384:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788572544.518134:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788572544.707382:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572544.866442:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572544.866552:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572544.866594:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572544.866630:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572544.866671:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616277760 00000100:00100000:1.0:1788572544.866682:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616277760 00000100:00100000:1.0:1788572544.866740:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616277632 00000100:00100000:1.0:1788572544.866743:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616277632 00000100:00100000:1.0:1788572544.866778:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3891 00000100:00100000:1.0:1788572544.866790:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616277760:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572544.866864:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616277760:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 76us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572544.866872:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3891 00000100:00100000:1.0:1788572544.866892:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3892 00000100:00100000:1.0:1788572544.866899:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616277632:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572544.866924:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616277632:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572544.866931:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3892 00000100:00100000:3.0:1788572544.867616:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616277376 00000100:00100000:3.0:1788572544.867622:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616277376 00000100:00100000:3.0:1788572544.867662:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 111 00000100:00100000:3.0:1788572544.867670:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616277376:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572544.867703:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616277376:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 35us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572544.867709:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 111 00000100:00080000:3.0:1788572544.867860:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572544.867865:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572544.868388:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616277504 00000100:00100000:2.0:1788572544.868394:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616277504 00000100:00100000:2.0:1788572544.868490:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4846 00000100:00100000:2.0:1788572544.868499:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616277504:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572544.868550:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62dac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616277504:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 53us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572544.868556:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4846 00000100:00080000:3.0:1788572544.869615:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572545.030105:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639264768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572545.030174:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572545.030207:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639265280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572545.030231:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572545.030246:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639265792:0@lo:400:kworker.0 00000100:00100000:0.0:1788572545.030266:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572545.030290:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572545.030294:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639264640:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.030414:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639264896:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.030446:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572545.030466:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639265408:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.030487:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572545.030501:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639265920:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.030521:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572545.030539:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788572545.030543:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6377c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639264512:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.030570:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572545.030595:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639265024:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.030619:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572545.030635:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e62d950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639265536:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.030667:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572545.030683:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639266048:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.030706:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572545.030736:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639265280 00000100:00100000:1.0:1788572545.030746:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639265280 00000100:00100000:1.0:1788572545.030798:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639265792 00000100:00100000:1.0:1788572545.030801:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639265792 00000100:00100000:1.0:1788572545.030814:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639264896 00000100:00100000:1.0:1788572545.030817:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639264896 00000100:00100000:1.0:1788572545.030835:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639265920 00000100:00100000:1.0:1788572545.030837:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639265920 00000100:00100000:1.0:1788572545.030857:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:1.0:1788572545.030865:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639265280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.030910:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639265280:12345-0@lo:400:kworker.0 Request processed in 46us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572545.030917:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:1.0:1788572545.030935:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:1.0:1788572545.030941:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639265792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.030967:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639265792:12345-0@lo:400:kworker.0 Request processed in 26us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572545.030972:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:1.0:1788572545.030982:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:1.0:1788572545.030987:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639264896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031045:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639264896:12345-0@lo:400:kworker.0 Request processed in 58us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572545.031051:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:1.0:1788572545.031074:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:1.0:1788572545.031080:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639265920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031107:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639265920:12345-0@lo:400:kworker.0 Request processed in 28us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572545.031113:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000100:00100000:1.0:1788572545.031155:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639264896:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031165:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639265920:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031216:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639264768 00000100:00100000:1.0:1788572545.031220:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639264768 00000100:00100000:1.0:1788572545.031238:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639265408 00000100:00100000:1.0:1788572545.031241:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639265408 00000100:00100000:1.0:1788572545.031251:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639265024 00000100:00100000:1.0:1788572545.031253:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639265024 00000100:00100000:1.0:1788572545.031261:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639265536 00000100:00100000:1.0:1788572545.031264:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639265536 00000100:00100000:1.0:1788572545.031274:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639266048 00000100:00100000:1.0:1788572545.031276:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639266048 00000100:00100000:1.0:1788572545.031286:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4847 00000100:00100000:1.0:1788572545.031292:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639264768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031334:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639264768:12345-0@lo:400:kworker.0 Request processed in 42us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572545.031341:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4847 00000100:00100000:1.0:1788572545.031352:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4848 00000100:00100000:1.0:1788572545.031357:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639265408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031385:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639265408:12345-0@lo:400:kworker.0 Request processed in 27us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572545.031390:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4848 00000100:00100000:1.0:1788572545.031401:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4849 00000100:00100000:1.0:1788572545.031406:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639265024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031432:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639265024:12345-0@lo:400:kworker.0 Request processed in 25us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572545.031437:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4849 00000100:00100000:1.0:1788572545.031447:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4850 00000100:00100000:1.0:1788572545.031452:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639265536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031479:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639265536:12345-0@lo:400:kworker.0 Request processed in 26us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572545.031485:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4850 00000100:00100000:1.0:1788572545.031497:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4851 00000100:00100000:1.0:1788572545.031502:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639266048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031527:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639266048:12345-0@lo:400:kworker.0 Request processed in 25us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572545.031532:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4851 00000100:00100000:1.0:1788572545.031557:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639265024:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031567:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e62d950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639265536:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031576:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639266048:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031586:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639265408:0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031620:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639264512 00000100:00100000:1.0:1788572545.031623:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639264512 00000100:00100000:1.0:1788572545.031645:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788572545.031651:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639264512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572545.031682:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639264512:12345-0@lo:400:kworker.0 Request processed in 31us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572545.031687:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788572545.031717:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6377c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639264512:0@lo:400:kworker.0 00000100:00100000:0.0:1788572545.032097:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572545.032121:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63ae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639265152:0@lo:400:kworker.0 00000100:00100000:0.0:1788572545.032145:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572545.032169:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639265664:0@lo:400:kworker.0 00000100:00100000:0.0:1788572545.032190:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572545.032215:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639264768:0@lo:400:kworker.0 00000100:00100000:0.0:1788572545.032227:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6131cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639265280:0@lo:400:kworker.0 00000100:00100000:0.0:1788572545.032237:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639265792:0@lo:400:kworker.0 00000100:00100000:2.0:1788572545.032450:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639265152 00000100:00100000:2.0:1788572545.032455:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639265152 00000100:00100000:2.0:1788572545.032497:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4852 00000100:00100000:2.0:1788572545.032505:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639265152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572545.032546:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639265152:12345-0@lo:400:kworker.0 Request processed in 43us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572545.032552:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4852 00000100:00100000:3.0:1788572545.032800:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639264640 00000100:00100000:3.0:1788572545.032805:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639264640 00000100:00100000:3.0:1788572545.032840:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639265664 00000100:00100000:3.0:1788572545.032843:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639265664 00000100:00100000:3.0:1788572545.032864:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:3.0:1788572545.032871:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639264640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572545.032909:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639264640:12345-0@lo:400:kworker.0 Request processed in 39us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572545.032915:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000100:00100000:3.0:1788572545.032926:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:3.0:1788572545.032931:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639265664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572545.032957:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639265664:12345-0@lo:400:kworker.0 Request processed in 26us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572545.032962:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00000100:00080000:3.0:1788572545.032981:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572545.032985:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572545.032988:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572545.032990:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572545.033484:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63aeb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639264640:0@lo:400:kworker.0 00000100:00100000:0.0:1788572545.033496:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63ae68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639265152:0@lo:400:kworker.0 00000100:00100000:0.0:1788572545.033508:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639265664:0@lo:400:kworker.0 00010000:00010000:2.0:1788572545.731359:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572546.051496:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572546.051522:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639266176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572546.051607:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572546.051812:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639266176 00000100:00100000:1.0:1788572546.051821:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639266176 00000100:00100000:1.0:1788572546.051878:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026 00000100:00100000:1.0:1788572546.051888:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639266176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572546.051919:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572546.051994:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639266176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572546.052001:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026 00000100:00100000:2.0:1788572546.052477:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639266176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572546.563288:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639266304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572546.563378:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572546.563558:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639266304 00000100:00100000:0.0:1788572546.563567:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639266304 00000100:00100000:0.0:1788572546.563624:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3027 00000100:00100000:0.0:1788572546.563634:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639266304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788572546.563665:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572546.563724:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639266304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572546.563731:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3027 00000100:00100000:1.0:1788572546.563986:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639266304:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788572546.756314:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00020000:3.0:1788572547.076127:0:9276:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 awake: rc=0 00000100:00100000:0.0:1788572547.076514:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572547.076538:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6375a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639266432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788572547.076626:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572547.076857:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639266432 00000100:00100000:1.0:1788572547.076866:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639266432 00000100:00100000:1.0:1788572547.076933:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028 00000100:00100000:1.0:1788572547.076944:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639266432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572547.076966:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572547.077029:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639266432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572547.077037:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028 00000100:00080000:2.0:1788572547.077105:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572547.077174:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6375a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639266432:0@lo:13:osp-pre-1-1.0 00010000:02000400:3.0:1788572547.116029:0:9276:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 35eb2d60-2de0-4b00-9815-d5153edd0057 (at 192.168.202.13@tcp) reconnecting 00010000:00080000:3.0:1788572547.116039:0:9276:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t219043334909 exp ffff94e633e09800 cur 4464 last 1788572541 00000004:00100000:3.0:1788572547.116094:0:9276:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.13@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1788572547.116118:0:9276:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1788572547.116511:0:9276:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788572547.116638:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e618491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616276736:12345-192.168.202.13@tcp:38:lctl.0 Request processed in 5470560us (5471485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572547.116651:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4844 00000100:00100000:3.0:1788572547.185543:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572547.186166:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616277888 00000100:00100000:2.0:1788572547.186177:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616277888 00000100:00100000:2.0:1788572547.186260:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15547 00000100:00100000:2.0:1788572547.186271:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91634:x1875449616277888:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:2.0:1788572547.186324:0:6550:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572547.186591:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91634:x1875449616277888:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 320us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572547.186599:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15547 00000100:00080000:3.0:1788572547.186726:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572547.205690:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572547.205852:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616278016 00000100:00100000:2.0:1788572547.205873:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616278016 00000100:00100000:2.0:1788572547.206101:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15548 00000100:00100000:2.0:1788572547.206113:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91634:x1875449616278016:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:2.0:1788572547.206154:0:10390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572547.206233:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91634:x1875449616278016:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 123us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572547.206242:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15548 00000100:00080000:3.0:1788572547.206506:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572547.216855:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572547.221154:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616278144 00000100:00100000:0.0:1788572547.221173:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616278144 00000100:00100000:1.0:1788572547.221524:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3029 00000100:00100000:1.0:1788572547.221539:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6375a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91634:x1875449616278144:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572547.221567:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572547.221648:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6375a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91634:x1875449616278144:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 113us (4802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572547.221655:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3029 00000100:00080000:2.0:1788572547.223500:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572547.230754:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572547.239603:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616278272 00000100:00100000:2.0:1788572547.239617:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616278272 00000100:00100000:2.0:1788572547.239755:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3030 00000100:00100000:2.0:1788572547.239766:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6377c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91634:x1875449616278272:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:2.0:1788572547.239793:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572547.239872:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6377c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91634:x1875449616278272:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 106us (9131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572547.239880:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3030 00000100:00080000:3.0:1788572547.247677:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572547.779250:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572548.804230:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572549.130512:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572549.130537:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639266560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572549.130616:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572549.130692:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639266560 00000100:00100000:3.0:1788572549.130698:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639266560 00000100:00100000:3.0:1788572549.130798:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:3.0:1788572549.130808:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639266560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788572549.130840:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:3.0:1788572549.130885:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639266560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572549.130892:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00100000:3.0:1788572549.130959:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639266560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572549.406079:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572549.406580:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616278400 00000100:00100000:2.0:1788572549.406607:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616278400 00000100:00100000:2.0:1788572549.406677:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4853 00000100:00100000:2.0:1788572549.406687:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616278400:12345-192.168.202.13@tcp:38:lctl.0 00010000:00020000:2.0:1788572549.406697:0:6551:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_race id 701 sleeping 00000100:00080000:3.0:1788572549.407038:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572549.638036:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639266688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572549.638120:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572549.643202:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639266688 00000100:00100000:3.0:1788572549.643221:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639266688 00000100:00100000:3.0:1788572549.643305:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:3.0:1788572549.643317:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639266688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572549.643360:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:3.0:1788572549.643457:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639266688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (5336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572549.643465:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00100000:3.0:1788572549.643516:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639266688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572549.643804:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572549.643987:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639266816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572549.644061:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572549.644141:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639266816 00000100:00100000:3.0:1788572549.644147:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639266816 00000100:00100000:3.0:1788572549.644198:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3031 00000100:00100000:3.0:1788572549.644206:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639266816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572549.644227:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572549.644264:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639266816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572549.644270:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3031 00000100:00080000:0.0:1788572549.644525:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572549.644559:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639266816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572549.827303:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572550.052658:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572550.052709:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572550.052801:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572550.052949:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572550.053049:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616278784 00000100:00100000:1.0:1788572550.053060:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616278784 00000100:00100000:0.0:1788572550.053276:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616278912 00000100:00100000:0.0:1788572550.053281:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616278912 00000100:00100000:0.0:1788572550.053330:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3897 00000100:00100000:0.0:1788572550.053341:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e62d950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616278784:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572550.053419:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e62d950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616278784:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 81us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572550.053427:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3897 00000100:00100000:0.0:1788572550.053448:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3898 00000100:00100000:0.0:1788572550.053454:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616278912:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572550.053481:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616278912:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572550.053488:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3898 00000100:00080000:0.0:1788572550.053505:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572550.053510:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572550.054472:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616278528 00000100:00100000:3.0:1788572550.054487:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616278528 00000100:00100000:3.0:1788572550.054545:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 113 00000100:00100000:3.0:1788572550.054554:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616278528:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572550.054625:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505643050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616278528:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 72us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572550.054632:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 113 00000100:00100000:2.0:1788572550.057454:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616278656 00000100:00100000:2.0:1788572550.057472:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616278656 00000100:00100000:2.0:1788572550.057642:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4854 00000100:00100000:2.0:1788572550.057653:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63ae68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616278656:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572550.057753:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63ae68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616278656:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 103us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572550.057760:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4854 00000100:00080000:0.0:1788572550.061565:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572550.147617:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639267328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572550.147692:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572550.147728:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639267840:0@lo:400:kworker.0 00000100:00100000:0.0:1788572550.147751:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572550.147769:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639268352:0@lo:400:kworker.0 00000100:00100000:0.0:1788572550.147791:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572550.147818:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788572550.147825:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639267200:0@lo:400:kworker.0 00000100:00100000:0.0:1788572550.147847:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572550.147880:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639267712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572550.147904:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572550.147922:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639268224:0@lo:400:kworker.0 00000100:00100000:0.0:1788572550.147945:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572550.147979:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639267328 00000100:00100000:0.0:1788572550.147988:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639267328 00000100:00100000:0.0:1788572550.148801:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639268352 00000100:00100000:0.0:1788572550.148808:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639268352 00000100:00100000:0.0:1788572550.148830:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639267712 00000100:00100000:0.0:1788572550.148833:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639267712 00000100:00100000:0.0:1788572550.148850:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639268224 00000100:00100000:0.0:1788572550.148853:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639268224 00000100:00100000:0.0:1788572550.149095:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:0.0:1788572550.149106:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639267328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572550.149328:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639267328:12345-0@lo:400:kworker.0 Request processed in 224us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572550.149336:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00100000:0.0:1788572550.149353:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:0.0:1788572550.149360:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639268352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572550.149390:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639268352:12345-0@lo:400:kworker.0 Request processed in 31us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572550.149396:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00100000:0.0:1788572550.149407:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:0.0:1788572550.149414:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639267712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572550.149443:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639267712:12345-0@lo:400:kworker.0 Request processed in 29us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572550.149448:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:0.0:1788572550.149459:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:0.0:1788572550.149465:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639268224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572550.149493:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639268224:12345-0@lo:400:kworker.0 Request processed in 28us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572550.149498:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:0.0:1788572550.149524:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639267840 00000100:00100000:0.0:1788572550.149528:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639267840 00000100:00100000:0.0:1788572550.149557:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639267200 00000100:00100000:0.0:1788572550.149561:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639267200 00000100:00100000:0.0:1788572550.149577:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4855 00000100:00100000:0.0:1788572550.149582:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639267840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.149717:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639267072:0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.149762:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572550.149806:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639267584:0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.149843:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572550.149873:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639268096:0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.149895:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572550.149917:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788572550.149924:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639266944:0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.149951:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572550.149973:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639267456:0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.150028:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572550.150068:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639267968:0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.150092:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572550.150105:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639268480:0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.150370:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572550.150403:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639267072 00000100:00100000:1.0:1788572550.150408:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639267072 00000100:00100000:1.0:1788572550.150440:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639268096 00000100:00100000:1.0:1788572550.150443:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639268096 00000100:00100000:1.0:1788572550.150461:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:1.0:1788572550.150468:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639267072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.150513:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639267072:12345-0@lo:400:kworker.0 Request processed in 45us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572550.150519:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:1.0:1788572550.150535:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:1.0:1788572550.150540:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639268096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.150565:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639268096:12345-0@lo:400:kworker.0 Request processed in 25us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572550.150573:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000100:00100000:1.0:1788572550.150592:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639266944 00000100:00100000:1.0:1788572550.150595:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639266944 00000100:00100000:3.0:1788572550.150828:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639267584 00000100:00100000:3.0:1788572550.150833:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639267584 00000100:00100000:3.0:1788572550.150855:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639267456 00000100:00100000:3.0:1788572550.150857:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639267456 00000100:00100000:3.0:1788572550.150878:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639267968 00000100:00100000:3.0:1788572550.150880:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639267968 00000100:00100000:3.0:1788572550.150890:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639268480 00000100:00100000:3.0:1788572550.150891:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639268480 00000100:00100000:3.0:1788572550.150904:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4856 00000100:00100000:3.0:1788572550.150910:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639267200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.150949:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639267200:12345-0@lo:400:kworker.0 Request processed in 40us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572550.150956:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4856 00000100:00100000:3.0:1788572550.150969:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4857 00000100:00100000:3.0:1788572550.150976:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639267584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151034:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639267584:12345-0@lo:400:kworker.0 Request processed in 58us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572550.151051:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4857 00000100:00100000:3.0:1788572550.151063:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4858 00000100:00100000:3.0:1788572550.151070:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639267456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151093:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639267456:12345-0@lo:400:kworker.0 Request processed in 25us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572550.151098:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4858 00000100:00100000:3.0:1788572550.151107:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4859 00000100:00100000:3.0:1788572550.151112:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639267968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151133:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639267968:12345-0@lo:400:kworker.0 Request processed in 20us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572550.151138:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4859 00000100:00100000:3.0:1788572550.151147:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4860 00000100:00100000:3.0:1788572550.151152:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639268480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151173:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875449639268480:12345-0@lo:400:kworker.0 Request processed in 21us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572550.151177:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4860 00000100:00080000:3.0:1788572550.151196:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788572550.151200:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572550.151203:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572550.151206:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572550.151256:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639267200:0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151268:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639267712:0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151279:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639268224:0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151290:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639267328:0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151300:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639268352:0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151351:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639267456:0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151361:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639267968:0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151370:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875449639268480:0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151380:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639267072:0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151390:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639267584:0@lo:400:kworker.0 00000100:00100000:3.0:1788572550.151400:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639268096:0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.151847:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788572550.151855:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50596a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639266944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572550.153377:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50596a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639266944:12345-0@lo:400:kworker.0 Request processed in 1520us (3422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572550.153387:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788572550.153456:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639266944:0@lo:400:kworker.0 00000100:00100000:0.0:1788572550.154198:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639267840:12345-0@lo:400:kworker.0 Request processed in 4612us (6442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572550.154208:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4855 00000100:00100000:1.0:1788572550.154354:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639267840:0@lo:400:kworker.0 00010000:00010000:2.0:1788572550.851807:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572551.172074:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639268608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572551.172154:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572551.172322:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639268608 00000100:00100000:2.0:1788572551.172331:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639268608 00000100:00100000:2.0:1788572551.172388:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3032 00000100:00100000:2.0:1788572551.172398:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639268608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572551.172430:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572551.172485:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63aeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639268608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572551.172493:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3032 00000100:00100000:1.0:1788572551.172970:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639268608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572551.683356:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639268736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572551.683434:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572551.683610:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639268736 00000100:00100000:1.0:1788572551.683618:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639268736 00000100:00100000:1.0:1788572551.683685:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3033 00000100:00100000:1.0:1788572551.683697:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639268736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572551.683732:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572551.683789:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639268736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572551.683796:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3033 00000100:00100000:2.0:1788572551.684810:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639268736:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788572551.879166:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572552.098467:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572552.098516:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572552.098550:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572552.098586:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572552.098666:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616279424 00000100:00100000:1.0:1788572552.098677:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616279424 00000100:00100000:1.0:1788572552.098743:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616279296 00000100:00100000:1.0:1788572552.098747:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616279296 00000100:00100000:1.0:1788572552.098771:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3903 00000100:00100000:1.0:1788572552.098781:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616279424:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572552.098854:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616279424:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 74us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572552.098862:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3903 00000100:00100000:1.0:1788572552.098881:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3904 00000100:00100000:1.0:1788572552.098887:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616279296:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572552.098912:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616279296:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572552.098918:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3904 00000100:00100000:3.0:1788572552.099058:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616279168 00000100:00100000:3.0:1788572552.099063:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616279168 00000100:00100000:3.0:1788572552.099108:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4861 00000100:00100000:3.0:1788572552.099117:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616279168:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572552.099151:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616279168:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 36us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572552.099157:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4861 00000100:00100000:2.0:1788572552.100143:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616279040 00000100:00100000:2.0:1788572552.100154:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616279040 00000100:00100000:2.0:1788572552.100215:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 115 00000100:00100000:2.0:1788572552.100224:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50596bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616279040:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572552.100282:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50596bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616279040:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 59us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572552.100289:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 115 00000100:00080000:0.0:1788572552.100516:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572552.100522:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572552.100525:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572552.195337:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572552.195363:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639268864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572552.195435:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572552.195576:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639268864 00000100:00100000:1.0:1788572552.195585:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639268864 00000100:00100000:1.0:1788572552.195658:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3034 00000100:00100000:1.0:1788572552.195669:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639268864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572552.195691:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572552.195739:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639268864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572552.195746:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3034 00000100:00100000:2.0:1788572552.195842:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639268864:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788572552.195905:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788572552.903813:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572553.923242:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572554.244051:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639268992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572554.244191:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572554.244345:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639268992 00000100:00100000:2.0:1788572554.244354:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639268992 00000100:00100000:2.0:1788572554.244405:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892 00000100:00100000:2.0:1788572554.244414:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639268992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572554.244458:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572554.244508:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639268992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572554.244514:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892 00000100:00100000:2.0:1788572554.244571:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639268992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572554.755200:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788572554.755227:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639269248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572554.755310:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572554.755580:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639269120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572554.755625:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572554.755735:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639269248 00000100:00100000:0.0:1788572554.755744:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639269248 00000100:00100000:0.0:1788572554.755820:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3035 00000100:00080000:1.0:1788572554.756138:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572554.756218:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639269248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572554.756254:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572554.756319:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634c91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639269248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572554.756327:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3035 00000100:00100000:1.0:1788572554.756676:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639269248:0@lo:13:osp-pre-0-0.0 00010000:00020000:0.0:1788572554.759196:0:6551:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 awake: rc=0 00010000:02000400:0.0:1788572554.759280:0:6551:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 35eb2d60-2de0-4b00-9815-d5153edd0057 (at 192.168.202.13@tcp) reconnecting 00000100:00100000:3.0:1788572554.759690:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639269120 00000100:00100000:3.0:1788572554.759700:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639269120 00000100:00100000:3.0:1788572554.759779:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893 00000100:00100000:3.0:1788572554.759791:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639269120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572554.759838:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:3.0:1788572554.759953:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639269120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (4327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572554.759961:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893 00000100:00100000:1.0:1788572554.760268:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639269120:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1788572554.780076:0:6551:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t219043334909 exp ffff94e633e09800 cur 4471 last 1788572549 00000004:00100000:0.0:1788572554.780120:0:6551:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.13@tcp supports cksum type f7, return f7 00000100:00080000:0.0:1788572554.780151:0:6551:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1788572554.780161:0:6551:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788572554.781521:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616278400:12345-192.168.202.13@tcp:38:lctl.0 Request processed in 5374830us (5375446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572554.781534:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4853 00000100:00100000:1.0:1788572554.831140:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572554.831513:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616279552 00000100:00100000:0.0:1788572554.831524:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616279552 00000100:00100000:0.0:1788572554.831631:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15549 00000100:00100000:0.0:1788572554.831642:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91655:x1875449616279552:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572554.831682:0:95742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572554.831763:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91655:x1875449616279552:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 121us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572554.831771:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15549 00000100:00080000:1.0:1788572554.833715:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572554.845894:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572554.846678:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616279680 00000100:00100000:0.0:1788572554.846691:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616279680 00000100:00100000:0.0:1788572554.846771:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15550 00000100:00100000:0.0:1788572554.846781:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91655:x1875449616279680:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572554.846814:0:6550:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572554.846899:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91655:x1875449616279680:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 119us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572554.846909:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15550 00000100:00080000:1.0:1788572554.848078:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572554.856376:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572554.856574:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616279808 00000100:00100000:1.0:1788572554.856585:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616279808 00000100:00100000:1.0:1788572554.856683:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3036 00000100:00100000:1.0:1788572554.856697:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91655:x1875449616279808:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572554.856733:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572554.856818:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91655:x1875449616279808:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 124us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572554.856826:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3036 00000100:00080000:0.0:1788572554.859877:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572554.863950:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572554.864050:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616279936 00000100:00100000:1.0:1788572554.864061:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616279936 00000100:00100000:1.0:1788572554.864141:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3037 00000100:00100000:1.0:1788572554.864154:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91655:x1875449616279936:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:1.0:1788572554.864320:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572554.864398:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91655:x1875449616279936:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 246us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572554.864406:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3037 00000100:00080000:0.0:1788572554.865653:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572554.953769:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572555.271618:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639269504:0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.271698:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572555.271746:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639270016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.271771:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572555.271789:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639270528:0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.271810:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572555.271836:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788572555.271843:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639269632:0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.271866:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572555.271880:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639270144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.271949:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572555.271969:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639270656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.271993:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572555.272056:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639269504 00000100:00100000:1.0:1788572555.272064:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639269504 00000100:00100000:1.0:1788572555.272108:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639270528 00000100:00100000:1.0:1788572555.272111:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639270528 00000100:00100000:1.0:1788572555.272134:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:1.0:1788572555.272142:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639269504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.272270:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639269504:12345-0@lo:400:kworker.0 Request processed in 127us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572555.272277:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00100000:1.0:1788572555.272296:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:1.0:1788572555.272302:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639270528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.272328:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639270528:12345-0@lo:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572555.272334:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:1.0:1788572555.272353:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639270016 00000100:00100000:1.0:1788572555.272357:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639270016 00000100:00100000:1.0:1788572555.272394:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639269632 00000100:00100000:1.0:1788572555.272397:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639269632 00000100:00100000:3.0:1788572555.272456:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639269376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.272490:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572555.272517:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639269888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.272539:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572555.273269:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639269760:0@lo:400:kworker.0 00000100:00100000:0.0:1788572555.273307:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572555.273330:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639270272:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.275364:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639270400:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.275415:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572555.275492:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639269888 00000100:00100000:1.0:1788572555.275501:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639269888 00000100:00100000:1.0:1788572555.275550:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4862 00000100:00100000:1.0:1788572555.275560:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639270016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.275618:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639270016:12345-0@lo:400:kworker.0 Request processed in 59us (3845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572555.275625:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4862 00000100:00100000:1.0:1788572555.275643:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4863 00000100:00100000:1.0:1788572555.275650:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639269632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.275681:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639269632:12345-0@lo:400:kworker.0 Request processed in 32us (3814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572555.275687:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4863 00000100:00100000:1.0:1788572555.275699:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4864 00000100:00100000:1.0:1788572555.275705:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639269888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.275734:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639269888:12345-0@lo:400:kworker.0 Request processed in 30us (3194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572555.275740:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4864 00000100:00100000:1.0:1788572555.275769:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639270144 00000100:00100000:1.0:1788572555.275773:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639270144 00000100:00100000:1.0:1788572555.275802:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639270656 00000100:00100000:1.0:1788572555.275806:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639270656 00000100:00100000:1.0:1788572555.275824:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639269760 00000100:00100000:1.0:1788572555.275828:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639269760 00000100:00100000:1.0:1788572555.275847:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:1.0:1788572555.275853:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639270144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.275887:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639270144:12345-0@lo:400:kworker.0 Request processed in 35us (3938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572555.275893:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:1.0:1788572555.275903:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:1.0:1788572555.275921:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639270656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.275962:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639270656:12345-0@lo:400:kworker.0 Request processed in 41us (3968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572555.275968:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:1.0:1788572555.275979:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:1.0:1788572555.275985:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639269760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.276033:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639269760:12345-0@lo:400:kworker.0 Request processed in 49us (2725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572555.276039:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00080000:1.0:1788572555.276068:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572555.276072:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572555.276074:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788572555.276076:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572555.276091:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639269376 00000100:00100000:1.0:1788572555.276095:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639269376 00000100:00100000:1.0:1788572555.276124:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788572555.276131:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639269376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.280470:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639269376:12345-0@lo:400:kworker.0 Request processed in 4326us (7965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572555.280487:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788572555.280632:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639269632:0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.280647:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639270144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.280658:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639270656:0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.280669:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639269504:0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.280680:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639270016:0@lo:400:kworker.0 00000100:00100000:1.0:1788572555.280693:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639270528:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.280864:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639270912:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.280931:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572555.280978:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639269376:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.280990:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639269888:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.281049:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639270400 00000100:00100000:3.0:1788572555.281056:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639270400 00000100:00100000:3.0:1788572555.281101:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639270912 00000100:00100000:3.0:1788572555.281104:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639270912 00000100:00100000:3.0:1788572555.281118:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4865 00000100:00100000:3.0:1788572555.281126:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639270400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.281306:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639270400:12345-0@lo:400:kworker.0 Request processed in 180us (5890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572555.281313:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4865 00000100:00100000:3.0:1788572555.281328:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4866 00000100:00100000:3.0:1788572555.281334:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639270912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.281362:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639270912:12345-0@lo:400:kworker.0 Request processed in 28us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572555.281368:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4866 00000100:00100000:3.0:1788572555.281552:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572555.281576:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639270784:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.281603:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572555.281637:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639269760:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.281663:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639270272 00000100:00100000:3.0:1788572555.281667:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639270272 00000100:00100000:3.0:1788572555.281691:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4867 00000100:00100000:3.0:1788572555.281697:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639270272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.281732:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639270272:12345-0@lo:400:kworker.0 Request processed in 35us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572555.281738:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4867 00000100:00100000:3.0:1788572555.281757:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639270784 00000100:00100000:3.0:1788572555.281760:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639270784 00000100:00100000:3.0:1788572555.281787:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:3.0:1788572555.281793:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639270784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.281825:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639270784:12345-0@lo:400:kworker.0 Request processed in 32us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572555.281831:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00080000:3.0:1788572555.282578:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572555.282583:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572555.282586:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572555.282615:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639270272:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.282629:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639270784:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.282658:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639270400:0@lo:400:kworker.0 00000100:00100000:3.0:1788572555.282669:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639270912:0@lo:400:kworker.0 00010000:00010000:2.0:1788572555.972986:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572556.296190:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788572556.296221:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639271040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572556.296292:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572556.296711:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639271040 00000100:00100000:2.0:1788572556.296720:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639271040 00000100:00100000:2.0:1788572556.296773:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038 00000100:00100000:2.0:1788572556.296784:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639271040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788572556.296817:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572556.296885:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639271040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572556.296892:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038 00000100:00100000:3.0:1788572556.297065:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639271040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572556.815130:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572556.815157:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639271168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788572556.815233:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572556.824519:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639271168 00000100:00100000:1.0:1788572556.824536:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639271168 00000100:00100000:1.0:1788572556.824610:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3039 00000100:00100000:1.0:1788572556.824621:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639271168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572556.824658:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572556.824758:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639271168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (9524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572556.824765:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3039 00000100:00100000:0.0:1788572556.826743:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639271168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572556.981401:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572556.982098:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616280064 00000100:00100000:1.0:1788572556.982110:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616280064 00000100:00100000:1.0:1788572556.982184:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4868 00000100:00100000:1.0:1788572556.982196:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616280064:12345-192.168.202.13@tcp:38:lctl.0 00010000:00020000:1.0:1788572556.982215:0:10390:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_race id 701 sleeping 00000100:00080000:2.0:1788572556.982404:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788572556.999332:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572557.217341:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572557.217382:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572557.217419:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572557.217466:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572557.217536:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616280192 00000100:00100000:1.0:1788572557.217547:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616280192 00000100:00100000:1.0:1788572557.217603:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 117 00000100:00100000:1.0:1788572557.217612:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616280192:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572557.217688:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616280192:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 76us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572557.217695:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 117 00000100:00100000:0.0:1788572557.218337:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616280576 00000100:00100000:0.0:1788572557.218344:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616280576 00000100:00100000:0.0:1788572557.218653:0:43974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616280448 00000100:00100000:0.0:1788572557.218658:0:43974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616280448 00000100:00100000:0.0:1788572557.218688:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3909 00000100:00100000:0.0:1788572557.218697:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616280576:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572557.218754:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616280576:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 59us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572557.218761:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3909 00000100:00100000:0.0:1788572557.218778:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3910 00000100:00100000:0.0:1788572557.218785:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616280448:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572557.218810:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616280448:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 26us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572557.218816:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3910 00000100:00100000:3.0:1788572557.219389:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616280320 00000100:00100000:3.0:1788572557.219396:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616280320 00000100:00080000:2.0:1788572557.222128:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572557.222141:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572557.222145:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572557.226368:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4869 00000100:00100000:3.0:1788572557.226396:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616280320:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572557.226607:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616280320:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 224us (9278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572557.226616:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4869 00000100:00100000:3.0:1788572557.315359:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639271296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572557.315439:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572557.315537:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639271296 00000100:00100000:2.0:1788572557.315547:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639271296 00000100:00100000:2.0:1788572557.315625:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040 00000100:00100000:2.0:1788572557.315636:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639271296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788572557.315662:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1788572557.315752:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572557.317750:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639271296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2108us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572557.317763:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040 00000100:00100000:3.0:1788572557.318648:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639271296:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788572558.025361:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572559.043240:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572559.269499:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572559.269555:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572559.269586:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572559.269618:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616280960 00000100:00100000:1.0:1788572559.269622:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572559.269629:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616280960 00000100:00100000:3.0:1788572559.269695:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616281088 00000100:00100000:3.0:1788572559.269698:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616281088 00000100:00100000:0.0:1788572559.269780:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616280832 00000100:00100000:0.0:1788572559.269785:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616280832 00000100:00100000:0.0:1788572559.269828:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4870 00000100:00100000:0.0:1788572559.269840:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616280832:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572559.269932:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616280832:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 94us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572559.269941:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4870 00000100:00100000:2.0:1788572559.270133:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616280704 00000100:00100000:2.0:1788572559.270138:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616280704 00000100:00100000:2.0:1788572559.270173:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 118 00000100:00100000:2.0:1788572559.270181:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616280704:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572559.270216:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616280704:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 37us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572559.270222:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 118 00000100:00080000:2.0:1788572559.270300:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788572559.270306:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572559.270308:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572559.275080:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3911 00000100:00100000:1.0:1788572559.275113:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616280960:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572559.275212:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616280960:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 116us (5655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572559.275220:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3911 00000100:00100000:1.0:1788572559.275249:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3912 00000100:00100000:1.0:1788572559.275256:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616281088:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572559.277605:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616281088:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 29us (5662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572559.277624:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3912 00000100:00100000:1.0:1788572559.364692:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572559.364729:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639271424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572559.364835:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572559.365145:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639271424 00000100:00100000:2.0:1788572559.365154:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639271424 00000100:00100000:2.0:1788572559.365220:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:2.0:1788572559.365231:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639271424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572559.365268:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572559.365349:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639271424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572559.365357:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000100:00100000:3.0:1788572559.366084:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639271424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572559.875460:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639271552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572559.875529:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572559.875652:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639271552 00000100:00100000:0.0:1788572559.875661:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639271552 00000100:00100000:0.0:1788572559.875760:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3041 00000100:00100000:0.0:1788572559.875770:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639271552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572559.875802:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572559.875853:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639271552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572559.875859:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3041 00000100:00100000:0.0:1788572559.875909:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639271552:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788572559.875979:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572559.876194:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572559.876203:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639271680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572559.876234:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572559.876471:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639271680 00000100:00100000:3.0:1788572559.876477:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639271680 00000100:00100000:3.0:1788572559.876558:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897 00000100:00100000:3.0:1788572559.876567:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639271680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572559.876595:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:3.0:1788572559.876654:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639271680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572559.876660:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897 00000100:00100000:0.0:1788572559.876756:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639271680:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788572560.067273:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572560.390350:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639272192:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.390425:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.390472:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639272704:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.390500:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.390521:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639273216:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.390546:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.390569:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788572560.390574:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639272064:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.390596:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.390611:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639272576:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.390634:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.390649:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639273088:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.390670:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.390704:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639272704 00000100:00100000:1.0:1788572560.390740:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639272704 00000100:00100000:1.0:1788572560.390809:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639272064 00000100:00100000:1.0:1788572560.390812:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639272064 00000100:00100000:1.0:1788572560.390836:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4871 00000100:00100000:1.0:1788572560.390846:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639272704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.390904:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875449639272704:12345-0@lo:400:kworker.0 Request processed in 59us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572560.390911:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4871 00000100:00100000:1.0:1788572560.390930:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4872 00000100:00100000:1.0:1788572560.390936:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639272064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.390962:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639272064:12345-0@lo:400:kworker.0 Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572560.390968:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4872 00000100:00100000:1.0:1788572560.390990:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639272192 00000100:00100000:1.0:1788572560.390993:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639272192 00000100:00100000:1.0:1788572560.391048:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639273216 00000100:00100000:1.0:1788572560.391052:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639273216 00000100:00100000:1.0:1788572560.391082:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639272576 00000100:00100000:1.0:1788572560.391085:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639272576 00000100:00100000:1.0:1788572560.391102:0:43970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639273088 00000100:00100000:1.0:1788572560.391104:0:43970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639273088 00000100:00100000:1.0:1788572560.391118:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:1.0:1788572560.391123:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639272192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391157:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639272192:12345-0@lo:400:kworker.0 Request processed in 33us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572560.391164:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00100000:1.0:1788572560.391174:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:1.0:1788572560.391182:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63c6dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639273216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391349:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63c6dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639273216:12345-0@lo:400:kworker.0 Request processed in 167us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572560.391355:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:1.0:1788572560.391548:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:1.0:1788572560.391555:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639272576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391584:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639272576:12345-0@lo:400:kworker.0 Request processed in 30us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572560.391590:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:1.0:1788572560.391601:0:43970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:1.0:1788572560.391607:0:43970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639273088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391632:0:43970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639273088:12345-0@lo:400:kworker.0 Request processed in 26us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572560.391638:0:43970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00080000:1.0:1788572560.391676:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572560.391681:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572560.391683:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572560.391734:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639272064:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391746:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639272576:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391757:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639273088:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391766:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639272192:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391775:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1875449639272704:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391784:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641105880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639273216:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391821:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639271808:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391856:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.391892:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639272320:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391916:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.391934:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639272832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391953:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.391970:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639273344:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.391987:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.392028:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788572560.392036:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639271936:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.392058:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572560.392196:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639271808 00000100:00100000:0.0:1788572560.392211:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639271808 00000100:00100000:0.0:1788572560.392244:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788572560.392252:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639271808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572560.392288:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639271808:12345-0@lo:400:kworker.0 Request processed in 38us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572560.392295:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788572560.392318:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639272320 00000100:00100000:0.0:1788572560.392329:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639272320 00000100:00100000:0.0:1788572560.392358:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639272832 00000100:00100000:0.0:1788572560.392362:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639272832 00000100:00100000:0.0:1788572560.392375:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639273344 00000100:00100000:0.0:1788572560.392378:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639273344 00000100:00100000:0.0:1788572560.392389:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4873 00000100:00100000:0.0:1788572560.392396:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639272320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572560.392427:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639272320:12345-0@lo:400:kworker.0 Request processed in 31us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572560.392433:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4873 00000100:00100000:0.0:1788572560.392444:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4874 00000100:00100000:0.0:1788572560.392449:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639272832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572560.392475:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639272832:12345-0@lo:400:kworker.0 Request processed in 26us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572560.392480:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4874 00000100:00100000:0.0:1788572560.392491:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4875 00000100:00100000:0.0:1788572560.392497:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639273344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572560.392522:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639273344:12345-0@lo:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572560.392526:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4875 00000100:00080000:0.0:1788572560.392540:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572560.392543:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572560.396452:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639271936 00000100:00100000:2.0:1788572560.396473:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639271936 00000100:00100000:2.0:1788572560.396562:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898 00000100:00100000:2.0:1788572560.396575:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639271936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572560.396722:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639271936:12345-0@lo:400:kworker.0 Request processed in 149us (4661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572560.396730:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898 00000100:00100000:1.0:1788572560.396831:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639271936:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.396844:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639272448:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.396883:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.397001:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639272960:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.397049:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572560.397094:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639271808:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.397110:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639272320:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.397122:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639272832:0@lo:400:kworker.0 00000100:00100000:1.0:1788572560.397133:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639273344:0@lo:400:kworker.0 00000100:00100000:3.0:1788572560.398351:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639272960 00000100:00100000:3.0:1788572560.398363:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639272960 00000100:00100000:3.0:1788572560.398428:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:3.0:1788572560.398437:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639272960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572560.398532:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639272960:12345-0@lo:400:kworker.0 Request processed in 96us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572560.398538:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00000100:00100000:0.0:1788572560.398895:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639272960:0@lo:400:kworker.0 00000100:00100000:2.0:1788572560.399895:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639272448 00000100:00100000:2.0:1788572560.399905:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639272448 00000100:00100000:2.0:1788572560.400047:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4876 00000100:00100000:2.0:1788572560.400057:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639272448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572560.400309:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639272448:12345-0@lo:400:kworker.0 Request processed in 253us (3423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572560.400317:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4876 00000100:00080000:0.0:1788572560.400798:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572560.400861:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639272448:0@lo:400:kworker.0 00010000:00010000:2.0:1788572561.091287:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572561.413094:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572561.413119:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e60fcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639273472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572561.413200:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572561.413372:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639273472 00000100:00100000:3.0:1788572561.413383:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639273472 00000100:00100000:3.0:1788572561.413453:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042 00000100:00100000:3.0:1788572561.413462:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639273472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572561.413499:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572561.413563:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639273472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572561.413570:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042 00000100:00100000:1.0:1788572561.413766:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e60fcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639273472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572561.923451:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572561.923481:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5058a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639273600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572561.923566:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572561.923770:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639273600 00000100:00100000:2.0:1788572561.923790:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639273600 00000100:00100000:2.0:1788572561.923848:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3043 00000100:00100000:2.0:1788572561.923858:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639273600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572561.923891:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572561.923992:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639273600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572561.924000:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3043 00000100:00100000:1.0:1788572561.930521:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5058a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639273600:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788572562.125310:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572562.435364:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572562.435389:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639273728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572562.435468:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572562.435655:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639273728 00000100:00100000:0.0:1788572562.435663:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639273728 00000100:00100000:0.0:1788572562.435728:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3044 00000100:00100000:0.0:1788572562.435736:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639273728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572562.435762:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572562.435808:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639273728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572562.435814:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3044 00000100:00100000:0.0:1788572562.435866:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639273728:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788572562.435929:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00020000:3.0:1788572562.437023:0:10390:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 awake: rc=0 00010000:02000400:3.0:1788572562.437057:0:10390:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 35eb2d60-2de0-4b00-9815-d5153edd0057 (at 192.168.202.13@tcp) reconnecting 00010000:00080000:3.0:1788572562.437061:0:10390:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t219043334909 exp ffff94e633e09800 cur 4479 last 1788572556 00000004:00100000:3.0:1788572562.437085:0:10390:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.13@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1788572562.437102:0:10390:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1788572562.437108:0:10390:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572562.437164:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616280064:12345-192.168.202.13@tcp:38:lctl.0 Request processed in 5454972us (5455778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572562.437172:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4868 00000100:00100000:2.0:1788572562.500470:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572562.500696:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616281216 00000100:00100000:0.0:1788572562.500708:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616281216 00000100:00100000:0.0:1788572562.500790:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15551 00000100:00100000:0.0:1788572562.500801:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91676:x1875449616281216:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572562.500850:0:6550:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572562.500962:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91676:x1875449616281216:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 162us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572562.500970:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15551 00000100:00080000:2.0:1788572562.502025:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572562.507456:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572562.507621:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616281344 00000100:00100000:2.0:1788572562.507646:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616281344 00000100:00100000:2.0:1788572562.507725:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15552 00000100:00100000:2.0:1788572562.507736:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91676:x1875449616281344:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:2.0:1788572562.507781:0:9276:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572562.507861:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91676:x1875449616281344:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 127us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572562.507868:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15552 00000100:00080000:0.0:1788572562.509488:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572562.517781:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572562.517898:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616281472 00000100:00100000:0.0:1788572562.517908:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616281472 00000100:00100000:3.0:1788572562.518172:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3045 00000100:00100000:3.0:1788572562.518190:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e60fcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91676:x1875449616281472:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:3.0:1788572562.518224:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:3.0:1788572562.518319:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e60fcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91676:x1875449616281472:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 133us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572562.518336:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3045 00000100:00100000:3.0:1788572562.525239:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572562.525490:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616281600 00000100:00100000:0.0:1788572562.525501:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616281600 00000100:00080000:2.0:1788572562.525579:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572562.525583:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572562.530565:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3046 00000100:00100000:0.0:1788572562.530580:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91676:x1875449616281600:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:0.0:1788572562.530611:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572562.534413:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91676:x1875449616281600:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 3822us (9171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572562.534429:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3046 00010000:00010000:1.0:1788572563.139540:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572564.169117:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572564.391866:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572564.392382:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616281728 00000100:00100000:2.0:1788572564.392393:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616281728 00000100:00100000:2.0:1788572564.392452:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:2.0:1788572564.392463:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616281728:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572564.392532:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616281728:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 71us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572564.392539:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 120 00000100:00100000:0.0:1788572564.416098:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572564.416135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572564.416176:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572564.416269:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572564.417060:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616281856 00000100:00100000:1.0:1788572564.417072:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616281856 00000100:00100000:1.0:1788572564.417146:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616281984 00000100:00100000:1.0:1788572564.417149:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616281984 00000100:00100000:1.0:1788572564.417402:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4877 00000100:00100000:1.0:1788572564.417415:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2383:x1875449616281856:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572564.417509:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2383:x1875449616281856:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 96us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572564.417517:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4877 00000100:00100000:1.0:1788572564.417539:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4878 00000100:00100000:1.0:1788572564.417546:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616281984:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572564.417584:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616281984:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 39us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572564.417590:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4878 00000100:00080000:0.0:1788572564.417902:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572564.417907:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572564.419524:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616282112 00000100:00100000:3.0:1788572564.419536:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616282112 00000100:00100000:3.0:1788572564.420441:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616282240 00000100:00100000:3.0:1788572564.420452:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616282240 00000100:00080000:0.0:1788572564.420783:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572564.420788:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572564.424487:0:43974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3917 00000100:00100000:3.0:1788572564.424763:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3918 00000100:00100000:3.0:1788572564.424781:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616282240:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572564.424923:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616282240:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 148us (8651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572564.424931:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3918 00000100:00100000:3.0:1788572564.425079:0:43974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616282112:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572564.425110:0:43974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616282112:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 609us (8973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572564.425117:0:43974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3917 00000100:00100000:1.0:1788572564.487142:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572564.487181:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639273856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572564.487282:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572564.487839:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639273856 00000100:00100000:2.0:1788572564.487848:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639273856 00000100:00100000:2.0:1788572564.487907:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:2.0:1788572564.487917:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639273856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572564.487954:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572564.488035:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639273856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572564.488041:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:2.0:1788572564.488096:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639273856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572564.699521:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572564.699602:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616282368 00000100:00100000:2.0:1788572564.699613:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616282368 00000100:00100000:2.0:1788572564.699674:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4879 00000100:00100000:2.0:1788572564.699684:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616282368:12345-192.168.202.13@tcp:38:lctl.0 00010000:00020000:2.0:1788572564.699695:0:9276:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_race id 701 sleeping 00000100:00100000:1.0:1788572564.995299:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572564.995326:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639273984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572564.995405:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572564.995836:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639273984 00000100:00100000:0.0:1788572564.995847:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639273984 00000100:00100000:0.0:1788572564.995927:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047 00000100:00100000:0.0:1788572564.995937:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639273984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788572564.995973:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572564.996048:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639273984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572564.996056:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047 00000100:00080000:2.0:1788572564.996122:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572564.996203:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639273984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572564.996379:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788572564.996391:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639274112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572564.996426:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572564.996506:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639274112 00000100:00100000:3.0:1788572564.996511:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639274112 00000100:00100000:3.0:1788572564.996562:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:3.0:1788572564.996570:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639274112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788572564.996596:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:3.0:1788572564.996638:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1875449639274112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572564.996645:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00000100:00100000:2.0:1788572564.996768:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e641104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639274112:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788572565.187902:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572565.508439:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639274240:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.508529:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572565.508570:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639274752:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.508594:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572565.508611:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639275264:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.508630:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572565.508650:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788572565.508655:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639274624:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.508672:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572565.508685:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639275136:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.508703:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572565.508722:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639274496:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.508743:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572565.508769:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639275008:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.508788:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572565.508802:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639275520:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.508819:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572565.508833:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788572565.508838:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639274368:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.508854:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572565.508862:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639274880:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.508876:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572565.508887:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5033f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639275392:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.508901:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572565.508924:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639274752 00000100:00100000:2.0:1788572565.508931:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639274752 00000100:00100000:2.0:1788572565.508975:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639274624 00000100:00100000:2.0:1788572565.508978:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639274624 00000100:00100000:2.0:1788572565.508988:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639275136 00000100:00100000:2.0:1788572565.508990:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639275136 00000100:00100000:2.0:1788572565.509025:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639275008 00000100:00100000:2.0:1788572565.509027:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639275008 00000100:00100000:2.0:1788572565.509039:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639275520 00000100:00100000:2.0:1788572565.509041:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639275520 00000100:00100000:2.0:1788572565.509049:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639274368 00000100:00100000:2.0:1788572565.509051:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639274368 00000100:00100000:2.0:1788572565.509063:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4880 00000100:00100000:2.0:1788572565.509070:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639274752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509128:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875449639274752:12345-0@lo:400:kworker.0 Request processed in 58us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572565.509135:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4880 00000100:00100000:2.0:1788572565.509156:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4881 00000100:00100000:2.0:1788572565.509162:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639274624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509183:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639274624:12345-0@lo:400:kworker.0 Request processed in 23us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572565.509189:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4881 00000100:00100000:2.0:1788572565.509200:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4882 00000100:00100000:2.0:1788572565.509205:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639275136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509223:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639275136:12345-0@lo:400:kworker.0 Request processed in 18us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572565.509228:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4882 00000100:00100000:2.0:1788572565.509236:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4883 00000100:00100000:2.0:1788572565.509241:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639275008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509264:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639275008:12345-0@lo:400:kworker.0 Request processed in 22us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572565.509269:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4883 00000100:00100000:2.0:1788572565.509282:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4884 00000100:00100000:2.0:1788572565.509287:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639275520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509313:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875449639275520:12345-0@lo:400:kworker.0 Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572565.509318:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4884 00000100:00100000:2.0:1788572565.509329:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4885 00000100:00100000:2.0:1788572565.509335:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639274368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509360:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639274368:12345-0@lo:400:kworker.0 Request processed in 26us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572565.509365:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4885 00000100:00100000:2.0:1788572565.509384:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639275264 00000100:00100000:2.0:1788572565.509387:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639275264 00000100:00100000:2.0:1788572565.509407:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902 00000100:00100000:2.0:1788572565.509413:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5058a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639275264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509442:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5058a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639275264:12345-0@lo:400:kworker.0 Request processed in 30us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572565.509448:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902 00000100:00100000:2.0:1788572565.509468:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639274496 00000100:00100000:2.0:1788572565.509471:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639274496 00000100:00100000:2.0:1788572565.509491:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639274880 00000100:00100000:2.0:1788572565.509493:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639274880 00000100:00100000:2.0:1788572565.509517:0:43968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639275392 00000100:00100000:2.0:1788572565.509520:0:43968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639275392 00000100:00100000:2.0:1788572565.509536:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:2.0:1788572565.509541:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639274496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509570:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639274496:12345-0@lo:400:kworker.0 Request processed in 28us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572565.509575:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:2.0:1788572565.509586:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:2.0:1788572565.509591:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639274880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509614:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639274880:12345-0@lo:400:kworker.0 Request processed in 24us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572565.509620:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:2.0:1788572565.509628:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:2.0:1788572565.509633:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639275392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509651:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639275392:12345-0@lo:400:kworker.0 Request processed in 18us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572565.509656:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00080000:2.0:1788572565.509675:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788572565.509678:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788572565.509681:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788572565.509683:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572565.509708:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639274368:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509717:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639274880:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509724:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5033f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639275392:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509731:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639274496:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509738:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639275008:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509746:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875449639275520:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509786:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639274624:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509795:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639275136:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509803:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1875449639274752:0@lo:400:kworker.0 00000100:00100000:2.0:1788572565.509811:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639275264:0@lo:400:kworker.0 00000100:00100000:1.0:1788572565.510436:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639274240 00000100:00100000:1.0:1788572565.510445:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639274240 00000100:00100000:1.0:1788572565.510494:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788572565.510503:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639274240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572565.510589:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3651:x1875449639274240:12345-0@lo:400:kworker.0 Request processed in 88us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572565.510595:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788572565.510750:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d74e0a07-d05f-49a8-aa32-40b653992526:3651:1875449639274240:0@lo:400:kworker.0 00010000:00010000:2.0:1788572566.211176:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572566.531253:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639275648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572566.531331:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572566.531516:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639275648 00000100:00100000:3.0:1788572566.531526:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639275648 00000100:00100000:3.0:1788572566.531588:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048 00000100:00100000:3.0:1788572566.531598:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639275648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572566.531631:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572566.533658:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639275648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2053us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572566.533673:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048 00000100:00100000:0.0:1788572566.533781:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639275648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572567.043989:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639275776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572567.044099:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572567.044325:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639275776 00000100:00100000:1.0:1788572567.044334:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639275776 00000100:00100000:1.0:1788572567.044411:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:1.0:1788572567.044423:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639275776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572567.044465:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00080000:2.0:1788572567.044601:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572567.044737:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639275776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 318us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572567.044742:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000100:00100000:3.0:1788572567.044810:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639275776:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788572567.238593:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572567.555308:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572567.555332:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639275904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572567.555413:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572567.555548:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639275904 00000100:00100000:1.0:1788572567.555556:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639275904 00000100:00100000:1.0:1788572567.555631:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3050 00000100:00100000:1.0:1788572567.555641:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639275904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788572567.555666:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572567.555711:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639275904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572567.555720:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3050 00000100:00080000:2.0:1788572567.555864:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572567.555906:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639275904:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572568.259602:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572569.285763:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572569.509547:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572569.509593:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572569.509648:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572569.509680:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572569.509713:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616282624 00000100:00100000:2.0:1788572569.509723:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616282624 00000100:00100000:2.0:1788572569.509785:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4886 00000100:00100000:2.0:1788572569.509797:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616282624:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572569.509879:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2384:x1875449616282624:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572569.509887:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4886 00000100:00080000:2.0:1788572569.509909:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572569.510451:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616282496 00000100:00100000:3.0:1788572569.510459:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616282496 00000100:00100000:3.0:1788572569.510510:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 122 00000100:00100000:3.0:1788572569.510519:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616282496:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572569.510568:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616282496:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 50us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572569.510574:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 122 00000100:00100000:1.0:1788572569.510802:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616282752 00000100:00100000:1.0:1788572569.510810:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616282752 00000100:00100000:1.0:1788572569.510860:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616282880 00000100:00100000:1.0:1788572569.510864:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616282880 00000100:00100000:1.0:1788572569.510887:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3922 00000100:00100000:1.0:1788572569.510898:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616282752:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572569.510928:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616282752:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 35us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572569.510935:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3922 00000100:00100000:1.0:1788572569.510949:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3923 00000100:00100000:1.0:1788572569.510956:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616282880:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572569.510978:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5033f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616282880:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 24us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572569.510984:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3923 00000100:00080000:3.0:1788572569.511816:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572569.511825:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572569.603394:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572569.603419:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63a93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639276032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572569.603505:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572569.603784:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639276032 00000100:00100000:1.0:1788572569.603796:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639276032 00000100:00100000:1.0:1788572569.603864:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903 00000100:00100000:1.0:1788572569.603875:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639276032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572569.603914:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572569.603977:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639276032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572569.603985:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903 00000100:00100000:0.0:1788572569.604499:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63a93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639276032:0@lo:41:osp-pre-1-0.0 00010000:00020000:3.0:1788572570.115204:0:9276:0:(ldlm_lib.c:1176:target_handle_connect()) cfs_fail_race id 701 awake: rc=0 00000100:00100000:0.0:1788572570.116618:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639276160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572570.116693:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572570.116829:0:6555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639276160 00000100:00100000:2.0:1788572570.116838:0:6555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639276160 00000100:00100000:2.0:1788572570.116902:0:6555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00000100:00100000:2.0:1788572570.116912:0:6555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639276160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572570.116946:0:6555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572570.116996:0:6555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639276160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572570.117020:0:6555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00000100:00100000:0.0:1788572570.117199:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639276160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572570.120755:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572570.120781:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639276288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788572570.120850:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572570.121181:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639276288 00000100:00100000:2.0:1788572570.121190:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639276288 00000100:00100000:2.0:1788572570.121264:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3051 00000100:00100000:2.0:1788572570.121274:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639276288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572570.121306:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572570.121370:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639276288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572570.121377:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3051 00000100:00080000:0.0:1788572570.121752:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788572570.121794:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e63779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639276288:0@lo:13:osp-pre-0-0.0 00010000:02000400:3.0:1788572570.145613:0:9276:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 35eb2d60-2de0-4b00-9815-d5153edd0057 (at 192.168.202.13@tcp) reconnecting 00010000:00080000:3.0:1788572570.145621:0:9276:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35eb2d60-2de0-4b00-9815-d5153edd0057@192.168.202.13@tcp t219043334909 exp ffff94e633e09800 cur 4487 last 1788572564 00000004:00100000:3.0:1788572570.145660:0:9276:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli 192.168.202.13@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1788572570.145687:0:9276:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1788572570.145696:0:9276:0:(import.c:65:import_set_state_nolock()) ffff94e641363000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788572570.145783:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616282368:12345-192.168.202.13@tcp:38:lctl.0 Request processed in 5446099us (5446271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572570.145795:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4879 00000100:00100000:2.0:1788572570.209910:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572570.210275:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616283008 00000100:00100000:3.0:1788572570.210286:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616283008 00000100:00100000:3.0:1788572570.210389:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15553 00000100:00100000:3.0:1788572570.210403:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91698:x1875449616283008:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:3.0:1788572570.210446:0:95742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:3.0:1788572570.210535:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+7:91698:x1875449616283008:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 135us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572570.210543:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15553 00000100:00080000:0.0:1788572570.211298:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788572570.213553:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572570.213698:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616283136 00000100:00100000:0.0:1788572570.213709:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616283136 00000100:00100000:0.0:1788572570.213775:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 15554 00000100:00100000:0.0:1788572570.213786:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91698:x1875449616283136:12345-192.168.202.13@tcp:41:lfs.0 00000004:00000024:0.0:1788572570.213823:0:6551:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572570.213895:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35eb2d60-2de0-4b00-9815-d5153edd0057+6:91698:x1875449616283136:12345-192.168.202.13@tcp:41:lfs.0 Request processed in 110us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572570.213903:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 15554 00000100:00100000:1.0:1788572570.227760:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572570.227962:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616283264 00000100:00100000:0.0:1788572570.227973:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616283264 00000100:00100000:0.0:1788572570.228064:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3052 00000100:00100000:0.0:1788572570.228074:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91698:x1875449616283264:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:0.0:1788572570.228102:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:0.0:1788572570.228188:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91698:x1875449616283264:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 114us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572570.228196:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3052 00000100:00100000:1.0:1788572570.238838:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572570.240778:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616283392 00000100:00100000:2.0:1788572570.240795:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616283392 00000100:00100000:2.0:1788572570.240882:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3053 00000100:00100000:2.0:1788572570.240894:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91698:x1875449616283392:12345-192.168.202.13@tcp:13:lfs.0 00002000:00000024:2.0:1788572570.240933:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788572570.241062:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63a93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:35eb2d60-2de0-4b00-9815-d5153edd0057+5:91698:x1875449616283392:12345-192.168.202.13@tcp:13:lfs.0 Request processed in 169us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572570.241070:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3053 00010000:00010000:1.0:1788572570.308901:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572570.627691:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639276416:0@lo:400:kworker.0 00000100:00100000:3.0:1788572570.627769:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572570.628036:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639276544:0@lo:400:kworker.0 00000100:00100000:2.0:1788572570.628076:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572570.628121:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639276544 00000100:00100000:2.0:1788572570.628138:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639276544 00000100:00100000:2.0:1788572570.628188:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4887 00000100:00100000:2.0:1788572570.628197:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639276544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572570.628255:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639276544:12345-0@lo:400:kworker.0 Request processed in 59us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572570.628263:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4887 00000100:00100000:2.0:1788572570.628305:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639276544:0@lo:400:kworker.0 00000100:00100000:0.0:1788572570.629595:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639276416 00000100:00100000:0.0:1788572570.629607:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639276416 00000100:00100000:0.0:1788572570.629658:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788572570.629667:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639276416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572570.629731:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3652:x1875449639276416:12345-0@lo:400:kworker.0 Request processed in 66us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572570.629738:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788572570.629850:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d74e0a07-d05f-49a8-aa32-40b653992526:3652:1875449639276416:0@lo:400:kworker.0 00000100:00100000:1.0:1788572570.630492:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639276800:0@lo:400:kworker.0 00000100:00100000:1.0:1788572570.630546:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572570.630638:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639276928:0@lo:400:kworker.0 00000100:00100000:0.0:1788572570.630704:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5032b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639276672:0@lo:400:kworker.0 00000100:00100000:0.0:1788572570.630733:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572570.630771:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639277184:0@lo:400:kworker.0 00000100:00100000:3.0:1788572570.630834:0:8464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639276672 00000100:00100000:3.0:1788572570.630839:0:8464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639276672 00000100:00100000:3.0:1788572570.630900:0:8464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:3.0:1788572570.630908:0:8464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639276672:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788572570.631075:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572570.631169:0:8464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639276672:12345-0@lo:400:kworker.0 Request processed in 261us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572570.631176:0:8464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:3.0:1788572570.631426:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639276800 00000100:00100000:3.0:1788572570.631432:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639276800 00000100:00100000:3.0:1788572570.631470:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4888 00000100:00100000:3.0:1788572570.631477:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639276800:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788572570.631586:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572570.631748:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572570.631777:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639277696:0@lo:400:kworker.0 00000100:00100000:0.0:1788572570.631819:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572570.631862:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639276672:0@lo:400:kworker.0 00000100:00100000:0.0:1788572570.631892:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639277184 00000100:00100000:0.0:1788572570.631896:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639277184 00000100:00100000:0.0:1788572570.631925:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639277696 00000100:00100000:0.0:1788572570.631937:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639277696 00000100:00100000:0.0:1788572570.631958:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4889 00000100:00100000:0.0:1788572570.631963:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639277184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572570.632024:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6131cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639277184:12345-0@lo:400:kworker.0 Request processed in 39us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572570.632032:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4889 00000100:00100000:0.0:1788572570.632046:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4890 00000100:00100000:0.0:1788572570.632052:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639277696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572570.632080:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639277696:12345-0@lo:400:kworker.0 Request processed in 28us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572570.632085:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4890 00000100:00100000:0.0:1788572570.632111:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639277184:0@lo:400:kworker.0 00000100:00100000:0.0:1788572570.632120:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639277696:0@lo:400:kworker.0 00000100:00100000:3.0:1788572570.634708:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875449639276800:12345-0@lo:400:kworker.0 Request processed in 3224us (4153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572570.634721:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4888 00000100:00080000:3.0:1788572570.635956:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788572570.641374:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1875449639276800:0@lo:400:kworker.0 00000100:00100000:1.0:1788572570.641391:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639277312:0@lo:400:kworker.0 00000100:00100000:1.0:1788572570.641454:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572570.642731:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639277056:0@lo:400:kworker.0 00000100:00100000:1.0:1788572570.642784:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572570.642824:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639277568:0@lo:400:kworker.0 00000100:00100000:1.0:1788572570.642849:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572570.642886:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639277056 00000100:00100000:1.0:1788572570.642895:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639277056 00000100:00100000:1.0:1788572570.642963:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639277568 00000100:00100000:1.0:1788572570.642966:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639277568 00000100:00100000:1.0:1788572570.642993:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:1.0:1788572570.643022:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639277056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572570.643083:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634bea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639277056:12345-0@lo:400:kworker.0 Request processed in 82us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572570.643090:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:1.0:1788572570.643108:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:1.0:1788572570.643115:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639277568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572570.643144:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634beaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639277568:12345-0@lo:400:kworker.0 Request processed in 30us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572570.643150:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000100:00080000:1.0:1788572570.643172:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572570.643198:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639277056:0@lo:400:kworker.0 00000100:00100000:1.0:1788572570.643210:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639277568:0@lo:400:kworker.0 00000100:00100000:2.0:1788572570.643965:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572570.648766:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639277440:0@lo:400:kworker.0 00000100:00100000:2.0:1788572570.649815:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572570.649891:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639277440 00000100:00100000:2.0:1788572570.649901:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639277440 00000100:00100000:2.0:1788572570.650106:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:2.0:1788572570.650119:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639277440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572570.650196:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639277440:12345-0@lo:400:kworker.0 Request processed in 79us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572570.650204:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00100000:2.0:1788572570.650260:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639277440:0@lo:400:kworker.0 00000100:00100000:3.0:1788572570.653430:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639277312 00000100:00100000:3.0:1788572570.653446:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639277312 00000100:00100000:3.0:1788572570.653529:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639276928 00000100:00100000:3.0:1788572570.653533:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639276928 00000100:00100000:3.0:1788572570.654742:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4891 00000100:00100000:3.0:1788572570.654761:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639277312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572570.655081:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875449639277312:12345-0@lo:400:kworker.0 Request processed in 327us (13626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572570.655088:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4891 00000100:00100000:3.0:1788572570.655109:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4892 00000100:00100000:3.0:1788572570.655116:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639276928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572570.655382:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1875449639277312:0@lo:400:kworker.0 00000100:00100000:3.0:1788572570.656727:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875449639276928:12345-0@lo:400:kworker.0 Request processed in 1604us (12755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572570.656738:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4892 00000100:00080000:1.0:1788572570.657268:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572570.657957:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5032b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1875449639276928:0@lo:400:kworker.0 00010000:00010000:0.0:1788572571.340746:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572571.651322:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639277824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572571.651401:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572571.651534:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639277824 00000100:00100000:1.0:1788572571.651543:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639277824 00000100:00100000:1.0:1788572571.651602:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054 00000100:00100000:1.0:1788572571.651613:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639277824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788572571.651636:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788572571.651704:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639277824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572571.651712:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054 00000100:00100000:2.0:1788572571.651867:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639277824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572572.163551:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639277952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788572572.163643:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572572.163898:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639277952 00000100:00100000:2.0:1788572572.163908:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639277952 00000100:00100000:2.0:1788572572.163986:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055 00000100:00100000:2.0:1788572572.163998:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639277952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572572.164056:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00080000:3.0:1788572572.164315:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572572.164604:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641107b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639277952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 609us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572572.164613:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055 00000100:00100000:3.0:1788572572.164722:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639277952:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788572572.355537:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572572.679984:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639278080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572572.680100:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572572.681253:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639278080 00000100:00100000:0.0:1788572572.681265:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639278080 00000100:00100000:0.0:1788572572.681348:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3056 00000100:00100000:0.0:1788572572.681359:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639278080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572572.681397:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788572572.681564:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572572.681611:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639278080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 253us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572572.681619:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3056 00000100:00100000:2.0:1788572572.681847:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639278080:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572573.379781:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572574.408469:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572574.626685:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572574.626733:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572574.626774:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572574.626811:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572574.626840:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572574.626886:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616283776 00000100:00100000:2.0:1788572574.626898:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616283776 00000100:00100000:1.0:1788572574.626908:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616284032 00000100:00100000:1.0:1788572574.626916:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616284032 00000100:00100000:1.0:1788572574.626972:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616283904 00000100:00100000:1.0:1788572574.626976:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616283904 00000100:00100000:1.0:1788572574.627032:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3927 00000100:00100000:1.0:1788572574.627044:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616284032:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572574.627114:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616284032:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 73us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572574.627122:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3927 00000100:00100000:1.0:1788572574.627139:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3928 00000100:00100000:1.0:1788572574.627145:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616283904:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572574.627181:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2385:x1875449616283904:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572574.627191:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3928 00000100:00100000:0.0:1788572574.627291:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616283648 00000100:00100000:0.0:1788572574.627296:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616283648 00000100:00100000:0.0:1788572574.627335:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4893 00000100:00100000:1.0:1788572574.627365:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2385:x1875449616283648:12345-192.168.202.13@tcp:400:kworker.0 00000100:00080000:0.0:1788572574.627373:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572574.627379:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572574.627381:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572574.627384:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788572574.627411:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2385:x1875449616283648:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 67us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572574.627420:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4893 00000100:00100000:3.0:1788572574.627583:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616283520 00000100:00100000:3.0:1788572574.627588:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616283520 00000100:00100000:3.0:1788572574.627622:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 124 00000100:00100000:3.0:1788572574.627629:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616283520:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572574.627671:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616283520:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 42us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572574.627678:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 124 00000100:00100000:1.0:1788572574.629303:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4894 00000100:00100000:1.0:1788572574.629320:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616283776:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572574.629414:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e63779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616283776:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 100us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572574.629421:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4894 00000100:00100000:2.0:1788572574.725228:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639278208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572574.725298:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572574.725697:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639278208 00000100:00100000:1.0:1788572574.725708:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639278208 00000100:00100000:1.0:1788572574.725767:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:1.0:1788572574.725776:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639278208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572574.725812:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572574.725866:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639278208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572574.725873:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000100:00100000:2.0:1788572574.726037:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639278208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572575.235305:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788572575.235330:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639278336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788572575.235420:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572575.235492:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639278336 00000100:00100000:0.0:1788572575.235500:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639278336 00000100:00100000:0.0:1788572575.235557:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:0.0:1788572575.235566:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639278336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788572575.235611:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:0.0:1788572575.235669:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639278336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572575.235677:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00000100:00100000:0.0:1788572575.235734:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639278336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572575.236611:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e64173c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639278464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572575.236652:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572575.236743:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639278464 00000100:00100000:1.0:1788572575.236749:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639278464 00000100:00100000:1.0:1788572575.236810:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3057 00000100:00100000:1.0:1788572575.236819:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639278464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788572575.236845:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572575.236903:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639278464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.236910:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3057 00000100:00080000:3.0:1788572575.236971:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572575.237028:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e64173c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639278464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572575.431708:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572575.747468:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639278592:0@lo:400:kworker.0 00000100:00100000:0.0:1788572575.747546:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572575.747600:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639279104:0@lo:400:kworker.0 00000100:00100000:0.0:1788572575.747629:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572575.747649:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639279616:0@lo:400:kworker.0 00000100:00100000:0.0:1788572575.747674:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572575.747698:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788572575.747704:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639278976:0@lo:400:kworker.0 00000100:00100000:0.0:1788572575.747727:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572575.747748:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639279488:0@lo:400:kworker.0 00000100:00100000:0.0:1788572575.747783:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572575.747814:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639279104 00000100:00100000:0.0:1788572575.747821:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639279104 00000100:00100000:0.0:1788572575.747884:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639278976 00000100:00100000:0.0:1788572575.747887:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639278976 00000100:00100000:0.0:1788572575.747906:0:6551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639279488 00000100:00100000:0.0:1788572575.747910:0:6551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639279488 00000100:00100000:0.0:1788572575.747933:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4895 00000100:00100000:0.0:1788572575.747942:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639279104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572575.748042:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639279104:12345-0@lo:400:kworker.0 Request processed in 101us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572575.748049:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4895 00000100:00100000:0.0:1788572575.748067:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4896 00000100:00100000:0.0:1788572575.748074:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639278976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572575.748104:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875449639278976:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572575.748120:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4896 00000100:00100000:0.0:1788572575.748131:0:6551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4897 00000100:00100000:0.0:1788572575.748137:0:6551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639279488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572575.748163:0:6551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875449639279488:12345-0@lo:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572575.748169:0:6551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4897 00000100:00100000:0.0:1788572575.748219:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1875449639278976:0@lo:400:kworker.0 00000100:00100000:0.0:1788572575.748230:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1875449639279488:0@lo:400:kworker.0 00000100:00100000:0.0:1788572575.748239:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639279104:0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.748779:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639278592 00000100:00100000:1.0:1788572575.748786:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639278592 00000100:00100000:1.0:1788572575.748829:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788572575.748837:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639278592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.748890:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3653:x1875449639278592:12345-0@lo:400:kworker.0 Request processed in 55us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.748897:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788572575.748929:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639279616 00000100:00100000:1.0:1788572575.748934:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639279616 00000100:00100000:1.0:1788572575.749084:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:1.0:1788572575.749092:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639279616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.749138:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639279616:12345-0@lo:400:kworker.0 Request processed in 47us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.749144:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00000100:00100000:2.0:1788572575.749316:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639278720:0@lo:400:kworker.0 00000100:00100000:2.0:1788572575.749349:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572575.749790:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639279232:0@lo:400:kworker.0 00000100:00100000:2.0:1788572575.749818:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572575.749847:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639279744:0@lo:400:kworker.0 00000100:00100000:2.0:1788572575.749937:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572575.750050:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572575.750058:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639278848:0@lo:400:kworker.0 00000100:00100000:2.0:1788572575.750081:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572575.750100:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639279360:0@lo:400:kworker.0 00000100:00100000:2.0:1788572575.750131:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572575.750149:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639279872:0@lo:400:kworker.0 00000100:00100000:2.0:1788572575.750170:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572575.750199:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639279232 00000100:00100000:2.0:1788572575.750204:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639279232 00000100:00100000:2.0:1788572575.750258:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639279744 00000100:00100000:2.0:1788572575.750261:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639279744 00000100:00100000:2.0:1788572575.750279:0:43976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639278848 00000100:00100000:2.0:1788572575.750282:0:43976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639278848 00000100:00100000:2.0:1788572575.750302:0:43976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:2.0:1788572575.750308:0:43976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639279232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572575.750350:0:43976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639279232:12345-0@lo:400:kworker.0 Request processed in 42us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.750450:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:1.0:1788572575.750459:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639279744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.750492:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639279744:12345-0@lo:400:kworker.0 Request processed in 35us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.750498:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00100000:1.0:1788572575.750515:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:1.0:1788572575.750521:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639278848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.750544:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639278848:12345-0@lo:400:kworker.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.750549:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00100000:1.0:1788572575.750584:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639278720 00000100:00100000:1.0:1788572575.750588:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639278720 00000100:00100000:1.0:1788572575.750610:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639279360 00000100:00100000:1.0:1788572575.750612:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639279360 00000100:00100000:1.0:1788572575.750626:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639279872 00000100:00100000:1.0:1788572575.750629:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639279872 00000100:00100000:1.0:1788572575.750639:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4898 00000100:00100000:1.0:1788572575.750643:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639278720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.750669:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875449639278720:12345-0@lo:400:kworker.0 Request processed in 25us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.750674:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4898 00000100:00100000:1.0:1788572575.750684:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4899 00000100:00100000:1.0:1788572575.750689:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639279360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.750710:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639279360:12345-0@lo:400:kworker.0 Request processed in 21us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.750715:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4899 00000100:00100000:1.0:1788572575.750723:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4900 00000100:00100000:1.0:1788572575.750728:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e64173c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639279872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.750746:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e64173c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639279872:12345-0@lo:400:kworker.0 Request processed in 18us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572575.750751:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4900 00000100:00100000:1.0:1788572575.750812:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639278848:0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.750821:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639279360:0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.750829:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639279872:0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.750838:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875449639278720:0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.750846:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639279232:0@lo:400:kworker.0 00000100:00100000:1.0:1788572575.750854:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639279744:0@lo:400:kworker.0 00000100:00080000:3.0:1788572575.751063:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572575.751067:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572575.751070:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572575.751072:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572575.751474:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e634be9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d74e0a07-d05f-49a8-aa32-40b653992526:3653:1875449639278592:0@lo:400:kworker.0 00000100:00100000:0.0:1788572575.751490:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639279616:0@lo:400:kworker.0 00000100:00100000:2.0:1788572575.751560:0:43976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00010000:00010000:0.0:1788572576.471947:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572576.772733:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639280000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572576.772817:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572576.773669:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639280000 00000100:00100000:0.0:1788572576.773679:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639280000 00000100:00100000:0.0:1788572576.773740:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3058 00000100:00100000:0.0:1788572576.773750:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639280000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572576.773784:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572576.774516:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639280000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 764us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572576.774526:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3058 00000100:00100000:3.0:1788572576.784024:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639280000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572577.283344:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788572577.283372:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639280128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572577.283446:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572577.287601:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639280128 00000100:00100000:1.0:1788572577.287622:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639280128 00000100:00100000:1.0:1788572577.287715:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3059 00000100:00100000:1.0:1788572577.287728:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639280128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572577.287762:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572577.287870:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639280128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (4424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572577.287877:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3059 00000100:00100000:1.0:1788572577.287933:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639280128:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788572577.289430:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572577.475354:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572577.795740:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572577.795768:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639280256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572577.795932:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572577.803845:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639280256 00000100:00100000:0.0:1788572577.803862:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639280256 00000100:00100000:0.0:1788572577.803952:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060 00000100:00100000:0.0:1788572577.803968:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639280256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572577.804023:0:8469:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788572577.804383:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572577.804929:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639280256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 965us (8997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572577.804938:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060 00000100:00100000:3.0:1788572577.805091:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639280256:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572578.500421:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572579.523321:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572579.769030:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572579.769086:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572579.769125:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572579.769145:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572579.769437:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616284160 00000100:00100000:3.0:1788572579.769448:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616284160 00000100:00100000:3.0:1788572579.769523:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 126 00000100:00100000:3.0:1788572579.769533:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616284160:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572579.769611:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616284160:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 80us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572579.769619:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 126 00000100:00100000:2.0:1788572579.770083:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616284288 00000100:00100000:2.0:1788572579.770089:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616284288 00000100:00100000:2.0:1788572579.770143:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4901 00000100:00100000:2.0:1788572579.770151:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2386:x1875449616284288:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572579.770188:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2386:x1875449616284288:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 39us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572579.770194:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4901 00000100:00100000:0.0:1788572579.770374:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616284544 00000100:00100000:0.0:1788572579.770379:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616284544 00000100:00100000:0.0:1788572579.770423:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616284672 00000100:00100000:0.0:1788572579.770426:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616284672 00000100:00100000:0.0:1788572579.770452:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3932 00000100:00100000:0.0:1788572579.770458:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616284544:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572579.770505:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2384:x1875449616284544:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 46us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.770511:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3932 00000100:00100000:0.0:1788572579.770524:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3933 00000100:00100000:0.0:1788572579.770530:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616284672:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572579.770552:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2383:x1875449616284672:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 22us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.770557:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3933 00000100:00080000:3.0:1788572579.771393:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788572579.771399:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788572579.771402:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788572579.771825:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572579.776764:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616284416 00000100:00100000:1.0:1788572579.776779:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616284416 00000100:00100000:1.0:1788572579.776884:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4902 00000100:00100000:1.0:1788572579.776897:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616284416:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:1.0:1788572579.776996:0:6550:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616284416:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 101us (5175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572579.777035:0:6550:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4902 00000100:00080000:3.0:1788572579.777883:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572579.845601:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639280384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572579.845691:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572579.850707:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639280384 00000100:00100000:0.0:1788572579.850724:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639280384 00000100:00100000:0.0:1788572579.850807:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909 00000100:00100000:0.0:1788572579.850818:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e641104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639280384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572579.850858:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572579.850969:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e641104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639280384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (5277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572579.850977:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909 00000100:00100000:3.0:1788572579.851179:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639280384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572580.356195:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572580.356228:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639280512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788572580.356322:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572580.356402:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639280512 00000100:00100000:2.0:1788572580.356412:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639280512 00000100:00100000:2.0:1788572580.356485:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3061 00000100:00100000:2.0:1788572580.356496:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639280512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572580.356533:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572580.356582:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639280512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572580.356590:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3061 00000100:00080000:2.0:1788572580.356620:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788572580.356677:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639280512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572580.358153:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639280640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572580.358245:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572580.358426:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639280640 00000100:00100000:2.0:1788572580.358437:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639280640 00000100:00100000:2.0:1788572580.358498:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1788572580.358508:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639280640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572580.358550:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572580.358600:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639280640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572580.358608:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000100:00100000:3.0:1788572580.358707:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639280640:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788572580.548068:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572580.873889:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639280768:0@lo:400:kworker.0 00000100:00100000:1.0:1788572580.873958:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639280896:0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.874097:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639281024:0@lo:400:kworker.0 00000100:00100000:3.0:1788572580.876556:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572580.876817:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639281280:0@lo:400:kworker.0 00000100:00100000:3.0:1788572580.876888:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572580.876926:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639281792:0@lo:400:kworker.0 00000100:00100000:3.0:1788572580.876971:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572580.877193:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639281280 00000100:00100000:3.0:1788572580.877203:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639281280 00000100:00100000:3.0:1788572580.877273:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4903 00000100:00100000:3.0:1788572580.877284:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639281280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572580.877345:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639281280:12345-0@lo:400:kworker.0 Request processed in 62us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572580.877352:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4903 00000100:00100000:3.0:1788572580.877380:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639281792 00000100:00100000:3.0:1788572580.877384:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639281792 00000100:00100000:3.0:1788572580.877409:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:3.0:1788572580.877414:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639281792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572580.877446:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639281792:12345-0@lo:400:kworker.0 Request processed in 31us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572580.877453:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00080000:3.0:1788572580.877474:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572580.877519:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639281280:0@lo:400:kworker.0 00000100:00100000:3.0:1788572580.877532:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639281792:0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.886758:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572580.886808:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639281536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.886842:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572580.886867:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639282048:0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.886888:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572580.886927:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788572580.886935:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639281152:0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.886959:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572580.886981:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639281664:0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.887002:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572580.887075:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639281536 00000100:00100000:0.0:1788572580.887083:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639281536 00000100:00100000:0.0:1788572580.887134:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639282048 00000100:00100000:0.0:1788572580.887137:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639282048 00000100:00100000:0.0:1788572580.887598:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639281152 00000100:00100000:0.0:1788572580.887603:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639281152 00000100:00100000:0.0:1788572580.887627:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639281664 00000100:00100000:0.0:1788572580.887630:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639281664 00000100:00100000:0.0:1788572580.887650:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4904 00000100:00100000:0.0:1788572580.887718:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639281536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.887790:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875449639281536:12345-0@lo:400:kworker.0 Request processed in 130us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572580.887797:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4904 00000100:00100000:0.0:1788572580.888649:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4905 00000100:00100000:0.0:1788572580.888662:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639282048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.889215:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875449639282048:12345-0@lo:400:kworker.0 Request processed in 556us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572580.889224:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4905 00000100:00100000:0.0:1788572580.889242:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4906 00000100:00100000:0.0:1788572580.889250:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639281152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.889280:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875449639281152:12345-0@lo:400:kworker.0 Request processed in 31us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572580.889286:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4906 00000100:00100000:0.0:1788572580.889298:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4907 00000100:00100000:0.0:1788572580.889305:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639281664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.889333:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875449639281664:12345-0@lo:400:kworker.0 Request processed in 29us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572580.889339:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4907 00000100:00080000:0.0:1788572580.889374:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788572580.889380:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572580.889426:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1875449639281152:0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.889439:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1875449639281664:0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.889450:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1875449639281536:0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.889460:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875449639282048:0@lo:400:kworker.0 00000100:00100000:3.0:1788572580.889701:0:43965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639281024 00000100:00100000:3.0:1788572580.889708:0:43965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639281024 00000100:00100000:3.0:1788572580.889755:0:43965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:3.0:1788572580.889761:0:43965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639281024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788572580.889802:0:43965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639281024:12345-0@lo:400:kworker.0 Request processed in 41us (3050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572580.889808:0:43965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000100:00080000:3.0:1788572580.889825:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572580.889841:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639281024:0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.890636:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639280768 00000100:00100000:0.0:1788572580.890642:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639280768 00000100:00100000:0.0:1788572580.890789:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788572580.890798:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5061a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639280768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572580.890853:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5061a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639280768:12345-0@lo:400:kworker.0 Request processed in 57us (14308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572580.890860:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788572580.891193:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572580.891230:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639280896 00000100:00100000:1.0:1788572580.891234:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639280896 00000100:00100000:1.0:1788572580.891266:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4908 00000100:00100000:1.0:1788572580.891272:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639280896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572580.891307:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875449639280896:12345-0@lo:400:kworker.0 Request processed in 35us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572580.891313:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4908 00000100:00100000:1.0:1788572580.891351:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875449639280896:0@lo:400:kworker.0 00000100:00100000:1.0:1788572580.891362:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639281408:0@lo:400:kworker.0 00000100:00100000:1.0:1788572580.891389:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572580.891411:0:8663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639281408 00000100:00100000:1.0:1788572580.891414:0:8663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639281408 00000100:00100000:1.0:1788572580.891448:0:8663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1788572580.891454:0:8663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639281408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572580.891485:0:8663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639281408:12345-0@lo:400:kworker.0 Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572580.891492:0:8663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1788572580.891518:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639281408:0@lo:400:kworker.0 00000100:00100000:1.0:1788572580.891525:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639281920:0@lo:400:kworker.0 00000100:00100000:1.0:1788572580.891760:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572580.891785:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639281920 00000100:00100000:1.0:1788572580.891788:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639281920 00000100:00100000:1.0:1788572580.891815:0:43967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:1.0:1788572580.891822:0:43967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639281920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572580.891852:0:43967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639281920:12345-0@lo:400:kworker.0 Request processed in 30us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572580.891858:0:43967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00100000:1.0:1788572580.891884:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639281920:0@lo:400:kworker.0 00000100:00080000:3.0:1788572580.892478:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788572580.892508:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639280768:0@lo:400:kworker.0 00000001:02000400:3.0:1788572581.109496:0:119088:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 44b: race in target handle connect ========================================================== 21:42:59 (1788572579) 00010000:00010000:0.0:1788572581.572372:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572581.891205:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788572581.891229:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639282176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788572581.891295:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572581.891344:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639282176 00000100:00100000:3.0:1788572581.891351:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639282176 00000100:00100000:3.0:1788572581.891401:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3062 00000100:00100000:3.0:1788572581.891411:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639282176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572581.891442:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572581.891487:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639282176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572581.891509:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3062 00000100:00100000:3.0:1788572581.891723:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639282176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788572582.404216:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788572582.404239:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639282304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788572582.404310:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572582.404398:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639282304 00000100:00100000:2.0:1788572582.404406:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639282304 00000100:00100000:2.0:1788572582.404483:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3063 00000100:00100000:2.0:1788572582.404495:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639282304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572582.404527:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572582.404580:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875449639282304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572582.404589:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3063 00000100:00100000:2.0:1788572582.404650:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1875449639282304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788572582.404703:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572582.596915:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572582.916335:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788572582.916365:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639282432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788572582.916450:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572582.926701:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639282432 00000100:00100000:0.0:1788572582.926722:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639282432 00000100:00100000:0.0:1788572582.927331:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3064 00000100:00100000:0.0:1788572582.927345:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639282432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572582.927375:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572582.927473:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639282432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (11022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572582.927479:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3064 00000100:00100000:0.0:1788572582.927551:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639282432:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788572582.938453:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788572583.621880:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572583.809381:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572583.809515:0:6550:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616284800 00000100:00100000:2.0:1788572583.809525:0:6550:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616284800 00000100:00100000:2.0:1788572583.809595:0:6550:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4909 00000100:00100000:2.0:1788572583.809605:0:6550:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35eb2d60-2de0-4b00-9815-d5153edd0057+7:2382:x1875449616284800:12345-192.168.202.13@tcp:38:lctl.0 00010000:02000400:2.0:1788572583.809635:0:6550:0:(ldlm_lib.c:962:target_handle_reconnect()) lustre-MDT0000: Client 35eb2d60-2de0-4b00-9815-d5153edd0057 (at 192.168.202.13@tcp) reconnecting 00000001:00020000:2.0:1788572583.809639:0:6550:0:(ldlm_lib.c:1434:target_handle_connect()) cfs_fail_timeout id 704 sleeping for 40000ms 00000100:00080000:0.0:1788572583.814152:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788572584.643546:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572584.870666:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572584.870711:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572584.870780:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:1.0:1788572584.870813:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572584.871103:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616285312 00000100:00100000:2.0:1788572584.871114:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616285312 00000100:00100000:2.0:1788572584.871184:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616285184 00000100:00100000:2.0:1788572584.871187:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616285184 00000100:00100000:2.0:1788572584.871210:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3937 00000100:00100000:2.0:1788572584.871221:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616285312:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572584.871300:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616285312:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 80us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572584.871308:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3937 00000100:00100000:2.0:1788572584.871329:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 3938 00000100:00100000:2.0:1788572584.871336:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616285184:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572584.871357:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2386:x1875449616285184:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 22us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572584.871363:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 3938 00000100:00100000:3.0:1788572584.871490:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616284928 00000100:00100000:3.0:1788572584.871494:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616284928 00000100:00100000:3.0:1788572584.871533:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 128 00000100:00100000:3.0:1788572584.871541:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616284928:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572584.871566:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2386:x1875449616284928:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 27us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572584.871576:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 128 00000100:00100000:0.0:1788572584.871656:0:10390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616285056 00000100:00100000:0.0:1788572584.871660:0:10390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616285056 00000100:00100000:0.0:1788572584.871704:0:10390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4910 00000100:00100000:0.0:1788572584.871711:0:10390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616285056:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572584.871738:0:10390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2386:x1875449616285056:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 28us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572584.871744:0:10390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4910 00000100:00080000:1.0:1788572584.873215:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572584.873227:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572584.873232:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572584.963307:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572584.963334:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639282560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788572584.963427:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572584.963680:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639282560 00000100:00100000:2.0:1788572584.963689:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639282560 00000100:00100000:2.0:1788572584.968626:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:2.0:1788572584.968651:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639282560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788572584.968692:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:2.0:1788572584.968801:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639282560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (5373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572584.968808:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1788572584.968973:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639282560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572585.475382:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788572585.475407:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639282688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788572585.475505:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572585.475578:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639282688 00000100:00100000:2.0:1788572585.475587:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639282688 00000100:00100000:2.0:1788572585.475636:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:2.0:1788572585.475646:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e506550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639282688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572585.475680:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572585.475727:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e506550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1875449639282688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572585.475772:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00000100:00100000:2.0:1788572585.475837:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639282688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788572585.476317:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788572585.476330:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639282816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572585.476366:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572585.476397:0:32111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639282816 00000100:00100000:3.0:1788572585.476401:0:32111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639282816 00000100:00100000:3.0:1788572585.476448:0:32111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3065 00000100:00100000:3.0:1788572585.476456:0:32111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639282816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788572585.476491:0:32111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00080000:1.0:1788572585.476493:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788572585.476526:0:32111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639282816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572585.476533:0:32111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3065 00000100:00100000:3.0:1788572585.476566:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639282816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788572585.667638:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572585.990806:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639283200:0@lo:400:kworker.0 00000100:00100000:2.0:1788572585.990894:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572585.990929:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639283712:0@lo:400:kworker.0 00000100:00100000:2.0:1788572585.990952:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572585.990976:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639284224:0@lo:400:kworker.0 00000100:00100000:2.0:1788572585.991035:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572585.991056:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788572585.991061:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639283072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572585.991084:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572585.991109:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639283584:0@lo:400:kworker.0 00000100:00100000:2.0:1788572585.991126:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572585.991138:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639284096:0@lo:400:kworker.0 00000100:00100000:2.0:1788572585.991154:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572585.991180:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639283072 00000100:00100000:2.0:1788572585.991188:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639283072 00000100:00100000:2.0:1788572585.991227:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639284096 00000100:00100000:2.0:1788572585.991230:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639284096 00000100:00100000:2.0:1788572585.991248:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914 00000100:00100000:2.0:1788572585.991255:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639283072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572585.991302:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639283072:12345-0@lo:400:kworker.0 Request processed in 47us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572585.991310:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914 00000100:00100000:2.0:1788572585.991328:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:2.0:1788572585.991334:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639284096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788572585.991357:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639284096:12345-0@lo:400:kworker.0 Request processed in 23us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572585.991362:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000100:00100000:2.0:1788572585.991398:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639283072:0@lo:400:kworker.0 00000100:00100000:2.0:1788572585.991407:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639284096:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.991506:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639283328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.991534:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572585.991559:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639283840:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.991578:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572585.991590:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639284352:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.991608:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572585.991625:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788572585.991630:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639282944:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.991654:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572585.991675:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639283456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.991692:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572585.991705:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639283968:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.991734:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572585.991749:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e501ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639284480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.991766:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572585.991783:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639282944 00000100:00100000:0.0:1788572585.991787:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639282944 00000100:00100000:0.0:1788572585.991814:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788572585.991820:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639282944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.991849:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639282944:12345-0@lo:400:kworker.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572585.991856:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788572585.991886:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639283200 00000100:00100000:0.0:1788572585.991889:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639283200 00000100:00100000:0.0:1788572585.991905:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639283584 00000100:00100000:0.0:1788572585.991907:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639283584 00000100:00100000:0.0:1788572585.991925:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639283840 00000100:00100000:0.0:1788572585.991927:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639283840 00000100:00100000:0.0:1788572585.991937:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639283456 00000100:00100000:0.0:1788572585.991939:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639283456 00000100:00100000:0.0:1788572585.991949:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639283968 00000100:00100000:0.0:1788572585.991951:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639283968 00000100:00100000:0.0:1788572585.991960:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639284480 00000100:00100000:0.0:1788572585.991962:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639284480 00000100:00100000:0.0:1788572585.991972:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4911 00000100:00100000:0.0:1788572585.991978:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639283200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.992030:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875449639283200:12345-0@lo:400:kworker.0 Request processed in 51us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572585.992036:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4911 00000100:00100000:0.0:1788572585.992048:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4912 00000100:00100000:0.0:1788572585.992053:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639283584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.992077:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875449639283584:12345-0@lo:400:kworker.0 Request processed in 24us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572585.992082:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4912 00000100:00100000:0.0:1788572585.992092:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913 00000100:00100000:0.0:1788572585.992097:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e634be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639283840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.992116:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e634be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875449639283840:12345-0@lo:400:kworker.0 Request processed in 20us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572585.992121:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913 00000100:00100000:0.0:1788572585.992131:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4914 00000100:00100000:0.0:1788572585.992137:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639283456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.992156:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639283456:12345-0@lo:400:kworker.0 Request processed in 19us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572585.992161:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4914 00000100:00100000:0.0:1788572585.992170:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4915 00000100:00100000:0.0:1788572585.992175:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639283968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.992194:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639283968:12345-0@lo:400:kworker.0 Request processed in 20us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572585.992200:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4915 00000100:00100000:0.0:1788572585.992208:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4916 00000100:00100000:0.0:1788572585.992213:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639284480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.992233:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639284480:12345-0@lo:400:kworker.0 Request processed in 20us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572585.992238:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4916 00000100:00100000:0.0:1788572585.992263:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639282944:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.992273:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639283456:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.992281:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639283968:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.992289:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639284480:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.992296:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1875449639283840:0@lo:400:kworker.0 00000100:00100000:1.0:1788572585.992782:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639283712 00000100:00100000:1.0:1788572585.992789:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639283712 00000100:00100000:1.0:1788572585.992837:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639284224 00000100:00100000:1.0:1788572585.992840:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639284224 00000100:00100000:1.0:1788572585.992869:0:43975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639283328 00000100:00100000:0.0:1788572585.992870:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639284352 00000100:00100000:1.0:1788572585.992872:0:43975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639283328 00000100:00100000:0.0:1788572585.992873:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639284352 00000100:00100000:1.0:1788572585.992897:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:1.0:1788572585.992904:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639283712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572585.992952:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639283712:12345-0@lo:400:kworker.0 Request processed in 48us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572585.992959:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00100000:1.0:1788572585.992974:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:1.0:1788572585.992981:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639284224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572585.993035:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639284224:12345-0@lo:400:kworker.0 Request processed in 55us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572585.993042:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00100000:1.0:1788572585.993053:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:1.0:1788572585.993060:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639283328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572585.993143:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639283328:12345-0@lo:400:kworker.0 Request processed in 82us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572585.993149:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00100000:1.0:1788572585.993163:0:43975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:1.0:1788572585.993169:0:43975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639284352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572585.993199:0:43975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639284352:12345-0@lo:400:kworker.0 Request processed in 31us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572585.993205:0:43975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00080000:0.0:1788572585.995167:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788572585.995178:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788572585.995181:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572585.995185:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788572585.995241:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639283328:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.995257:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639284352:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.995580:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1875449639283584:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.995601:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875449639283200:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.995613:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e506553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639283712:0@lo:400:kworker.0 00000100:00100000:0.0:1788572585.995624:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e501ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639284224:0@lo:400:kworker.0 00010000:00010000:0.0:1788572586.692450:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572587.011914:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572587.021079:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e637795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639284608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572587.021183:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572587.021527:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639284608 00000100:00100000:0.0:1788572587.021538:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639284608 00000100:00100000:0.0:1788572587.021618:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066 00000100:00100000:0.0:1788572587.021628:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639284608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788572587.021665:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788572587.021739:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788572587.021743:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639284608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572587.021750:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066 00000100:00100000:2.0:1788572587.022061:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e637795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639284608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572587.523820:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639284736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572587.523900:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572587.524130:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639284736 00000100:00100000:1.0:1788572587.524139:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639284736 00000100:00100000:1.0:1788572587.524208:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067 00000100:00100000:1.0:1788572587.524219:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639284736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788572587.524252:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8667712 pending 0 free 3923476480 avail 3691954176 00000100:00100000:1.0:1788572587.524302:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639284736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572587.524309:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067 00000100:00080000:1.0:1788572587.524331:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572587.524366:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639284736:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788572587.717259:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572588.036801:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e5038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639284864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788572588.036879:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572588.039150:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639284864 00000100:00100000:0.0:1788572588.039166:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639284864 00000100:00100000:0.0:1788572588.039254:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3068 00000100:00100000:0.0:1788572588.039265:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639284864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572588.039303:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8635328 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572588.039399:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875449639284864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (2521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572588.039415:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3068 00000100:00080000:1.0:1788572588.040318:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788572588.040712:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e5038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639284864:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572588.740690:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572589.763258:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572589.984983:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572589.985054:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572589.985092:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572589.985130:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572589.985165:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616285568 00000100:00100000:0.0:1788572589.985174:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616285568 00000100:00100000:0.0:1788572589.985243:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4917 00000100:00100000:0.0:1788572589.985255:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616285568:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572589.985334:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2385:x1875449616285568:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572589.985341:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4917 00000100:00100000:1.0:1788572589.985436:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616285696 00000100:00100000:1.0:1788572589.985441:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616285696 00000100:00100000:1.0:1788572589.985489:0:43973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616285824 00000100:00100000:1.0:1788572589.985492:0:43973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616285824 00000100:00100000:1.0:1788572589.985517:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4514 00000100:00100000:1.0:1788572589.985525:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5038c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2382:x1875449616285696:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:1.0:1788572589.985549:0:43973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b833a497 00000100:00080000:1.0:1788572589.985589:0:43973:0:(import.c:65:import_set_state_nolock()) ffff94e618791000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572589.985635:0:43973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884902113 00000100:00100000:1.0:1788572589.985793:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5038c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+2:2382:x1875449616285696:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 268us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572589.985799:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4514 00000100:00100000:1.0:1788572589.985814:0:43973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4515 00000100:00100000:1.0:1788572589.985820:0:43973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+5:2382:x1875449616285824:12345-192.168.202.13@tcp:9:kworker.0 00000020:00000080:1.0:1788572589.985830:0:43973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdb7edb52b833a49e 00000100:00080000:1.0:1788572589.985835:0:43973:0:(import.c:65:import_set_state_nolock()) ffff94e618790800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788572589.985858:0:43973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968877 00000100:00100000:1.0:1788572589.985923:0:43973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:35eb2d60-2de0-4b00-9815-d5153edd0057+2:2382:x1875449616285824:12345-192.168.202.13@tcp:9:kworker.0 Request processed in 102us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572589.985929:0:43973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4515 00010000:00010000:1.0:1788572589.985949:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788572589.985955:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788572589.985961:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788572589.985965:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788572589.985967:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788572589.986441:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616285440 00000100:00100000:2.0:1788572589.986447:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616285440 00000100:00100000:2.0:1788572589.986500:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:2.0:1788572589.986509:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616285440:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572589.986567:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2385:x1875449616285440:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 59us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572589.986575:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 130 00000100:00100000:3.0:1788572590.092101:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639284992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572590.092181:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572590.092343:0:6556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639284992 00000100:00100000:0.0:1788572590.092351:0:6556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639284992 00000100:00100000:0.0:1788572590.092404:0:6556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:0.0:1788572590.092415:0:6556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e637795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639284992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788572590.092449:0:6556:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:0.0:1788572590.092519:0:6556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e637795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875449639284992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572590.092527:0:6556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000100:00100000:3.0:1788572590.092730:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1875449639284992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788572590.595398:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788572590.595424:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639285120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572590.595500:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572590.595708:0:7860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639285120 00000100:00100000:2.0:1788572590.595717:0:7860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639285120 00000100:00100000:2.0:1788572590.595779:0:7860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:2.0:1788572590.595790:0:7860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639285120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788572590.595836:0:7860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446002688 avail 1299763200 00000100:00100000:2.0:1788572590.595895:0:7860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875449639285120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572590.595902:0:7860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00100000:1.0:1788572590.596059:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639285120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788572590.599405:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639285248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788572590.599485:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572590.601036:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639285248 00000100:00100000:2.0:1788572590.601051:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639285248 00000100:00100000:2.0:1788572590.601137:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3069 00000100:00100000:2.0:1788572590.601147:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639285248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788572590.601183:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572590.601267:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e6412c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639285248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572590.601286:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3069 00000100:00100000:0.0:1788572590.601409:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639285248:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788572590.601648:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788572590.791448:0:92610:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572591.114663:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639285376:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.114758:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572591.114812:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639285888:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.114852:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572591.114871:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639286400:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.114892:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572591.114908:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639286912:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.114929:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572591.114957:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788572591.114963:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639285504:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.114988:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572591.115042:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639286016:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.115065:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572591.115081:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639286528:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.115100:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572591.115571:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639285376 00000100:00100000:1.0:1788572591.115580:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639285376 00000100:00100000:1.0:1788572591.115643:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788572591.115654:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639285376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572591.115735:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d74e0a07-d05f-49a8-aa32-40b653992526+24:3650:x1875449639285376:12345-0@lo:400:kworker.0 Request processed in 83us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572591.115743:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788572591.115777:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639285504 00000100:00100000:1.0:1788572591.115781:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639285504 00000100:00100000:1.0:1788572591.115812:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639286528 00000100:00100000:1.0:1788572591.115824:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639286528 00000100:00100000:1.0:1788572591.115847:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:1.0:1788572591.115853:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639285504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572591.115899:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875449639285504:12345-0@lo:400:kworker.0 Request processed in 46us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572591.115906:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00100000:1.0:1788572591.115919:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:1.0:1788572591.115925:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639286528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572591.115954:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639286528:12345-0@lo:400:kworker.0 Request processed in 30us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572591.115960:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:1.0:1788572591.115986:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639285888 00000100:00100000:1.0:1788572591.115989:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639285888 00000100:00100000:1.0:1788572591.116331:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639286400 00000100:00100000:1.0:1788572591.116337:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639286400 00000100:00100000:1.0:1788572591.116352:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639286912 00000100:00100000:1.0:1788572591.116354:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639286912 00000100:00100000:1.0:1788572591.116364:0:95742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639286016 00000100:00100000:1.0:1788572591.116367:0:95742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639286016 00000100:00100000:1.0:1788572591.116382:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4918 00000100:00100000:1.0:1788572591.116388:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639285888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572591.116423:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875449639285888:12345-0@lo:400:kworker.0 Request processed in 36us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572591.116429:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4918 00000100:00100000:1.0:1788572591.116440:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4919 00000100:00100000:1.0:1788572591.116446:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639286400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572591.116473:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875449639286400:12345-0@lo:400:kworker.0 Request processed in 27us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572591.116479:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4919 00000100:00100000:1.0:1788572591.116489:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4920 00000100:00100000:1.0:1788572591.116494:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639286912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572591.116532:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875449639286912:12345-0@lo:400:kworker.0 Request processed in 37us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572591.116541:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4920 00000100:00100000:1.0:1788572591.116553:0:95742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4921 00000100:00100000:1.0:1788572591.116559:0:95742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639286016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572591.116586:0:95742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875449639286016:12345-0@lo:400:kworker.0 Request processed in 28us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572591.116591:0:95742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4921 00000100:00080000:1.0:1788572591.116606:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788572591.116610:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788572591.116690:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639285632:0@lo:400:kworker.0 00000100:00100000:3.0:1788572591.116711:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e6412c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639285760:0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.116735:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572591.116759:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572591.116774:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639286144:0@lo:400:kworker.0 00000100:00100000:3.0:1788572591.116795:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639286272:0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.116823:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572591.116842:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572591.116852:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639286656:0@lo:400:kworker.0 00000100:00100000:3.0:1788572591.116869:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639286784:0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.116881:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572591.116914:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572591.116930:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639285632 00000100:00100000:0.0:1788572591.116936:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639285632 00000100:00100000:3.0:1788572591.116957:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639285760 00000100:00100000:3.0:1788572591.116962:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639285760 00000100:00100000:0.0:1788572591.116969:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639286272 00000100:00100000:0.0:1788572591.116974:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639286272 00000100:00100000:0.0:1788572591.117033:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4922 00000100:00100000:0.0:1788572591.117040:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e501ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639285632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.117078:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e501ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875449639285632:12345-0@lo:400:kworker.0 Request processed in 38us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572591.117085:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4922 00000100:00100000:0.0:1788572591.117099:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4923 00000100:00100000:0.0:1788572591.117106:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639286272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.117140:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875449639286272:12345-0@lo:400:kworker.0 Request processed in 35us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572591.117146:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4923 00000100:00100000:3.0:1788572591.117380:0:43967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639286144 00000100:00100000:3.0:1788572591.117385:0:43967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639286144 00000100:00100000:0.0:1788572591.117917:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639286656 00000100:00100000:0.0:1788572591.117925:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639286656 00000100:00100000:0.0:1788572591.117961:0:43969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639286784 00000100:00100000:0.0:1788572591.117965:0:43969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639286784 00000100:00100000:0.0:1788572591.117985:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:0.0:1788572591.117994:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639285760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.118073:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639285760:12345-0@lo:400:kworker.0 Request processed in 80us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572591.118081:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00100000:0.0:1788572591.118096:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:0.0:1788572591.118104:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639286144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.118136:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639286144:12345-0@lo:400:kworker.0 Request processed in 33us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572591.118142:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:00100000:1.0:1788572591.118156:0:43968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:0.0:1788572591.118164:0:43969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:1.0:1788572591.118169:0:43968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639286656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.118176:0:43969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639286784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788572591.118217:0:43968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3652:x1875449639286656:12345-0@lo:400:kworker.0 Request processed in 53us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572591.118225:0:43969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3653:x1875449639286784:12345-0@lo:400:kworker.0 Request processed in 52us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572591.118226:0:43968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:0.0:1788572591.118237:0:43969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00000100:00080000:0.0:1788572591.118286:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572591.118286:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875449639285632:0@lo:400:kworker.0 00000100:00080000:0.0:1788572591.118292:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788572591.118298:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788572591.118305:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639286144:0@lo:400:kworker.0 00000100:00100000:1.0:1788572591.118319:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1875449639286656:0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.118346:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639285760:0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.118363:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1875449639286272:0@lo:400:kworker.0 00000100:00100000:0.0:1788572591.118375:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639286784:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.119245:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639285504:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.119277:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1875449639286016:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.119289:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639286528:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.119299:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e6412c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d74e0a07-d05f-49a8-aa32-40b653992526:3650:1875449639285376:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.119309:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1875449639285888:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.119320:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1875449639286400:0@lo:400:kworker.0 00000100:00100000:2.0:1788572591.119331:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875449639286912:0@lo:400:kworker.0 00010000:00010000:1.0:1788572591.811260:0:17013:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788572592.131294:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572592.131320:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e633dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639287040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788572592.131393:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788572592.131508:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639287040 00000100:00100000:3.0:1788572592.131517:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639287040 00000100:00100000:3.0:1788572592.131645:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3070 00000100:00100000:3.0:1788572592.131655:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639287040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788572592.131687:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 197568 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788572592.131748:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639287040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572592.131755:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3070 00000100:00100000:1.0:1788572592.131844:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e633dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639287040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788572592.644624:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788572592.644650:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639287168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788572592.644725:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788572592.644831:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639287168 00000100:00100000:2.0:1788572592.644839:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639287168 00000100:00100000:2.0:1788572592.644903:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3071 00000100:00100000:2.0:1788572592.644913:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639287168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788572592.644947:0:8468:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923476480 avail 3691954176 00000100:00100000:2.0:1788572592.645022:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e5032b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875449639287168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572592.645030:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3071 00000100:00100000:0.0:1788572592.645344:0:3653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e50552c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1875449639287168:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788572592.835310:0:6538:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788572593.155954:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788572593.155980:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639287296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788572593.156092:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788572593.156190:0:10546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639287296 00000100:00100000:0.0:1788572593.156198:0:10546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639287296 00000100:00100000:0.0:1788572593.156268:0:10546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3072 00000100:00100000:0.0:1788572593.156279:0:10546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639287296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788572593.156303:0:10546:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 197568 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788572593.156350:0:10546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e57e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875449639287296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572593.156357:0:10546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3072 00000100:00080000:1.0:1788572593.156585:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788572593.156628:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1875449639287296:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788572593.859209:0:6539:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788572594.092286:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572594.092318:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572594.092351:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:0.0:1788572594.092382:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616286208 00000100:00100000:0.0:1788572594.092392:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616286208 00000100:00100000:0.0:1788572594.092477:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616286080 00000100:00100000:0.0:1788572594.092480:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616286080 00000100:00100000:0.0:1788572594.092508:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4924 00000100:00100000:0.0:1788572594.092519:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616286208:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572594.092602:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616286208:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 83us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572594.092610:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4924 00000100:00100000:0.0:1788572594.092628:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4925 00000100:00100000:0.0:1788572594.092634:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e61e572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2382:x1875449616286080:12345-192.168.202.13@tcp:38:kworker.0 00010000:02000400:0.0:1788572594.092657:0:6552:0:(ldlm_lib.c:1341:target_handle_connect()) lustre-MDT0000: Export ffff94e633e09800 already connecting from 192.168.202.13@tcp 00000100:00080000:3.0:1788572594.097063:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788572594.097073:0:6546:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788572594.097090:0:116818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616285952 00000100:00100000:3.0:1788572594.097100:0:116818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616285952 00000100:00100000:3.0:1788572594.097165:0:116818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 132 00000100:00100000:3.0:1788572594.097175:0:116818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616285952:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:3.0:1788572594.097247:0:116818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2384:x1875449616285952:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 74us (4894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788572594.097255:0:116818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 132 00000100:00100000:0.0:1788572594.106414:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e61e572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2382:x1875449616286080:12345-192.168.202.13@tcp:38:kworker.0 Request processed in 13761us (14076us total) trans 0 rc -114/-114 00000100:00100000:0.0:1788572594.106430:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4925 00010000:00010000:1.0:1788572594.883716:0:92609:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788572595.104832:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572595.104935:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:3.0:1788572595.106730:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.13@tcp (source: 12345-192.168.202.13@tcp) 00000100:00100000:2.0:1788572595.107019:0:116817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616286336 00000100:00100000:2.0:1788572595.107029:0:116817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616286336 00000100:00100000:2.0:1788572595.107085:0:116817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 133 00000100:00100000:2.0:1788572595.107094:0:116817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e505c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616286336:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:2.0:1788572595.107163:0:116817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e505c92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90fa6266-5a39-4f6d-b3cf-5043b0cc0e22+10:2383:x1875449616286336:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 70us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788572595.107171:0:116817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 133 00000100:00100000:0.0:1788572595.107865:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616286592 00000100:00100000:0.0:1788572595.107873:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616286592 00000100:00100000:0.0:1788572595.107914:0:9276:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449616286464 00000100:00100000:0.0:1788572595.107918:0:9276:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449616286464 00000100:00100000:0.0:1788572595.107950:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4926 00000100:00100000:0.0:1788572595.107958:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616286592:12345-192.168.202.13@tcp:400:kworker.0 00000100:00100000:0.0:1788572595.108018:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+6:2383:x1875449616286592:12345-192.168.202.13@tcp:400:kworker.0 Request processed in 47us (3182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788572595.108026:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4926 00000100:00100000:0.0:1788572595.108041:0:9276:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.13@tcp, seq: 4927 00000100:00100000:0.0:1788572595.108048:0:9276:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e633dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2382:x1875449616286464:12345-192.168.202.13@tcp:38:kworker.0 00010000:02000400:0.0:1788572595.108069:0:9276:0:(ldlm_lib.c:1341:target_handle_connect()) lustre-MDT0000: Export ffff94e633e09800 already connecting from 192.168.202.13@tcp 00000100:00100000:0.0:1788572595.115564:0:9276:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e633dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35eb2d60-2de0-4b00-9815-d5153edd0057+9:2382:x1875449616286464:12345-192.168.202.13@tcp:38:kworker.0 Request processed in 7506us (10618us total) trans 0 rc -114/-114 00000100:00100000:0.0:1788572595.115578:0:9276:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.13@tcp, seq: 4927 00000100:00100000:2.0:1788572595.205820:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e61e57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639287424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788572595.205895:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788572595.206193:0:42013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875449639287424 00000100:00100000:1.0:1788572595.206202:0:42013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875449639287424 00000100:00100000:1.0:1788572595.206256:0:42013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:1.0:1788572595.206265:0:42013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94e50552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639287424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788572595.206300:0:42013:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446277120 avail 1300037632 00000100:00100000:1.0:1788572595.206364:0:42013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94e50552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875449639287424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788572595.206371:0:42013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:3.0:1788572595.206453:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff94e61e57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1875449639287424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788572595.715473:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788572595.715474:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788572595.715494:0:3653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e506553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1875449639287680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788572595.715502:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff94e50552c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1875449639287552:0@lo:41:osp-pre-0-1.0 Debug log: 70859 lines, 70859 kept, 0 dropped, 0 bad.